2023-06-23T18:26:37.824 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-23T18:26:37.825 DEBUG:teuthology.run:Teuthology command: teuthology --name rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi --archive /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313889 --description fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-common}} --owner scheduled_rishabh@teuthology --verbose -- /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313889/orig.config.yaml 2023-06-23T18:26:37.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T18:26:37.957 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313889 branch: wip-rishabh-improvements-authmon description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-common}} email: null first_in_suite: false job_id: '7313889' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-rishabh-improvements-authmon ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 8627af3e0adcb765a3c249fcc209cba9f4873e1b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8627af3e0adcb765a3c249fcc209cba9f4873e1b kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-improvements-authmon sha1: 8627af3e0adcb765a3c249fcc209cba9f4873e1b owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 sha1: 8627af3e0adcb765a3c249fcc209cba9f4873e1b sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-improvements-authmon suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_8627af3e0adcb765a3c249fcc209cba9f4873e1b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 8627af3e0adcb765a3c249fcc209cba9f4873e1b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi052.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCuwSVvet/dbvZOV5d0NpDrTRFboc5LwnPEoXiPNA5k91N/9W78nJ6HXsjZeAc9bXmLyuLH7bTNa/T3Sqr9pHTluLB886V3mpI6JEywzy0vMXQekwXn/LyY5GrJ+jrLZVzqGLai9Mz4aVHMi3AZo2661Pe89FqnGcY0i+pxkzx5v0pmJ2VZ9ail0fj12zCDznkDB4mbHIHzpoFlMNtGViPaBFG2gOOSi5tKMTjh2Oz/4CXWeK20ttsceSX58nI/pkPhyO0SRfdcCGXwfBM5OH/n2AWuViAqcHJG0zqs+qbbJEwZXyJ1DxC0PIuZccbXnJECrP9EubcETErNssB+pDqofIWj+TSrepfuKLEJo4Z1Zzvu4WdSz0l3Tei6Z76G6bsW1qql9vgILWrB+0GDM63BeW0DJX9X1l5NvAVmv5r3CBKVMmwoecvUImahWZ5dRx2Zl1rJDM3IBSlIPhxGBc6boWxcp5LaCLY4gM52EC46qmAELgVHUtUR0VDA9+vVBI0= smithi089.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjKCEYWhtdLD2qdUqrj8js1imvc+GW6NVfisx6/kIkWEMjUf59lSml+jl9MdPMhtf5XmqgPfOYRx2laiBkaOV+xHvTbzNZgdX1BVUxLNqDFSe7aNKRYTRWcYe3KHj3zKhlPsL4pxN5ztiljM22RWia377wSduh4c4sk2FPA92yv9aN6VjC6aE0mboGsN2Yimly1Fl47ho7kifTHdVeHhb9ZaNnFUXtIwYBea0beTEUObp9VM2Li24sZVvGCQJVh4Ix+Fx+T7YJeuyqPx7+7B0KiNTocYai9Npr/JHQk2giT7zKY8QAbf4RCk+buhxQ6YkUEv03/0+CmqVdPmlurr1ge9SGFH1mOYfVRzQv/VGKt7CP6vJ/ODfR3DUrMoN65jUti6mhKcc22pG+nfaUqgN+ah3zFIVs+X5aGCsiHAsuFQoUPNiNhHqigj0vek/6snO7N+wZ12lXrZ8XjlVwGHALNN6NMOyo1oZrwc935VkU5lVZ/mml8GRsQdBG+Evdr8E= smithi158.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDgbIgfNflO9OCLmCEDDhWNzxtFO641eukcJJZeS5y23pppLgizMZOvlptAn7IwMonISde9y8LkcPtkdES8RTALz3iA6RKlN/lmH2msnf8/Em1JUQBe8D9P1toBc60bfUkGNjL95vV51y2Qixj/0n30+D32iEbQr2uvpCIhuTTo6sblJyT/Y2oxUJFMYzyWU/wJjtgcJ/sEeDbZOu2hSsOplmsgNrTwS0s3suf1C7wUNeoFEqjelZPWrPx6ZMmI3+/oXj9DLH665jCjziej/CzYdWySC2OclPhNg+714chHSJNOtUKDq7vkjDakLIKVc5YbskgsVKNce9AXrpPRVKa8QSg6jLoJtV/TPdg5jAxvQ0C1KU3J9d51YBbp88sAN2p4vQeRqjvARU3VDl+iCBqNhyagfZ8OMutDc2DD5J/M13RQv0RKEWDkT/xpTGYhLwXoJZ1BIyzxTgMlvLBqByKqXYZeDcgmoqJJblqCbNtoesEaxW07vTo/uHXAlWO6yls= task: null tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_fscrypt teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end - if not is_kupstream() then reject() end teuthology_branch: main teuthology_sha1: 076bbebc42a14f7d568aaa78eabb0038327bcb23 timestamp: 2023-06-23_17:37:30 tube: smithi user: rishabh verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-06-23T18:26:37.958 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_8627af3e0adcb765a3c249fcc209cba9f4873e1b/qa; will attempt to use it 2023-06-23T18:26:37.958 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_8627af3e0adcb765a3c249fcc209cba9f4873e1b/qa/tasks 2023-06-23T18:26:37.959 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-06-23T18:26:37.960 INFO:teuthology.task.internal:Checking packages... 2023-06-23T18:26:37.989 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8627af3e0adcb765a3c249fcc209cba9f4873e1b' 2023-06-23T18:26:37.990 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-06-23T18:26:37.990 INFO:teuthology.packaging:ref: None 2023-06-23T18:26:37.991 INFO:teuthology.packaging:tag: None 2023-06-23T18:26:37.991 INFO:teuthology.packaging:branch: wip-rishabh-improvements-authmon 2023-06-23T18:26:37.991 INFO:teuthology.packaging:sha1: 8627af3e0adcb765a3c249fcc209cba9f4873e1b 2023-06-23T18:26:37.991 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-rishabh-improvements-authmon 2023-06-23T18:26:38.133 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4479.g8627af3e 2023-06-23T18:26:38.133 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-06-23T18:26:38.140 INFO:teuthology.task.internal:no buildpackages task found 2023-06-23T18:26:38.141 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-06-23T18:26:38.146 INFO:teuthology.task.internal:Saving configuration 2023-06-23T18:26:38.163 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-06-23T18:26:38.177 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T18:26:38.207 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313889', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 18:20:53.311861', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGO0xDlK55OS7Fmby0kZeeXE9IoM/drgree+r1aaY95BKYzOjvNyAUpcnwYKxvAOFGoseKtygUalxNJ5iAdeTfw='} 2023-06-23T18:26:38.232 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313889', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 18:20:53.308541', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBYwqTQwW3Zr0ungiAMLNNp08S0fkAGtTTXFoPqVj6THilkeyRpw+G/5DbMTf+ieBhlmdxxc48tmdcmwR04qJVI='} 2023-06-23T18:26:38.254 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi158.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313889', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 18:20:53.310332', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIYkvVt3PBOE7d4aNuJKGo7D/B8Zfgu2aJcVDaWvSqDprcZ1snyW6THFrMfYeXMkKYZsxDRBR1TO+TceVHXK7ZE='} 2023-06-23T18:26:38.254 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-06-23T18:26:38.264 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-06-23T18:26:38.265 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-06-23T18:26:38.265 INFO:teuthology.task.internal:roles: ubuntu@smithi158.front.sepia.ceph.com - ['client.0'] 2023-06-23T18:26:38.265 INFO:teuthology.run_tasks:Running task console_log... 2023-06-23T18:26:38.384 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f56325b2ee0>, signals=[15]) 2023-06-23T18:26:38.385 INFO:teuthology.run_tasks:Running task internal.connect... 2023-06-23T18:26:38.395 INFO:teuthology.task.internal:Opening connections... 2023-06-23T18:26:38.395 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi052.front.sepia.ceph.com 2023-06-23T18:26:38.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:26:38.469 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2023-06-23T18:26:38.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:26:38.540 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi158.front.sepia.ceph.com 2023-06-23T18:26:38.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:26:38.609 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-06-23T18:26:38.616 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2023-06-23T18:26:38.640 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2023-06-23T18:26:38.640 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2023-06-23T18:26:38.702 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2023-06-23T18:26:38.702 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="8" 2023-06-23T18:26:38.702 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2023-06-23T18:26:38.702 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2023-06-23T18:26:38.702 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="8" 2023-06-23T18:26:38.703 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el8" 2023-06-23T18:26:38.703 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-23T18:26:38.703 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2023-06-23T18:26:38.703 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-23T18:26:38.703 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2023-06-23T18:26:38.703 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-23T18:26:38.704 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-23T18:26:38.704 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-23T18:26:38.704 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2023-06-23T18:26:38.730 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2023-06-23T18:26:38.752 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2023-06-23T18:26:38.753 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-06-23T18:26:38.812 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2023-06-23T18:26:38.813 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="8" 2023-06-23T18:26:38.813 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2023-06-23T18:26:38.813 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2023-06-23T18:26:38.813 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="8" 2023-06-23T18:26:38.813 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el8" 2023-06-23T18:26:38.813 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-23T18:26:38.814 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2023-06-23T18:26:38.814 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-23T18:26:38.814 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2023-06-23T18:26:38.814 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-23T18:26:38.814 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-23T18:26:38.814 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-23T18:26:38.815 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-06-23T18:26:38.838 DEBUG:teuthology.orchestra.run.smithi158:> uname -m 2023-06-23T18:26:38.860 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2023-06-23T18:26:38.860 DEBUG:teuthology.orchestra.run.smithi158:> cat /etc/os-release 2023-06-23T18:26:38.921 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="CentOS Stream" 2023-06-23T18:26:38.922 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8" 2023-06-23T18:26:38.922 INFO:teuthology.orchestra.run.smithi158.stdout:ID="centos" 2023-06-23T18:26:38.922 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="rhel fedora" 2023-06-23T18:26:38.922 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8" 2023-06-23T18:26:38.923 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2023-06-23T18:26:38.923 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-23T18:26:38.924 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2023-06-23T18:26:38.924 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-23T18:26:38.924 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://centos.org/" 2023-06-23T18:26:38.924 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-23T18:26:38.924 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-23T18:26:38.924 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-23T18:26:38.925 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2023-06-23T18:26:38.946 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-06-23T18:26:38.954 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-06-23T18:26:38.960 INFO:teuthology.task.internal:Checking for old test directory... 2023-06-23T18:26:38.961 DEBUG:teuthology.orchestra.run.smithi052:> test '!' -e /home/ubuntu/cephtest 2023-06-23T18:26:38.963 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2023-06-23T18:26:38.966 DEBUG:teuthology.orchestra.run.smithi158:> test '!' -e /home/ubuntu/cephtest 2023-06-23T18:26:38.985 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-06-23T18:26:38.994 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-06-23T18:26:38.994 DEBUG:teuthology.orchestra.run.smithi052:> test -z $(ls -A /var/lib/ceph) 2023-06-23T18:26:39.026 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2023-06-23T18:26:39.029 DEBUG:teuthology.orchestra.run.smithi158:> test -z $(ls -A /var/lib/ceph) 2023-06-23T18:26:39.075 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-06-23T18:26:39.168 INFO:teuthology.run_tasks:Running task kernel... 2023-06-23T18:26:39.188 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-06-23T18:26:39.189 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-06-23T18:26:39.189 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-06-23T18:26:39.190 DEBUG:teuthology.orchestra.run.smithi158:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-23T18:26:39.210 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:26:39.211 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-06-23T18:26:39.365 DEBUG:teuthology.task.kernel:sha1 for client.0 is 1c622d92b6f18ce44a7c33802686ff61c3c273ab 2023-06-23T18:26:39.365 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "1c622d92b6f18ce44a7c33802686ff61c3c273ab"... 2023-06-23T18:26:39.365 DEBUG:teuthology.orchestra.run.smithi158:> uname -r 2023-06-23T18:26:39.387 INFO:teuthology.orchestra.run.smithi158.stdout:4.18.0-489.el8.x86_64 2023-06-23T18:26:39.387 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 1c622d92b6f18ce44a7c33802686ff61c3c273ab 2023-06-23T18:26:39.387 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-06-23T18:26:39.388 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum upgrade -y linux-firmware 2023-06-23T18:26:48.493 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - AppStream 4.7 MB/s | 30 MB 00:06 2023-06-23T18:26:55.494 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - BaseOS 24 MB/s | 39 MB 00:01 2023-06-23T18:27:01.860 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - Extras 29 kB/s | 18 kB 00:00 2023-06-23T18:27:02.196 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - Extras common packages 39 kB/s | 6.6 kB 00:00 2023-06-23T18:27:05.023 INFO:teuthology.orchestra.run.smithi158.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-06-23T18:27:06.065 INFO:teuthology.orchestra.run.smithi158.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2023-06-23T18:27:09.865 INFO:teuthology.orchestra.run.smithi158.stdout:lab-extras 256 kB/s | 24 kB 00:00 2023-06-23T18:27:13.288 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-06-23T18:27:13.289 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-06-23T18:27:13.289 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repo Size 2023-06-23T18:27:13.290 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-06-23T18:27:13.290 INFO:teuthology.orchestra.run.smithi158.stdout:Upgrading: 2023-06-23T18:27:13.290 INFO:teuthology.orchestra.run.smithi158.stdout: linux-firmware noarch 20230515-115.gitd1962891.el8 baseos 266 M 2023-06-23T18:27:13.290 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:27:13.290 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-06-23T18:27:13.290 INFO:teuthology.orchestra.run.smithi158.stdout:================================================================================ 2023-06-23T18:27:13.290 INFO:teuthology.orchestra.run.smithi158.stdout:Upgrade 1 Package 2023-06-23T18:27:13.291 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:27:13.291 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 266 M 2023-06-23T18:27:13.291 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2023-06-23T18:27:27.282 INFO:teuthology.orchestra.run.smithi158.stdout:linux-firmware-20230515-115.gitd1962891.el8.noa 19 MB/s | 266 MB 00:13 2023-06-23T18:27:27.283 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2023-06-23T18:27:27.283 INFO:teuthology.orchestra.run.smithi158.stdout:Total 19 MB/s | 266 MB 00:13 2023-06-23T18:27:28.862 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-06-23T18:27:28.936 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-06-23T18:27:28.937 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-06-23T18:27:30.582 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-06-23T18:27:30.615 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-06-23T18:27:48.593 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-06-23T18:27:49.023 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-06-23T18:27:49.275 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-06-23T18:27:49.498 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-06-23T18:27:49.499 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-06-23T18:27:50.205 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-06-23T18:27:50.206 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:27:50.206 INFO:teuthology.orchestra.run.smithi158.stdout:Upgraded: 2023-06-23T18:27:50.206 INFO:teuthology.orchestra.run.smithi158.stdout: linux-firmware-20230515-115.gitd1962891.el8.noarch 2023-06-23T18:27:50.206 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:27:50.206 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-06-23T18:27:50.424 INFO:teuthology.task.kernel:Downloading kernel 1c622d92b6f18ce44a7c33802686ff61c3c273ab on client.0... 2023-06-23T18:27:50.425 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1c622d92b6f18ce44a7c33802686ff61c3c273ab 2023-06-23T18:27:50.565 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/1c622d92b6f18ce44a7c33802686ff61c3c273ab/centos/8/flavors/default/x86_64/ 2023-06-23T18:27:50.565 DEBUG:teuthology.orchestra.run.smithi158:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.4.0_rc5_g1c622d92b6f1-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/1c622d92b6f18ce44a7c33802686ff61c3c273ab/centos/8/flavors/default/x86_64/ --input-file=- 2023-06-23T18:27:50.567 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi158.front.sepia.ceph.com to complete... 2023-06-23T18:28:03.394 INFO:teuthology.orchestra.run.smithi158.stderr:2023-06-23 18:28:03 URL:https://2.chacra.ceph.com/r/kernel/testing/1c622d92b6f18ce44a7c33802686ff61c3c273ab/centos/8/flavors/default/x86_64/kernel-6.4.0_rc5_g1c622d92b6f1-1.x86_64.rpm [379883408/379883408] -> "/tmp/kernel.x86_64.rpm" [1] 2023-06-23T18:28:03.395 INFO:teuthology.orchestra.run.smithi158.stderr:FINISHED --2023-06-23 18:28:03-- 2023-06-23T18:28:03.395 INFO:teuthology.orchestra.run.smithi158.stderr:Total wall clock time: 13s 2023-06-23T18:28:03.395 INFO:teuthology.orchestra.run.smithi158.stderr:Downloaded: 1 files, 362M in 13s (28.9 MB/s) 2023-06-23T18:28:03.396 INFO:teuthology.task.kernel:Installing kernel 1c622d92b6f18ce44a7c33802686ff61c3c273ab on client.0... 2023-06-23T18:28:03.396 DEBUG:teuthology.orchestra.run.smithi158:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-06-23T18:28:05.060 INFO:teuthology.orchestra.run.smithi158.stdout:Verifying... ######################################## 2023-06-23T18:28:05.104 INFO:teuthology.orchestra.run.smithi158.stdout:Preparing... ######################################## 2023-06-23T18:28:05.213 INFO:teuthology.orchestra.run.smithi158.stdout:Updating / installing... 2023-06-23T18:28:42.990 INFO:teuthology.orchestra.run.smithi158.stdout:kernel-6.4.0_rc5_g1c622d92b6f1-1 ######################################## 2023-06-23T18:29:04.606 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi158.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-06-23T18:29:04.607 DEBUG:teuthology.orchestra.run.smithi158:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-06-23T18:29:04.654 INFO:teuthology.orchestra.run.smithi158.stdout:/boot/System.map-6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:29:04.654 INFO:teuthology.orchestra.run.smithi158.stdout:/boot/config-6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:29:04.654 INFO:teuthology.orchestra.run.smithi158.stdout:/boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:29:04.654 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:29:04.654 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel 2023-06-23T18:29:04.654 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch 2023-06-23T18:29:04.655 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86 2023-06-23T18:29:04.655 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto 2023-06-23T18:29:04.655 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-06-23T18:29:04.655 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-06-23T18:29:04.655 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-06-23T18:29:04.655 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-06-23T18:29:04.655 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-06-23T18:29:04.656 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-06-23T18:29:04.656 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-06-23T18:29:04.656 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/crc32c-intel.ko 2023-06-23T18:29:04.656 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-06-23T18:29:04.656 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-06-23T18:29:04.656 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-06-23T18:29:04.656 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-06-23T18:29:04.657 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/serpent-avx2.ko 2023-06-23T18:29:04.657 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-06-23T18:29:04.657 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-06-23T18:29:04.657 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-06-23T18:29:04.657 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-06-23T18:29:04.657 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-06-23T18:29:04.657 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-06-23T18:29:04.657 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-06-23T18:29:04.658 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel 2023-06-23T18:29:04.658 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel/cpu 2023-06-23T18:29:04.658 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel/cpu/mce 2023-06-23T18:29:04.658 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-06-23T18:29:04.658 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm 2023-06-23T18:29:04.658 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm/kvm-amd.ko 2023-06-23T18:29:04.658 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm/kvm-intel.ko 2023-06-23T18:29:04.659 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm/kvm.ko 2023-06-23T18:29:04.659 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto 2023-06-23T18:29:04.659 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/ansi_cprng.ko 2023-06-23T18:29:04.659 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/anubis.ko 2023-06-23T18:29:04.659 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/arc4.ko 2023-06-23T18:29:04.659 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx 2023-06-23T18:29:04.659 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_memcpy.ko 2023-06-23T18:29:04.659 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_pq.ko 2023-06-23T18:29:04.660 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_raid6_recov.ko 2023-06-23T18:29:04.660 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_tx.ko 2023-06-23T18:29:04.660 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_xor.ko 2023-06-23T18:29:04.660 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/raid6test.ko 2023-06-23T18:29:04.660 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/authenc.ko 2023-06-23T18:29:04.660 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/authencesn.ko 2023-06-23T18:29:04.660 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/blake2b_generic.ko 2023-06-23T18:29:04.661 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/blowfish_common.ko 2023-06-23T18:29:04.661 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/blowfish_generic.ko 2023-06-23T18:29:04.661 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/camellia_generic.ko 2023-06-23T18:29:04.661 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cast5_generic.ko 2023-06-23T18:29:04.661 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cast6_generic.ko 2023-06-23T18:29:04.661 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cast_common.ko 2023-06-23T18:29:04.661 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/ccm.ko 2023-06-23T18:29:04.661 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cmac.ko 2023-06-23T18:29:04.662 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/crc32_generic.ko 2023-06-23T18:29:04.662 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/crypto_engine.ko 2023-06-23T18:29:04.662 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/crypto_user.ko 2023-06-23T18:29:04.662 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cts.ko 2023-06-23T18:29:04.662 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/des_generic.ko 2023-06-23T18:29:04.662 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/dh_generic.ko 2023-06-23T18:29:04.662 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/echainiv.ko 2023-06-23T18:29:04.663 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/essiv.ko 2023-06-23T18:29:04.663 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/fcrypt.ko 2023-06-23T18:29:04.663 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/khazad.ko 2023-06-23T18:29:04.663 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/lz4.ko 2023-06-23T18:29:04.663 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/lz4hc.ko 2023-06-23T18:29:04.663 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/md4.ko 2023-06-23T18:29:04.663 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/michael_mic.ko 2023-06-23T18:29:04.663 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/pcbc.ko 2023-06-23T18:29:04.664 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/pcrypt.ko 2023-06-23T18:29:04.664 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/rmd160.ko 2023-06-23T18:29:04.664 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/seed.ko 2023-06-23T18:29:04.664 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/serpent_generic.ko 2023-06-23T18:29:04.664 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/tcrypt.ko 2023-06-23T18:29:04.664 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/tea.ko 2023-06-23T18:29:04.664 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/twofish_common.ko 2023-06-23T18:29:04.664 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/twofish_generic.ko 2023-06-23T18:29:04.665 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/vmac.ko 2023-06-23T18:29:04.665 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/wp512.ko 2023-06-23T18:29:04.665 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/xcbc.ko 2023-06-23T18:29:04.665 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/xor.ko 2023-06-23T18:29:04.665 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/xxhash_generic.ko 2023-06-23T18:29:04.665 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers 2023-06-23T18:29:04.665 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi 2023-06-23T18:29:04.666 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/acpi_ipmi.ko 2023-06-23T18:29:04.666 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/acpi_pad.ko 2023-06-23T18:29:04.666 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/custom_method.ko 2023-06-23T18:29:04.666 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/ec_sys.ko 2023-06-23T18:29:04.666 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/platform_profile.ko 2023-06-23T18:29:04.666 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/sbs.ko 2023-06-23T18:29:04.666 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/sbshc.ko 2023-06-23T18:29:04.666 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/video.ko 2023-06-23T18:29:04.667 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata 2023-06-23T18:29:04.667 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/acard-ahci.ko 2023-06-23T18:29:04.667 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/ahci_platform.ko 2023-06-23T18:29:04.667 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/ata_generic.ko 2023-06-23T18:29:04.667 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/libahci_platform.ko 2023-06-23T18:29:04.667 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_acpi.ko 2023-06-23T18:29:04.667 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ali.ko 2023-06-23T18:29:04.667 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_amd.ko 2023-06-23T18:29:04.668 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_artop.ko 2023-06-23T18:29:04.668 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_atiixp.ko 2023-06-23T18:29:04.668 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_atp867x.ko 2023-06-23T18:29:04.668 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_cmd640.ko 2023-06-23T18:29:04.668 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_cmd64x.ko 2023-06-23T18:29:04.668 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_cypress.ko 2023-06-23T18:29:04.668 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_efar.ko 2023-06-23T18:29:04.669 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt366.ko 2023-06-23T18:29:04.669 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt37x.ko 2023-06-23T18:29:04.669 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt3x2n.ko 2023-06-23T18:29:04.669 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt3x3.ko 2023-06-23T18:29:04.669 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_it8213.ko 2023-06-23T18:29:04.669 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_it821x.ko 2023-06-23T18:29:04.669 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_jmicron.ko 2023-06-23T18:29:04.669 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_marvell.ko 2023-06-23T18:29:04.670 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_mpiix.ko 2023-06-23T18:29:04.670 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_netcell.ko 2023-06-23T18:29:04.670 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ninja32.ko 2023-06-23T18:29:04.670 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ns87410.ko 2023-06-23T18:29:04.670 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ns87415.ko 2023-06-23T18:29:04.670 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_oldpiix.ko 2023-06-23T18:29:04.670 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_opti.ko 2023-06-23T18:29:04.671 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_optidma.ko 2023-06-23T18:29:04.671 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_pcmcia.ko 2023-06-23T18:29:04.671 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_pdc2027x.ko 2023-06-23T18:29:04.671 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-06-23T18:29:04.671 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_piccolo.ko 2023-06-23T18:29:04.671 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_rdc.ko 2023-06-23T18:29:04.671 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sch.ko 2023-06-23T18:29:04.671 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_serverworks.ko 2023-06-23T18:29:04.672 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sil680.ko 2023-06-23T18:29:04.672 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sis.ko 2023-06-23T18:29:04.672 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sl82c105.ko 2023-06-23T18:29:04.672 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_triflex.ko 2023-06-23T18:29:04.672 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_via.ko 2023-06-23T18:29:04.672 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pdc_adma.ko 2023-06-23T18:29:04.672 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_inic162x.ko 2023-06-23T18:29:04.673 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_mv.ko 2023-06-23T18:29:04.673 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_nv.ko 2023-06-23T18:29:04.673 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_promise.ko 2023-06-23T18:29:04.673 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_qstor.ko 2023-06-23T18:29:04.673 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sil.ko 2023-06-23T18:29:04.673 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sil24.ko 2023-06-23T18:29:04.673 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sis.ko 2023-06-23T18:29:04.673 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_svw.ko 2023-06-23T18:29:04.674 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sx4.ko 2023-06-23T18:29:04.674 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_uli.ko 2023-06-23T18:29:04.674 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_via.ko 2023-06-23T18:29:04.674 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_vsc.ko 2023-06-23T18:29:04.674 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/auxdisplay 2023-06-23T18:29:04.674 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/auxdisplay/ks0108.ko 2023-06-23T18:29:04.674 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/base 2023-06-23T18:29:04.674 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/base/regmap 2023-06-23T18:29:04.675 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/base/regmap/regmap-i2c.ko 2023-06-23T18:29:04.675 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/bcma 2023-06-23T18:29:04.675 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/bcma/bcma.ko 2023-06-23T18:29:04.675 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block 2023-06-23T18:29:04.675 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/aoe 2023-06-23T18:29:04.675 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/aoe/aoe.ko 2023-06-23T18:29:04.675 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/brd.ko 2023-06-23T18:29:04.675 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/drbd 2023-06-23T18:29:04.676 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/drbd/drbd.ko 2023-06-23T18:29:04.676 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/floppy.ko 2023-06-23T18:29:04.676 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/loop.ko 2023-06-23T18:29:04.676 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/mtip32xx 2023-06-23T18:29:04.676 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-06-23T18:29:04.676 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/nbd.ko 2023-06-23T18:29:04.676 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/null_blk 2023-06-23T18:29:04.677 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/null_blk/null_blk.ko 2023-06-23T18:29:04.677 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/pktcdvd.ko 2023-06-23T18:29:04.677 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/rbd.ko 2023-06-23T18:29:04.677 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/virtio_blk.ko 2023-06-23T18:29:04.677 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/xen-blkback 2023-06-23T18:29:04.677 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-06-23T18:29:04.677 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/xen-blkfront.ko 2023-06-23T18:29:04.677 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/zram 2023-06-23T18:29:04.678 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/zram/zram.ko 2023-06-23T18:29:04.678 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char 2023-06-23T18:29:04.678 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hangcheck-timer.ko 2023-06-23T18:29:04.678 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random 2023-06-23T18:29:04.678 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/amd-rng.ko 2023-06-23T18:29:04.678 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/intel-rng.ko 2023-06-23T18:29:04.678 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-06-23T18:29:04.679 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/via-rng.ko 2023-06-23T18:29:04.679 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/virtio-rng.ko 2023-06-23T18:29:04.679 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi 2023-06-23T18:29:04.679 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-06-23T18:29:04.679 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-06-23T18:29:04.679 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-06-23T18:29:04.679 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_si.ko 2023-06-23T18:29:04.679 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-06-23T18:29:04.680 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-06-23T18:29:04.680 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/lp.ko 2023-06-23T18:29:04.680 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/mwave 2023-06-23T18:29:04.680 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/mwave/mwave.ko 2023-06-23T18:29:04.680 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ppdev.ko 2023-06-23T18:29:04.680 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tlclk.ko 2023-06-23T18:29:04.680 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm 2023-06-23T18:29:04.680 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm.ko 2023-06-23T18:29:04.681 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_atmel.ko 2023-06-23T18:29:04.681 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_infineon.ko 2023-06-23T18:29:04.681 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_nsc.ko 2023-06-23T18:29:04.681 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_tis.ko 2023-06-23T18:29:04.681 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-06-23T18:29:04.681 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/uv_mmtimer.ko 2023-06-23T18:29:04.681 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/virtio_console.ko 2023-06-23T18:29:04.682 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq 2023-06-23T18:29:04.682 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-06-23T18:29:04.682 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-06-23T18:29:04.682 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/p4-clockmod.ko 2023-06-23T18:29:04.682 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-06-23T18:29:04.682 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/powernow-k8.ko 2023-06-23T18:29:04.682 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/speedstep-lib.ko 2023-06-23T18:29:04.682 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto 2023-06-23T18:29:04.683 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/ccp 2023-06-23T18:29:04.683 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-06-23T18:29:04.683 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/ccp/ccp.ko 2023-06-23T18:29:04.683 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel 2023-06-23T18:29:04.683 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat 2023-06-23T18:29:04.683 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_common 2023-06-23T18:29:04.683 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-06-23T18:29:04.683 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-06-23T18:29:04.684 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-06-23T18:29:04.684 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/padlock-aes.ko 2023-06-23T18:29:04.684 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/padlock-sha.ko 2023-06-23T18:29:04.684 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/virtio 2023-06-23T18:29:04.684 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-06-23T18:29:04.684 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dca 2023-06-23T18:29:04.684 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dca/dca.ko 2023-06-23T18:29:04.685 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/devfreq 2023-06-23T18:29:04.685 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-06-23T18:29:04.685 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma 2023-06-23T18:29:04.685 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/dw 2023-06-23T18:29:04.685 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/dw/dw_dmac.ko 2023-06-23T18:29:04.685 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/ioat 2023-06-23T18:29:04.685 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/ioat/ioatdma.ko 2023-06-23T18:29:04.685 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac 2023-06-23T18:29:04.686 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/amd64_edac.ko 2023-06-23T18:29:04.686 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/e752x_edac.ko 2023-06-23T18:29:04.686 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/edac_mce_amd.ko 2023-06-23T18:29:04.686 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i3000_edac.ko 2023-06-23T18:29:04.686 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i3200_edac.ko 2023-06-23T18:29:04.686 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i5100_edac.ko 2023-06-23T18:29:04.686 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i5400_edac.ko 2023-06-23T18:29:04.686 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i7300_edac.ko 2023-06-23T18:29:04.687 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i7core_edac.ko 2023-06-23T18:29:04.687 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i82975x_edac.ko 2023-06-23T18:29:04.687 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/ie31200_edac.ko 2023-06-23T18:29:04.687 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/sb_edac.ko 2023-06-23T18:29:04.687 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/x38_edac.ko 2023-06-23T18:29:04.687 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/firmware 2023-06-23T18:29:04.687 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/firmware/edd.ko 2023-06-23T18:29:04.688 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/firmware/iscsi_ibft.ko 2023-06-23T18:29:04.688 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/gpio 2023-06-23T18:29:04.688 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/gpio/gpio-ich.ko 2023-06-23T18:29:04.688 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/gpio/gpio-viperboard.ko 2023-06-23T18:29:04.688 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid 2023-06-23T18:29:04.688 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-appleir.ko 2023-06-23T18:29:04.688 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-aureal.ko 2023-06-23T18:29:04.688 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-axff.ko 2023-06-23T18:29:04.689 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-dr.ko 2023-06-23T18:29:04.689 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-elecom.ko 2023-06-23T18:29:04.689 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-elo.ko 2023-06-23T18:29:04.689 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-emsff.ko 2023-06-23T18:29:04.689 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-gaff.ko 2023-06-23T18:29:04.689 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-gt683r.ko 2023-06-23T18:29:04.689 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-gyration.ko 2023-06-23T18:29:04.689 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-holtek-kbd.ko 2023-06-23T18:29:04.690 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-holtek-mouse.ko 2023-06-23T18:29:04.690 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-holtekff.ko 2023-06-23T18:29:04.690 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-hyperv.ko 2023-06-23T18:29:04.690 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-icade.ko 2023-06-23T18:29:04.690 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-keytouch.ko 2023-06-23T18:29:04.690 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-kye.ko 2023-06-23T18:29:04.690 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-lcpower.ko 2023-06-23T18:29:04.690 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-led.ko 2023-06-23T18:29:04.691 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-lenovo.ko 2023-06-23T18:29:04.691 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-logitech-dj.ko 2023-06-23T18:29:04.691 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-06-23T18:29:04.691 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-multitouch.ko 2023-06-23T18:29:04.691 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-ortek.ko 2023-06-23T18:29:04.691 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-penmount.ko 2023-06-23T18:29:04.691 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-petalynx.ko 2023-06-23T18:29:04.692 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-picolcd.ko 2023-06-23T18:29:04.692 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-pl.ko 2023-06-23T18:29:04.692 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-plantronics.ko 2023-06-23T18:29:04.692 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-primax.ko 2023-06-23T18:29:04.692 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-rmi.ko 2023-06-23T18:29:04.692 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-arvo.ko 2023-06-23T18:29:04.692 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-common.ko 2023-06-23T18:29:04.692 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-isku.ko 2023-06-23T18:29:04.693 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-kone.ko 2023-06-23T18:29:04.693 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-06-23T18:29:04.693 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-konepure.ko 2023-06-23T18:29:04.693 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-06-23T18:29:04.693 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-lua.ko 2023-06-23T18:29:04.693 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-pyra.ko 2023-06-23T18:29:04.693 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-ryos.ko 2023-06-23T18:29:04.693 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-savu.ko 2023-06-23T18:29:04.694 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat.ko 2023-06-23T18:29:04.694 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-saitek.ko 2023-06-23T18:29:04.694 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-samsung.ko 2023-06-23T18:29:04.694 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sensor-hub.ko 2023-06-23T18:29:04.694 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sjoy.ko 2023-06-23T18:29:04.694 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sony.ko 2023-06-23T18:29:04.694 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-speedlink.ko 2023-06-23T18:29:04.694 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-steelseries.ko 2023-06-23T18:29:04.695 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sunplus.ko 2023-06-23T18:29:04.695 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-thrustmaster.ko 2023-06-23T18:29:04.695 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-tivo.ko 2023-06-23T18:29:04.695 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-tmff.ko 2023-06-23T18:29:04.695 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-topseed.ko 2023-06-23T18:29:04.695 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-twinhan.ko 2023-06-23T18:29:04.695 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-uclogic.ko 2023-06-23T18:29:04.696 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-waltop.ko 2023-06-23T18:29:04.696 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-wiimote.ko 2023-06-23T18:29:04.696 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-xinmo.ko 2023-06-23T18:29:04.696 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-zpff.ko 2023-06-23T18:29:04.696 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-zydacron.ko 2023-06-23T18:29:04.696 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/uhid.ko 2023-06-23T18:29:04.696 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/wacom.ko 2023-06-23T18:29:04.696 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv 2023-06-23T18:29:04.697 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv/hv_balloon.ko 2023-06-23T18:29:04.697 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv/hv_utils.ko 2023-06-23T18:29:04.697 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv/hv_vmbus.ko 2023-06-23T18:29:04.697 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon 2023-06-23T18:29:04.697 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/abituguru.ko 2023-06-23T18:29:04.697 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/abituguru3.ko 2023-06-23T18:29:04.697 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/acpi_power_meter.ko 2023-06-23T18:29:04.698 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ad7414.ko 2023-06-23T18:29:04.698 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ad7418.ko 2023-06-23T18:29:04.698 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adc128d818.ko 2023-06-23T18:29:04.698 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1025.ko 2023-06-23T18:29:04.698 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1026.ko 2023-06-23T18:29:04.698 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1029.ko 2023-06-23T18:29:04.698 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1031.ko 2023-06-23T18:29:04.698 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm9240.ko 2023-06-23T18:29:04.699 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ads7828.ko 2023-06-23T18:29:04.699 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7410.ko 2023-06-23T18:29:04.699 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7411.ko 2023-06-23T18:29:04.699 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7462.ko 2023-06-23T18:29:04.699 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7470.ko 2023-06-23T18:29:04.699 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7475.ko 2023-06-23T18:29:04.699 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7x10.ko 2023-06-23T18:29:04.699 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/amc6821.ko 2023-06-23T18:29:04.700 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/applesmc.ko 2023-06-23T18:29:04.700 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/asb100.ko 2023-06-23T18:29:04.700 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/asc7621.ko 2023-06-23T18:29:04.700 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/asus_atk0110.ko 2023-06-23T18:29:04.700 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/atxp1.ko 2023-06-23T18:29:04.700 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/coretemp.ko 2023-06-23T18:29:04.700 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-06-23T18:29:04.701 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/dme1737.ko 2023-06-23T18:29:04.701 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ds1621.ko 2023-06-23T18:29:04.701 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ds620.ko 2023-06-23T18:29:04.701 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/emc1403.ko 2023-06-23T18:29:04.701 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/emc6w201.ko 2023-06-23T18:29:04.701 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/f71805f.ko 2023-06-23T18:29:04.701 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/f71882fg.ko 2023-06-23T18:29:04.702 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/f75375s.ko 2023-06-23T18:29:04.702 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/fam15h_power.ko 2023-06-23T18:29:04.702 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/fschmd.ko 2023-06-23T18:29:04.702 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/g760a.ko 2023-06-23T18:29:04.702 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/g762.ko 2023-06-23T18:29:04.702 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/gl518sm.ko 2023-06-23T18:29:04.702 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/gl520sm.ko 2023-06-23T18:29:04.702 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/hwmon-vid.ko 2023-06-23T18:29:04.703 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/i5500_temp.ko 2023-06-23T18:29:04.703 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/i5k_amb.ko 2023-06-23T18:29:04.703 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ibmaem.ko 2023-06-23T18:29:04.703 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ibmpex.ko 2023-06-23T18:29:04.703 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ina209.ko 2023-06-23T18:29:04.703 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ina2xx.ko 2023-06-23T18:29:04.703 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/it87.ko 2023-06-23T18:29:04.703 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/k10temp.ko 2023-06-23T18:29:04.704 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/k8temp.ko 2023-06-23T18:29:04.704 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lineage-pem.ko 2023-06-23T18:29:04.704 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm63.ko 2023-06-23T18:29:04.704 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm73.ko 2023-06-23T18:29:04.704 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm75.ko 2023-06-23T18:29:04.704 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm77.ko 2023-06-23T18:29:04.704 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm78.ko 2023-06-23T18:29:04.704 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm80.ko 2023-06-23T18:29:04.705 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm83.ko 2023-06-23T18:29:04.705 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm85.ko 2023-06-23T18:29:04.705 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm87.ko 2023-06-23T18:29:04.705 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm90.ko 2023-06-23T18:29:04.705 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm92.ko 2023-06-23T18:29:04.705 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm93.ko 2023-06-23T18:29:04.705 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm95234.ko 2023-06-23T18:29:04.706 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm95241.ko 2023-06-23T18:29:04.706 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm95245.ko 2023-06-23T18:29:04.706 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc2945.ko 2023-06-23T18:29:04.706 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4151.ko 2023-06-23T18:29:04.706 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4215.ko 2023-06-23T18:29:04.706 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4222.ko 2023-06-23T18:29:04.706 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4245.ko 2023-06-23T18:29:04.706 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4260.ko 2023-06-23T18:29:04.707 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4261.ko 2023-06-23T18:29:04.707 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max16065.ko 2023-06-23T18:29:04.707 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max1619.ko 2023-06-23T18:29:04.707 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max1668.ko 2023-06-23T18:29:04.707 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max197.ko 2023-06-23T18:29:04.707 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max6639.ko 2023-06-23T18:29:04.707 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max6650.ko 2023-06-23T18:29:04.707 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max6697.ko 2023-06-23T18:29:04.708 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/mcp3021.ko 2023-06-23T18:29:04.708 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct6683.ko 2023-06-23T18:29:04.708 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct6775-core.ko 2023-06-23T18:29:04.708 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct6775.ko 2023-06-23T18:29:04.708 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct7802.ko 2023-06-23T18:29:04.708 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pc87360.ko 2023-06-23T18:29:04.709 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pc87427.ko 2023-06-23T18:29:04.709 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pcf8591.ko 2023-06-23T18:29:04.709 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus 2023-06-23T18:29:04.709 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-06-23T18:29:04.709 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-06-23T18:29:04.709 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-06-23T18:29:04.709 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/max16064.ko 2023-06-23T18:29:04.709 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/max34440.ko 2023-06-23T18:29:04.710 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/max8688.ko 2023-06-23T18:29:04.710 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-06-23T18:29:04.710 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-06-23T18:29:04.710 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-06-23T18:29:04.710 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-06-23T18:29:04.710 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-06-23T18:29:04.710 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-06-23T18:29:04.711 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/powr1220.ko 2023-06-23T18:29:04.711 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sch5627.ko 2023-06-23T18:29:04.711 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sch5636.ko 2023-06-23T18:29:04.711 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sch56xx-common.ko 2023-06-23T18:29:04.711 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sht15.ko 2023-06-23T18:29:04.711 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sht21.ko 2023-06-23T18:29:04.711 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/shtc1.ko 2023-06-23T18:29:04.711 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sis5595.ko 2023-06-23T18:29:04.712 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/smsc47b397.ko 2023-06-23T18:29:04.712 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/smsc47m1.ko 2023-06-23T18:29:04.712 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/smsc47m192.ko 2023-06-23T18:29:04.712 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/thmc50.ko 2023-06-23T18:29:04.712 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp102.ko 2023-06-23T18:29:04.712 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp103.ko 2023-06-23T18:29:04.712 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp401.ko 2023-06-23T18:29:04.712 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp421.ko 2023-06-23T18:29:04.713 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/via-cputemp.ko 2023-06-23T18:29:04.713 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/via686a.ko 2023-06-23T18:29:04.713 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/vt1211.ko 2023-06-23T18:29:04.713 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/vt8231.ko 2023-06-23T18:29:04.713 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83627ehf.ko 2023-06-23T18:29:04.713 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83627hf.ko 2023-06-23T18:29:04.713 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83781d.ko 2023-06-23T18:29:04.714 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83791d.ko 2023-06-23T18:29:04.714 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83792d.ko 2023-06-23T18:29:04.714 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83793.ko 2023-06-23T18:29:04.714 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83795.ko 2023-06-23T18:29:04.714 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83l785ts.ko 2023-06-23T18:29:04.714 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83l786ng.ko 2023-06-23T18:29:04.714 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c 2023-06-23T18:29:04.714 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/algos 2023-06-23T18:29:04.715 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-06-23T18:29:04.715 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-06-23T18:29:04.715 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses 2023-06-23T18:29:04.715 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-06-23T18:29:04.715 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-06-23T18:29:04.715 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-06-23T18:29:04.715 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-06-23T18:29:04.715 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-06-23T18:29:04.716 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-06-23T18:29:04.716 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-06-23T18:29:04.716 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-06-23T18:29:04.716 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-i801.ko 2023-06-23T18:29:04.716 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-isch.ko 2023-06-23T18:29:04.716 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-06-23T18:29:04.716 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-06-23T18:29:04.717 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-06-23T18:29:04.717 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-parport.ko 2023-06-23T18:29:04.717 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-06-23T18:29:04.717 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-06-23T18:29:04.717 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-06-23T18:29:04.717 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-06-23T18:29:04.717 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-06-23T18:29:04.717 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-06-23T18:29:04.718 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-via.ko 2023-06-23T18:29:04.718 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-06-23T18:29:04.718 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-06-23T18:29:04.718 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-dev.ko 2023-06-23T18:29:04.718 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-mux.ko 2023-06-23T18:29:04.718 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-06-23T18:29:04.718 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-smbus.ko 2023-06-23T18:29:04.718 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-stub.ko 2023-06-23T18:29:04.719 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband 2023-06-23T18:29:04.719 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core 2023-06-23T18:29:04.719 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_cm.ko 2023-06-23T18:29:04.719 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_core.ko 2023-06-23T18:29:04.719 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_umad.ko 2023-06-23T18:29:04.719 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-06-23T18:29:04.719 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/iw_cm.ko 2023-06-23T18:29:04.719 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/rdma_cm.ko 2023-06-23T18:29:04.720 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-06-23T18:29:04.720 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw 2023-06-23T18:29:04.720 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/cxgb4 2023-06-23T18:29:04.720 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-06-23T18:29:04.720 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx4 2023-06-23T18:29:04.720 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-06-23T18:29:04.720 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx5 2023-06-23T18:29:04.721 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-06-23T18:29:04.721 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mthca 2023-06-23T18:29:04.721 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-06-23T18:29:04.721 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp 2023-06-23T18:29:04.721 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/ipoib 2023-06-23T18:29:04.721 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-06-23T18:29:04.721 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/iser 2023-06-23T18:29:04.721 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-06-23T18:29:04.722 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/isert 2023-06-23T18:29:04.722 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-06-23T18:29:04.722 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srp 2023-06-23T18:29:04.722 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-06-23T18:29:04.722 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srpt 2023-06-23T18:29:04.722 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-06-23T18:29:04.722 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input 2023-06-23T18:29:04.722 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport 2023-06-23T18:29:04.723 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-06-23T18:29:04.723 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/fm801-gp.ko 2023-06-23T18:29:04.723 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/gameport.ko 2023-06-23T18:29:04.723 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/lightning.ko 2023-06-23T18:29:04.723 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/ns558.ko 2023-06-23T18:29:04.723 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/joydev.ko 2023-06-23T18:29:04.723 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/keyboard 2023-06-23T18:29:04.723 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/keyboard/gpio_keys.ko 2023-06-23T18:29:04.724 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse 2023-06-23T18:29:04.724 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/appletouch.ko 2023-06-23T18:29:04.724 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/bcm5974.ko 2023-06-23T18:29:04.724 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/cyapatp.ko 2023-06-23T18:29:04.724 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/elan_i2c.ko 2023-06-23T18:29:04.724 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/sermouse.ko 2023-06-23T18:29:04.724 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-06-23T18:29:04.725 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/synaptics_usb.ko 2023-06-23T18:29:04.725 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/vsxxxaa.ko 2023-06-23T18:29:04.725 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/rmi4 2023-06-23T18:29:04.725 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/rmi4/rmi_core.ko 2023-06-23T18:29:04.725 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio 2023-06-23T18:29:04.725 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/altera_ps2.ko 2023-06-23T18:29:04.725 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/arc_ps2.ko 2023-06-23T18:29:04.726 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-06-23T18:29:04.726 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/serio_raw.ko 2023-06-23T18:29:04.726 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/sparse-keymap.ko 2023-06-23T18:29:04.726 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/iommu 2023-06-23T18:29:04.726 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/iommu/amd 2023-06-23T18:29:04.726 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/iommu/amd/iommu_v2.ko 2023-06-23T18:29:04.726 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds 2023-06-23T18:29:04.726 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-blinkm.ko 2023-06-23T18:29:04.727 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-lm3530.ko 2023-06-23T18:29:04.727 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-lp3944.ko 2023-06-23T18:29:04.727 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-ss4200.ko 2023-06-23T18:29:04.727 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger 2023-06-23T18:29:04.727 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-06-23T18:29:04.727 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-06-23T18:29:04.727 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-06-23T18:29:04.727 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-06-23T18:29:04.728 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-06-23T18:29:04.728 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-06-23T18:29:04.728 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-06-23T18:29:04.728 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-06-23T18:29:04.728 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md 2023-06-23T18:29:04.728 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/bcache 2023-06-23T18:29:04.728 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/bcache/bcache.ko 2023-06-23T18:29:04.729 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-bio-prison.ko 2023-06-23T18:29:04.729 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-cache-smq.ko 2023-06-23T18:29:04.729 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-cache.ko 2023-06-23T18:29:04.729 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-crypt.ko 2023-06-23T18:29:04.729 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-delay.ko 2023-06-23T18:29:04.729 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-flakey.ko 2023-06-23T18:29:04.729 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-log-userspace.ko 2023-06-23T18:29:04.729 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-multipath.ko 2023-06-23T18:29:04.730 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-queue-length.ko 2023-06-23T18:29:04.730 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-raid.ko 2023-06-23T18:29:04.730 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-round-robin.ko 2023-06-23T18:29:04.730 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-service-time.ko 2023-06-23T18:29:04.730 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-switch.ko 2023-06-23T18:29:04.730 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-thin-pool.ko 2023-06-23T18:29:04.730 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-verity.ko 2023-06-23T18:29:04.730 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/faulty.ko 2023-06-23T18:29:04.731 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/linear.ko 2023-06-23T18:29:04.731 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/multipath.ko 2023-06-23T18:29:04.731 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/persistent-data 2023-06-23T18:29:04.731 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-06-23T18:29:04.731 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid0.ko 2023-06-23T18:29:04.731 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid1.ko 2023-06-23T18:29:04.731 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid10.ko 2023-06-23T18:29:04.731 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid456.ko 2023-06-23T18:29:04.732 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message 2023-06-23T18:29:04.732 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion 2023-06-23T18:29:04.732 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptbase.ko 2023-06-23T18:29:04.732 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptctl.ko 2023-06-23T18:29:04.732 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptfc.ko 2023-06-23T18:29:04.732 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptlan.ko 2023-06-23T18:29:04.732 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptsas.ko 2023-06-23T18:29:04.733 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptscsih.ko 2023-06-23T18:29:04.733 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptspi.ko 2023-06-23T18:29:04.733 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd 2023-06-23T18:29:04.733 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/lpc_ich.ko 2023-06-23T18:29:04.733 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/lpc_sch.ko 2023-06-23T18:29:04.733 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/mfd-core.ko 2023-06-23T18:29:04.733 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/sm501.ko 2023-06-23T18:29:04.733 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/viperboard.ko 2023-06-23T18:29:04.734 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/vx855.ko 2023-06-23T18:29:04.734 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/wl1273-core.ko 2023-06-23T18:29:04.734 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc 2023-06-23T18:29:04.734 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/altera-stapl 2023-06-23T18:29:04.734 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-06-23T18:29:04.734 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/apds9802als.ko 2023-06-23T18:29:04.734 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/apds990x.ko 2023-06-23T18:29:04.734 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/bh1770glc.ko 2023-06-23T18:29:04.735 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/cb710 2023-06-23T18:29:04.735 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/cb710/cb710.ko 2023-06-23T18:29:04.735 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom 2023-06-23T18:29:04.735 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/at24.ko 2023-06-23T18:29:04.735 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/eeprom.ko 2023-06-23T18:29:04.735 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-06-23T18:29:04.735 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/max6875.ko 2023-06-23T18:29:04.735 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/enclosure.ko 2023-06-23T18:29:04.736 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/hpilo.ko 2023-06-23T18:29:04.736 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/isl29003.ko 2023-06-23T18:29:04.736 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/isl29020.ko 2023-06-23T18:29:04.736 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/lis3lv02d 2023-06-23T18:29:04.736 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-06-23T18:29:04.736 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-06-23T18:29:04.736 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei 2023-06-23T18:29:04.737 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei/mei-me.ko 2023-06-23T18:29:04.737 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei/mei-txe.ko 2023-06-23T18:29:04.737 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei/mei.ko 2023-06-23T18:29:04.737 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-gru 2023-06-23T18:29:04.737 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-gru/gru.ko 2023-06-23T18:29:04.737 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp 2023-06-23T18:29:04.737 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp/xp.ko 2023-06-23T18:29:04.737 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp/xpc.ko 2023-06-23T18:29:04.738 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-06-23T18:29:04.738 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/tifm_7xx1.ko 2023-06-23T18:29:04.738 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/tifm_core.ko 2023-06-23T18:29:04.738 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/tsl2550.ko 2023-06-23T18:29:04.738 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/vmw_balloon.ko 2023-06-23T18:29:04.738 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/vmw_vmci 2023-06-23T18:29:04.738 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-06-23T18:29:04.739 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net 2023-06-23T18:29:04.739 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/bonding 2023-06-23T18:29:04.739 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/bonding/bonding.ko 2023-06-23T18:29:04.739 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa 2023-06-23T18:29:04.739 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/b53 2023-06-23T18:29:04.739 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/b53/b53_common.ko 2023-06-23T18:29:04.739 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/bcm-sf2.ko 2023-06-23T18:29:04.740 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/mv88e6060.ko 2023-06-23T18:29:04.740 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/mv88e6xxx 2023-06-23T18:29:04.740 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-06-23T18:29:04.740 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dummy.ko 2023-06-23T18:29:04.740 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/eql.ko 2023-06-23T18:29:04.740 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet 2023-06-23T18:29:04.740 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com 2023-06-23T18:29:04.740 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-06-23T18:29:04.741 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-06-23T18:29:04.741 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-06-23T18:29:04.741 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-06-23T18:29:04.741 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390 2023-06-23T18:29:04.741 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/8390.ko 2023-06-23T18:29:04.741 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-06-23T18:29:04.741 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-06-23T18:29:04.741 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-06-23T18:29:04.742 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/adaptec 2023-06-23T18:29:04.742 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-06-23T18:29:04.742 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/agere 2023-06-23T18:29:04.742 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/agere/et131x.ko 2023-06-23T18:29:04.742 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/alteon 2023-06-23T18:29:04.742 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-06-23T18:29:04.742 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/altera 2023-06-23T18:29:04.743 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-06-23T18:29:04.743 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd 2023-06-23T18:29:04.743 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-06-23T18:29:04.743 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-06-23T18:29:04.743 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-06-23T18:29:04.743 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros 2023-06-23T18:29:04.743 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/alx 2023-06-23T18:29:04.743 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-06-23T18:29:04.744 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1c 2023-06-23T18:29:04.744 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-06-23T18:29:04.744 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1e 2023-06-23T18:29:04.744 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-06-23T18:29:04.744 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atlx 2023-06-23T18:29:04.744 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-06-23T18:29:04.744 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-06-23T18:29:04.744 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom 2023-06-23T18:29:04.745 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-06-23T18:29:04.745 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-06-23T18:29:04.745 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-06-23T18:29:04.745 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-06-23T18:29:04.745 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-06-23T18:29:04.745 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/genet 2023-06-23T18:29:04.745 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-06-23T18:29:04.746 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-06-23T18:29:04.746 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/brocade 2023-06-23T18:29:04.746 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/brocade/bna 2023-06-23T18:29:04.746 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-06-23T18:29:04.746 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio 2023-06-23T18:29:04.746 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb 2023-06-23T18:29:04.746 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-06-23T18:29:04.746 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-06-23T18:29:04.747 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-06-23T18:29:04.747 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-06-23T18:29:04.747 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-06-23T18:29:04.747 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-06-23T18:29:04.747 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-06-23T18:29:04.747 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-06-23T18:29:04.747 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-06-23T18:29:04.747 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/cisco 2023-06-23T18:29:04.748 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/cisco/enic 2023-06-23T18:29:04.748 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-06-23T18:29:04.748 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec 2023-06-23T18:29:04.748 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip 2023-06-23T18:29:04.748 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-06-23T18:29:04.748 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-06-23T18:29:04.748 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-06-23T18:29:04.749 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-06-23T18:29:04.749 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-06-23T18:29:04.749 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-06-23T18:29:04.749 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dlink 2023-06-23T18:29:04.749 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-06-23T18:29:04.749 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-06-23T18:29:04.749 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dnet.ko 2023-06-23T18:29:04.749 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/emulex 2023-06-23T18:29:04.750 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/emulex/benet 2023-06-23T18:29:04.750 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-06-23T18:29:04.750 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/ethoc.ko 2023-06-23T18:29:04.750 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/fealnx.ko 2023-06-23T18:29:04.750 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel 2023-06-23T18:29:04.750 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e100.ko 2023-06-23T18:29:04.750 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000 2023-06-23T18:29:04.750 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-06-23T18:29:04.751 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000e 2023-06-23T18:29:04.751 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-06-23T18:29:04.751 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/fm10k 2023-06-23T18:29:04.751 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-06-23T18:29:04.751 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/i40e 2023-06-23T18:29:04.751 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-06-23T18:29:04.751 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/iavf 2023-06-23T18:29:04.752 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-06-23T18:29:04.752 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igb 2023-06-23T18:29:04.752 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-06-23T18:29:04.752 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igbvf 2023-06-23T18:29:04.752 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-06-23T18:29:04.752 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbe 2023-06-23T18:29:04.752 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-06-23T18:29:04.752 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbevf 2023-06-23T18:29:04.753 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-06-23T18:29:04.753 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/jme.ko 2023-06-23T18:29:04.753 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell 2023-06-23T18:29:04.753 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-06-23T18:29:04.753 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell/skge.ko 2023-06-23T18:29:04.753 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-06-23T18:29:04.753 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox 2023-06-23T18:29:04.754 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx4 2023-06-23T18:29:04.754 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-06-23T18:29:04.754 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-06-23T18:29:04.754 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx5 2023-06-23T18:29:04.754 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-06-23T18:29:04.754 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-06-23T18:29:04.754 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/micrel 2023-06-23T18:29:04.755 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-06-23T18:29:04.755 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/myricom 2023-06-23T18:29:04.755 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/myricom/myri10ge 2023-06-23T18:29:04.755 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-06-23T18:29:04.755 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/natsemi 2023-06-23T18:29:04.755 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-06-23T18:29:04.755 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-06-23T18:29:04.755 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/neterion 2023-06-23T18:29:04.756 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-06-23T18:29:04.756 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/nvidia 2023-06-23T18:29:04.756 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-06-23T18:29:04.756 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/packetengines 2023-06-23T18:29:04.756 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-06-23T18:29:04.756 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-06-23T18:29:04.756 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic 2023-06-23T18:29:04.756 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/netxen 2023-06-23T18:29:04.757 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-06-23T18:29:04.757 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-06-23T18:29:04.757 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-06-23T18:29:04.757 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-06-23T18:29:04.757 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rdc 2023-06-23T18:29:04.757 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-06-23T18:29:04.757 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek 2023-06-23T18:29:04.758 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-06-23T18:29:04.758 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-06-23T18:29:04.758 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/atp.ko 2023-06-23T18:29:04.758 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-06-23T18:29:04.758 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rocker 2023-06-23T18:29:04.758 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-06-23T18:29:04.758 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sfc 2023-06-23T18:29:04.758 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-06-23T18:29:04.759 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/silan 2023-06-23T18:29:04.759 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-06-23T18:29:04.759 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sis 2023-06-23T18:29:04.759 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sis/sis190.ko 2023-06-23T18:29:04.759 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sis/sis900.ko 2023-06-23T18:29:04.759 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc 2023-06-23T18:29:04.759 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-06-23T18:29:04.759 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-06-23T18:29:04.760 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-06-23T18:29:04.760 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-06-23T18:29:04.760 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro 2023-06-23T18:29:04.760 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro/stmmac 2023-06-23T18:29:04.760 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-06-23T18:29:04.760 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-06-23T18:29:04.760 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun 2023-06-23T18:29:04.761 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/cassini.ko 2023-06-23T18:29:04.761 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/niu.ko 2023-06-23T18:29:04.761 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/sungem.ko 2023-06-23T18:29:04.761 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-06-23T18:29:04.761 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/tehuti 2023-06-23T18:29:04.761 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-06-23T18:29:04.761 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/ti 2023-06-23T18:29:04.761 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/ti/tlan.ko 2023-06-23T18:29:04.762 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/via 2023-06-23T18:29:04.762 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-06-23T18:29:04.762 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-06-23T18:29:04.762 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/wiznet 2023-06-23T18:29:04.762 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-06-23T18:29:04.762 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-06-23T18:29:04.762 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/xircom 2023-06-23T18:29:04.763 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-06-23T18:29:04.763 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/geneve.ko 2023-06-23T18:29:04.763 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/hyperv 2023-06-23T18:29:04.763 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-06-23T18:29:04.763 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ieee802154 2023-06-23T18:29:04.763 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ieee802154/fakelb.ko 2023-06-23T18:29:04.763 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ifb.ko 2023-06-23T18:29:04.763 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ipvlan 2023-06-23T18:29:04.764 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ipvlan/ipvlan.ko 2023-06-23T18:29:04.764 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/macvlan.ko 2023-06-23T18:29:04.764 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/macvtap.ko 2023-06-23T18:29:04.764 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio 2023-06-23T18:29:04.764 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio.ko 2023-06-23T18:29:04.764 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-06-23T18:29:04.764 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-06-23T18:29:04.765 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mii.ko 2023-06-23T18:29:04.765 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/net_failover.ko 2023-06-23T18:29:04.765 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/netconsole.ko 2023-06-23T18:29:04.765 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/nlmon.ko 2023-06-23T18:29:04.765 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/pcs 2023-06-23T18:29:04.765 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-06-23T18:29:04.765 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-06-23T18:29:04.765 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy 2023-06-23T18:29:04.766 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/amd.ko 2023-06-23T18:29:04.766 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-06-23T18:29:04.766 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-06-23T18:29:04.766 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm7xxx.ko 2023-06-23T18:29:04.766 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm87xx.ko 2023-06-23T18:29:04.766 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/broadcom.ko 2023-06-23T18:29:04.766 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/cicada.ko 2023-06-23T18:29:04.767 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/davicom.ko 2023-06-23T18:29:04.767 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/dp83640.ko 2023-06-23T18:29:04.767 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/et1011c.ko 2023-06-23T18:29:04.767 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/icplus.ko 2023-06-23T18:29:04.767 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/lxt.ko 2023-06-23T18:29:04.767 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/marvell.ko 2023-06-23T18:29:04.767 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/micrel.ko 2023-06-23T18:29:04.767 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/national.ko 2023-06-23T18:29:04.768 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/phylink.ko 2023-06-23T18:29:04.768 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/qsemi.ko 2023-06-23T18:29:04.768 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/realtek.ko 2023-06-23T18:29:04.768 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/smsc.ko 2023-06-23T18:29:04.768 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/ste10Xp.ko 2023-06-23T18:29:04.768 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/vitesse.ko 2023-06-23T18:29:04.768 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp 2023-06-23T18:29:04.768 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/bsd_comp.ko 2023-06-23T18:29:04.769 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_async.ko 2023-06-23T18:29:04.769 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_deflate.ko 2023-06-23T18:29:04.769 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_generic.ko 2023-06-23T18:29:04.769 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_mppe.ko 2023-06-23T18:29:04.769 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_synctty.ko 2023-06-23T18:29:04.769 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/pppoe.ko 2023-06-23T18:29:04.769 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/pppox.ko 2023-06-23T18:29:04.769 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/pptp.ko 2023-06-23T18:29:04.770 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/slip 2023-06-23T18:29:04.770 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/slip/slhc.ko 2023-06-23T18:29:04.770 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/slip/slip.ko 2023-06-23T18:29:04.770 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/sungem_phy.ko 2023-06-23T18:29:04.770 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/tap.ko 2023-06-23T18:29:04.770 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team 2023-06-23T18:29:04.770 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team.ko 2023-06-23T18:29:04.770 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_activebackup.ko 2023-06-23T18:29:04.771 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_broadcast.ko 2023-06-23T18:29:04.771 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-06-23T18:29:04.771 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_random.ko 2023-06-23T18:29:04.771 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-06-23T18:29:04.771 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/tun.ko 2023-06-23T18:29:04.771 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/veth.ko 2023-06-23T18:29:04.771 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/virtio_net.ko 2023-06-23T18:29:04.771 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vmxnet3 2023-06-23T18:29:04.772 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-06-23T18:29:04.772 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vxlan 2023-06-23T18:29:04.772 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vxlan/vxlan.ko 2023-06-23T18:29:04.772 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/xen-netback 2023-06-23T18:29:04.772 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/xen-netback/xen-netback.ko 2023-06-23T18:29:04.772 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/xen-netfront.ko 2023-06-23T18:29:04.772 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ntb 2023-06-23T18:29:04.773 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ntb/ntb.ko 2023-06-23T18:29:04.773 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme 2023-06-23T18:29:04.773 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme/host 2023-06-23T18:29:04.773 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme/host/nvme-core.ko 2023-06-23T18:29:04.773 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme/host/nvme.ko 2023-06-23T18:29:04.773 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport 2023-06-23T18:29:04.773 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport.ko 2023-06-23T18:29:04.773 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport_cs.ko 2023-06-23T18:29:04.774 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport_pc.ko 2023-06-23T18:29:04.774 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport_serial.ko 2023-06-23T18:29:04.774 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci 2023-06-23T18:29:04.774 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/hotplug 2023-06-23T18:29:04.774 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-06-23T18:29:04.774 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/pcie 2023-06-23T18:29:04.774 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/pcie/aer_inject.ko 2023-06-23T18:29:04.774 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/xen-pcifront.ko 2023-06-23T18:29:04.775 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia 2023-06-23T18:29:04.775 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia/i82092.ko 2023-06-23T18:29:04.775 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia/pd6729.ko 2023-06-23T18:29:04.775 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia/yenta_socket.ko 2023-06-23T18:29:04.775 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pinctrl 2023-06-23T18:29:04.775 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pinctrl/intel 2023-06-23T18:29:04.775 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-06-23T18:29:04.775 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform 2023-06-23T18:29:04.776 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86 2023-06-23T18:29:04.776 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/acer-wmi.ko 2023-06-23T18:29:04.776 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/acerhdf.ko 2023-06-23T18:29:04.776 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/apple-gmux.ko 2023-06-23T18:29:04.776 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/asus-laptop.ko 2023-06-23T18:29:04.776 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-06-23T18:29:04.776 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/asus-wmi.ko 2023-06-23T18:29:04.777 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/classmate-laptop.ko 2023-06-23T18:29:04.777 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-06-23T18:29:04.777 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-06-23T18:29:04.777 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-06-23T18:29:04.777 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-06-23T18:29:04.777 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/hdaps.ko 2023-06-23T18:29:04.777 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/intel 2023-06-23T18:29:04.777 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-06-23T18:29:04.778 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/intel_ips.ko 2023-06-23T18:29:04.778 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/msi-wmi.ko 2023-06-23T18:29:04.778 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/mxm-wmi.ko 2023-06-23T18:29:04.778 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-06-23T18:29:04.778 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/samsung-laptop.ko 2023-06-23T18:29:04.778 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/samsung-q10.ko 2023-06-23T18:29:04.778 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/topstar-laptop.ko 2023-06-23T18:29:04.778 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-06-23T18:29:04.779 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/toshiba_haps.ko 2023-06-23T18:29:04.779 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/wmi-bmof.ko 2023-06-23T18:29:04.779 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/wmi.ko 2023-06-23T18:29:04.779 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/powercap 2023-06-23T18:29:04.779 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/powercap/intel_rapl_common.ko 2023-06-23T18:29:04.779 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/powercap/intel_rapl_msr.ko 2023-06-23T18:29:04.779 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps 2023-06-23T18:29:04.779 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients 2023-06-23T18:29:04.780 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients/pps-gpio.ko 2023-06-23T18:29:04.780 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients/pps-ldisc.ko 2023-06-23T18:29:04.780 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients/pps_parport.ko 2023-06-23T18:29:04.780 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/pps_core.ko 2023-06-23T18:29:04.780 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ptp 2023-06-23T18:29:04.780 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ptp/ptp.ko 2023-06-23T18:29:04.780 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ptp/ptp_kvm.ko 2023-06-23T18:29:04.780 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc 2023-06-23T18:29:04.781 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-bq32k.ko 2023-06-23T18:29:04.781 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-bq4802.ko 2023-06-23T18:29:04.781 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1286.ko 2023-06-23T18:29:04.781 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1307.ko 2023-06-23T18:29:04.781 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1374.ko 2023-06-23T18:29:04.781 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1511.ko 2023-06-23T18:29:04.781 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1553.ko 2023-06-23T18:29:04.781 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1672.ko 2023-06-23T18:29:04.782 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1742.ko 2023-06-23T18:29:04.782 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds2404.ko 2023-06-23T18:29:04.782 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds3232.ko 2023-06-23T18:29:04.782 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-em3027.ko 2023-06-23T18:29:04.782 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-fm3130.ko 2023-06-23T18:29:04.782 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-isl12022.ko 2023-06-23T18:29:04.782 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-isl1208.ko 2023-06-23T18:29:04.782 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-m41t80.ko 2023-06-23T18:29:04.783 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-m48t35.ko 2023-06-23T18:29:04.783 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-m48t59.ko 2023-06-23T18:29:04.783 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-max6900.ko 2023-06-23T18:29:04.783 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-msm6242.ko 2023-06-23T18:29:04.783 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf2127.ko 2023-06-23T18:29:04.783 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf85063.ko 2023-06-23T18:29:04.783 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf8523.ko 2023-06-23T18:29:04.784 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf8563.ko 2023-06-23T18:29:04.784 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf8583.ko 2023-06-23T18:29:04.784 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rp5c01.ko 2023-06-23T18:29:04.784 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rs5c372.ko 2023-06-23T18:29:04.784 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-06-23T18:29:04.784 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rx8025.ko 2023-06-23T18:29:04.784 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rx8581.ko 2023-06-23T18:29:04.784 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-06-23T18:29:04.785 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-x1205.ko 2023-06-23T18:29:04.785 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi 2023-06-23T18:29:04.785 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/3w-9xxx.ko 2023-06-23T18:29:04.785 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/3w-sas.ko 2023-06-23T18:29:04.785 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/3w-xxxx.ko 2023-06-23T18:29:04.785 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/BusLogic.ko 2023-06-23T18:29:04.785 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/a100u2w.ko 2023-06-23T18:29:04.785 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aacraid 2023-06-23T18:29:04.786 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aacraid/aacraid.ko 2023-06-23T18:29:04.786 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/advansys.ko 2023-06-23T18:29:04.786 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aic7xxx 2023-06-23T18:29:04.786 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-06-23T18:29:04.786 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-06-23T18:29:04.786 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/am53c974.ko 2023-06-23T18:29:04.786 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/arcmsr 2023-06-23T18:29:04.786 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-06-23T18:29:04.787 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/atp870u.ko 2023-06-23T18:29:04.787 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/be2iscsi 2023-06-23T18:29:04.787 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-06-23T18:29:04.787 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bfa 2023-06-23T18:29:04.787 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bfa/bfa.ko 2023-06-23T18:29:04.787 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2fc 2023-06-23T18:29:04.787 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-06-23T18:29:04.787 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2i 2023-06-23T18:29:04.788 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-06-23T18:29:04.788 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ch.ko 2023-06-23T18:29:04.788 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/csiostor 2023-06-23T18:29:04.788 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/csiostor/csiostor.ko 2023-06-23T18:29:04.788 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi 2023-06-23T18:29:04.788 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb3i 2023-06-23T18:29:04.788 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-06-23T18:29:04.788 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb4i 2023-06-23T18:29:04.789 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-06-23T18:29:04.789 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-06-23T18:29:04.789 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/dc395x.ko 2023-06-23T18:29:04.789 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler 2023-06-23T18:29:04.789 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-06-23T18:29:04.789 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-06-23T18:29:04.789 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-06-23T18:29:04.790 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-06-23T18:29:04.790 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/dmx3191d.ko 2023-06-23T18:29:04.790 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/esas2r 2023-06-23T18:29:04.790 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/esas2r/esas2r.ko 2023-06-23T18:29:04.790 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/esp_scsi.ko 2023-06-23T18:29:04.790 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fcoe 2023-06-23T18:29:04.790 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fcoe/fcoe.ko 2023-06-23T18:29:04.790 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-06-23T18:29:04.791 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fnic 2023-06-23T18:29:04.791 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fnic/fnic.ko 2023-06-23T18:29:04.791 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/hpsa.ko 2023-06-23T18:29:04.791 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/hptiop.ko 2023-06-23T18:29:04.791 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/hv_storvsc.ko 2023-06-23T18:29:04.791 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/initio.ko 2023-06-23T18:29:04.791 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ipr.ko 2023-06-23T18:29:04.791 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ips.ko 2023-06-23T18:29:04.792 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/isci 2023-06-23T18:29:04.792 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/isci/isci.ko 2023-06-23T18:29:04.792 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-06-23T18:29:04.792 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/iscsi_tcp.ko 2023-06-23T18:29:04.792 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libfc 2023-06-23T18:29:04.792 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libfc/libfc.ko 2023-06-23T18:29:04.792 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libiscsi.ko 2023-06-23T18:29:04.793 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libiscsi_tcp.ko 2023-06-23T18:29:04.793 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libsas 2023-06-23T18:29:04.793 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libsas/libsas.ko 2023-06-23T18:29:04.793 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/lpfc 2023-06-23T18:29:04.793 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/lpfc/lpfc.ko 2023-06-23T18:29:04.793 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid 2023-06-23T18:29:04.793 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid.ko 2023-06-23T18:29:04.793 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-06-23T18:29:04.794 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-06-23T18:29:04.794 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-06-23T18:29:04.794 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mpt3sas 2023-06-23T18:29:04.794 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-06-23T18:29:04.794 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mvsas 2023-06-23T18:29:04.794 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mvsas/mvsas.ko 2023-06-23T18:29:04.794 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mvumi.ko 2023-06-23T18:29:04.794 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/pm8001 2023-06-23T18:29:04.795 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-06-23T18:29:04.795 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/pmcraid.ko 2023-06-23T18:29:04.795 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla1280.ko 2023-06-23T18:29:04.795 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla2xxx 2023-06-23T18:29:04.795 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-06-23T18:29:04.795 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-06-23T18:29:04.795 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla4xxx 2023-06-23T18:29:04.795 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-06-23T18:29:04.796 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/raid_class.ko 2023-06-23T18:29:04.796 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_debug.ko 2023-06-23T18:29:04.796 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_fc.ko 2023-06-23T18:29:04.796 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-06-23T18:29:04.796 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_sas.ko 2023-06-23T18:29:04.796 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_spi.ko 2023-06-23T18:29:04.796 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_srp.ko 2023-06-23T18:29:04.796 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ses.ko 2023-06-23T18:29:04.797 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/st.ko 2023-06-23T18:29:04.797 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/stex.ko 2023-06-23T18:29:04.797 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/sym53c8xx_2 2023-06-23T18:29:04.797 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-06-23T18:29:04.797 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/virtio_scsi.ko 2023-06-23T18:29:04.797 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/vmw_pvscsi.ko 2023-06-23T18:29:04.797 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/wd719x.ko 2023-06-23T18:29:04.798 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ssb 2023-06-23T18:29:04.798 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ssb/ssb.ko 2023-06-23T18:29:04.798 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target 2023-06-23T18:29:04.798 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/iscsi 2023-06-23T18:29:04.798 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-06-23T18:29:04.798 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/loopback 2023-06-23T18:29:04.798 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/loopback/tcm_loop.ko 2023-06-23T18:29:04.798 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_file.ko 2023-06-23T18:29:04.799 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_iblock.ko 2023-06-23T18:29:04.799 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_mod.ko 2023-06-23T18:29:04.799 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_pscsi.ko 2023-06-23T18:29:04.799 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_user.ko 2023-06-23T18:29:04.799 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/tcm_fc 2023-06-23T18:29:04.799 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-06-23T18:29:04.799 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal 2023-06-23T18:29:04.800 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel 2023-06-23T18:29:04.800 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal 2023-06-23T18:29:04.800 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-06-23T18:29:04.800 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-06-23T18:29:04.800 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-06-23T18:29:04.800 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-06-23T18:29:04.800 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-06-23T18:29:04.801 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-06-23T18:29:04.801 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-06-23T18:29:04.801 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-06-23T18:29:04.801 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-06-23T18:29:04.801 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-06-23T18:29:04.801 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-06-23T18:29:04.801 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-06-23T18:29:04.801 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-06-23T18:29:04.802 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-06-23T18:29:04.802 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-06-23T18:29:04.802 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty 2023-06-23T18:29:04.802 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/ipwireless 2023-06-23T18:29:04.802 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-06-23T18:29:04.802 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/n_gsm.ko 2023-06-23T18:29:04.802 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/n_hdlc.ko 2023-06-23T18:29:04.803 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/nozomi.ko 2023-06-23T18:29:04.803 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial 2023-06-23T18:29:04.803 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/8250 2023-06-23T18:29:04.803 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-06-23T18:29:04.803 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/arc_uart.ko 2023-06-23T18:29:04.803 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/jsm 2023-06-23T18:29:04.803 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/jsm/jsm.ko 2023-06-23T18:29:04.803 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/synclink_gt.ko 2023-06-23T18:29:04.804 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs 2023-06-23T18:29:04.804 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/core 2023-06-23T18:29:04.804 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/core/ufshcd-core.ko 2023-06-23T18:29:04.804 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/host 2023-06-23T18:29:04.804 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-06-23T18:29:04.804 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio 2023-06-23T18:29:04.804 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio.ko 2023-06-23T18:29:04.805 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_aec.ko 2023-06-23T18:29:04.805 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_cif.ko 2023-06-23T18:29:04.805 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_pci_generic.ko 2023-06-23T18:29:04.805 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_sercos3.ko 2023-06-23T18:29:04.805 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb 2023-06-23T18:29:04.805 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class 2023-06-23T18:29:04.805 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/cdc-acm.ko 2023-06-23T18:29:04.806 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/cdc-wdm.ko 2023-06-23T18:29:04.806 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/usblp.ko 2023-06-23T18:29:04.806 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/usbtmc.ko 2023-06-23T18:29:04.806 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/host 2023-06-23T18:29:04.806 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/host/sl811-hcd.ko 2023-06-23T18:29:04.806 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/image 2023-06-23T18:29:04.806 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/image/mdc800.ko 2023-06-23T18:29:04.806 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/image/microtek.ko 2023-06-23T18:29:04.807 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc 2023-06-23T18:29:04.807 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/adutux.ko 2023-06-23T18:29:04.807 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/appledisplay.ko 2023-06-23T18:29:04.807 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/emi26.ko 2023-06-23T18:29:04.807 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/emi62.ko 2023-06-23T18:29:04.807 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/ezusb.ko 2023-06-23T18:29:04.807 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/idmouse.ko 2023-06-23T18:29:04.808 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/iowarrior.ko 2023-06-23T18:29:04.808 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/isight_firmware.ko 2023-06-23T18:29:04.808 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/ldusb.ko 2023-06-23T18:29:04.808 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/legousbtower.ko 2023-06-23T18:29:04.808 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/sisusbvga 2023-06-23T18:29:04.808 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-06-23T18:29:04.808 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/trancevibrator.ko 2023-06-23T18:29:04.808 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/usb3503.ko 2023-06-23T18:29:04.809 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/usblcd.ko 2023-06-23T18:29:04.809 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/usbsevseg.ko 2023-06-23T18:29:04.809 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/uss720.ko 2023-06-23T18:29:04.809 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/yurex.ko 2023-06-23T18:29:04.809 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/phy 2023-06-23T18:29:04.809 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/phy/phy-generic.ko 2023-06-23T18:29:04.809 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial 2023-06-23T18:29:04.809 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/aircable.ko 2023-06-23T18:29:04.810 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ark3116.ko 2023-06-23T18:29:04.810 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/belkin_sa.ko 2023-06-23T18:29:04.810 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ch341.ko 2023-06-23T18:29:04.810 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/cp210x.ko 2023-06-23T18:29:04.810 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/cyberjack.ko 2023-06-23T18:29:04.810 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/cypress_m8.ko 2023-06-23T18:29:04.810 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/digi_acceleport.ko 2023-06-23T18:29:04.810 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/empeg.ko 2023-06-23T18:29:04.811 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ftdi_sio.ko 2023-06-23T18:29:04.811 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/garmin_gps.ko 2023-06-23T18:29:04.811 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/io_edgeport.ko 2023-06-23T18:29:04.811 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/io_ti.ko 2023-06-23T18:29:04.811 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ipaq.ko 2023-06-23T18:29:04.811 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ipw.ko 2023-06-23T18:29:04.811 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ir-usb.ko 2023-06-23T18:29:04.811 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-06-23T18:29:04.812 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/keyspan.ko 2023-06-23T18:29:04.812 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/keyspan_pda.ko 2023-06-23T18:29:04.812 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/kl5kusb105.ko 2023-06-23T18:29:04.812 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/kobil_sct.ko 2023-06-23T18:29:04.812 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/mct_u232.ko 2023-06-23T18:29:04.812 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/mos7720.ko 2023-06-23T18:29:04.812 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/mos7840.ko 2023-06-23T18:29:04.812 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/navman.ko 2023-06-23T18:29:04.813 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/omninet.ko 2023-06-23T18:29:04.813 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/opticon.ko 2023-06-23T18:29:04.813 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/option.ko 2023-06-23T18:29:04.813 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/oti6858.ko 2023-06-23T18:29:04.813 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/pl2303.ko 2023-06-23T18:29:04.813 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/qcaux.ko 2023-06-23T18:29:04.813 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/qcserial.ko 2023-06-23T18:29:04.813 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/quatech2.ko 2023-06-23T18:29:04.814 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/safe_serial.ko 2023-06-23T18:29:04.814 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/sierra.ko 2023-06-23T18:29:04.814 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/spcp8x5.ko 2023-06-23T18:29:04.814 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ssu100.ko 2023-06-23T18:29:04.814 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/symbolserial.ko 2023-06-23T18:29:04.814 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-06-23T18:29:04.814 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-06-23T18:29:04.814 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/usb_debug.ko 2023-06-23T18:29:04.815 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/usb_wwan.ko 2023-06-23T18:29:04.815 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/visor.ko 2023-06-23T18:29:04.815 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/whiteheat.ko 2023-06-23T18:29:04.815 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/xsens_mt.ko 2023-06-23T18:29:04.815 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage 2023-06-23T18:29:04.815 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/uas.ko 2023-06-23T18:29:04.815 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-alauda.ko 2023-06-23T18:29:04.815 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-cypress.ko 2023-06-23T18:29:04.816 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-datafab.ko 2023-06-23T18:29:04.816 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-06-23T18:29:04.816 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-freecom.ko 2023-06-23T18:29:04.816 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-isd200.ko 2023-06-23T18:29:04.816 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-06-23T18:29:04.816 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-karma.ko 2023-06-23T18:29:04.816 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-onetouch.ko 2023-06-23T18:29:04.817 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-realtek.ko 2023-06-23T18:29:04.817 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-sddr09.ko 2023-06-23T18:29:04.817 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-sddr55.ko 2023-06-23T18:29:04.817 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-usbat.ko 2023-06-23T18:29:04.817 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/usb-storage.ko 2023-06-23T18:29:04.817 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip 2023-06-23T18:29:04.817 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip/usbip-core.ko 2023-06-23T18:29:04.818 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip/usbip-host.ko 2023-06-23T18:29:04.818 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-06-23T18:29:04.818 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio 2023-06-23T18:29:04.818 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/pci 2023-06-23T18:29:04.818 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-06-23T18:29:04.818 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/pci/vfio-pci.ko 2023-06-23T18:29:04.818 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/vfio.ko 2023-06-23T18:29:04.818 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-06-23T18:29:04.819 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost 2023-06-23T18:29:04.819 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost.ko 2023-06-23T18:29:04.819 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost_iotlb.ko 2023-06-23T18:29:04.819 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost_net.ko 2023-06-23T18:29:04.819 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost_scsi.ko 2023-06-23T18:29:04.819 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video 2023-06-23T18:29:04.819 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight 2023-06-23T18:29:04.819 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight/apple_bl.ko 2023-06-23T18:29:04.820 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight/lcd.ko 2023-06-23T18:29:04.820 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight/platform_lcd.ko 2023-06-23T18:29:04.820 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio 2023-06-23T18:29:04.820 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio.ko 2023-06-23T18:29:04.820 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_balloon.ko 2023-06-23T18:29:04.820 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_mmio.ko 2023-06-23T18:29:04.820 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_pci.ko 2023-06-23T18:29:04.820 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-06-23T18:29:04.821 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-06-23T18:29:04.821 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_ring.ko 2023-06-23T18:29:04.821 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1 2023-06-23T18:29:04.821 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/masters 2023-06-23T18:29:04.821 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/masters/ds2482.ko 2023-06-23T18:29:04.821 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/masters/ds2490.ko 2023-06-23T18:29:04.821 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves 2023-06-23T18:29:04.821 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-06-23T18:29:04.822 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-06-23T18:29:04.822 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-06-23T18:29:04.822 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-06-23T18:29:04.822 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-06-23T18:29:04.822 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-06-23T18:29:04.822 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-06-23T18:29:04.822 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-06-23T18:29:04.822 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-06-23T18:29:04.823 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_smem.ko 2023-06-23T18:29:04.823 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_therm.ko 2023-06-23T18:29:04.823 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/wire.ko 2023-06-23T18:29:04.823 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog 2023-06-23T18:29:04.823 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/alim1535_wdt.ko 2023-06-23T18:29:04.823 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/alim7101_wdt.ko 2023-06-23T18:29:04.823 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/f71808e_wdt.ko 2023-06-23T18:29:04.823 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/hpwdt.ko 2023-06-23T18:29:04.824 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/i6300esb.ko 2023-06-23T18:29:04.824 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-06-23T18:29:04.824 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/iTCO_wdt.ko 2023-06-23T18:29:04.824 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/ib700wdt.ko 2023-06-23T18:29:04.824 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/ibmasr.ko 2023-06-23T18:29:04.824 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-06-23T18:29:04.824 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/it8712f_wdt.ko 2023-06-23T18:29:04.825 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/it87_wdt.ko 2023-06-23T18:29:04.825 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/machzwd.ko 2023-06-23T18:29:04.825 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/nv_tco.ko 2023-06-23T18:29:04.825 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/pcwd_pci.ko 2023-06-23T18:29:04.825 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/pcwd_usb.ko 2023-06-23T18:29:04.825 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-06-23T18:29:04.825 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/sch311x_wdt.ko 2023-06-23T18:29:04.825 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/softdog.ko 2023-06-23T18:29:04.826 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/sp5100_tco.ko 2023-06-23T18:29:04.826 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/via_wdt.ko 2023-06-23T18:29:04.826 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-06-23T18:29:04.826 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/w83877f_wdt.ko 2023-06-23T18:29:04.826 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/w83977f_wdt.ko 2023-06-23T18:29:04.826 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/wdt_pci.ko 2023-06-23T18:29:04.826 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/xen_wdt.ko 2023-06-23T18:29:04.826 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen 2023-06-23T18:29:04.827 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-acpi-processor.ko 2023-06-23T18:29:04.827 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-evtchn.ko 2023-06-23T18:29:04.827 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-gntalloc.ko 2023-06-23T18:29:04.827 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-gntdev.ko 2023-06-23T18:29:04.827 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-pciback 2023-06-23T18:29:04.827 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-06-23T18:29:04.827 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-privcmd.ko 2023-06-23T18:29:04.827 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xenfs 2023-06-23T18:29:04.828 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xenfs/xenfs.ko 2023-06-23T18:29:04.828 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs 2023-06-23T18:29:04.828 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/9p 2023-06-23T18:29:04.828 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/9p/9p.ko 2023-06-23T18:29:04.828 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/affs 2023-06-23T18:29:04.828 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/affs/affs.ko 2023-06-23T18:29:04.828 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/befs 2023-06-23T18:29:04.828 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/befs/befs.ko 2023-06-23T18:29:04.829 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/binfmt_misc.ko 2023-06-23T18:29:04.829 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/btrfs 2023-06-23T18:29:04.829 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/btrfs/btrfs.ko 2023-06-23T18:29:04.829 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cachefiles 2023-06-23T18:29:04.829 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cachefiles/cachefiles.ko 2023-06-23T18:29:04.829 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ceph 2023-06-23T18:29:04.829 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ceph/ceph.ko 2023-06-23T18:29:04.829 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/coda 2023-06-23T18:29:04.830 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/coda/coda.ko 2023-06-23T18:29:04.830 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cramfs 2023-06-23T18:29:04.830 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cramfs/cramfs.ko 2023-06-23T18:29:04.830 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/dlm 2023-06-23T18:29:04.830 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/dlm/dlm.ko 2023-06-23T18:29:04.830 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ecryptfs 2023-06-23T18:29:04.830 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ecryptfs/ecryptfs.ko 2023-06-23T18:29:04.830 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/f2fs 2023-06-23T18:29:04.831 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/f2fs/f2fs.ko 2023-06-23T18:29:04.831 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat 2023-06-23T18:29:04.831 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat/fat.ko 2023-06-23T18:29:04.831 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat/msdos.ko 2023-06-23T18:29:04.831 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat/vfat.ko 2023-06-23T18:29:04.831 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fscache 2023-06-23T18:29:04.831 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fscache/fscache.ko 2023-06-23T18:29:04.831 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fuse 2023-06-23T18:29:04.832 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fuse/cuse.ko 2023-06-23T18:29:04.832 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fuse/fuse.ko 2023-06-23T18:29:04.832 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/gfs2 2023-06-23T18:29:04.832 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/gfs2/gfs2.ko 2023-06-23T18:29:04.832 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfs 2023-06-23T18:29:04.832 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfs/hfs.ko 2023-06-23T18:29:04.832 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfsplus 2023-06-23T18:29:04.833 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfsplus/hfsplus.ko 2023-06-23T18:29:04.833 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/isofs 2023-06-23T18:29:04.833 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/isofs/isofs.ko 2023-06-23T18:29:04.833 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/jfs 2023-06-23T18:29:04.833 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/jfs/jfs.ko 2023-06-23T18:29:04.833 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/lockd 2023-06-23T18:29:04.833 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/lockd/lockd.ko 2023-06-23T18:29:04.833 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/minix 2023-06-23T18:29:04.834 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/minix/minix.ko 2023-06-23T18:29:04.834 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/netfs 2023-06-23T18:29:04.834 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/netfs/netfs.ko 2023-06-23T18:29:04.834 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs 2023-06-23T18:29:04.834 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/blocklayout 2023-06-23T18:29:04.834 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-06-23T18:29:04.834 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/filelayout 2023-06-23T18:29:04.834 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-06-23T18:29:04.835 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/flexfilelayout 2023-06-23T18:29:04.835 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-06-23T18:29:04.835 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/nfs.ko 2023-06-23T18:29:04.835 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/nfsv3.ko 2023-06-23T18:29:04.835 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/nfsv4.ko 2023-06-23T18:29:04.835 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs_common 2023-06-23T18:29:04.835 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs_common/grace.ko 2023-06-23T18:29:04.835 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs_common/nfs_acl.ko 2023-06-23T18:29:04.836 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfsd 2023-06-23T18:29:04.836 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfsd/nfsd.ko 2023-06-23T18:29:04.836 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nilfs2 2023-06-23T18:29:04.836 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nilfs2/nilfs2.ko 2023-06-23T18:29:04.836 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls 2023-06-23T18:29:04.836 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-celtic.ko 2023-06-23T18:29:04.836 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-centeuro.ko 2023-06-23T18:29:04.836 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-croatian.ko 2023-06-23T18:29:04.837 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-cyrillic.ko 2023-06-23T18:29:04.837 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-gaelic.ko 2023-06-23T18:29:04.837 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-greek.ko 2023-06-23T18:29:04.837 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-iceland.ko 2023-06-23T18:29:04.837 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-inuit.ko 2023-06-23T18:29:04.837 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-roman.ko 2023-06-23T18:29:04.837 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-romanian.ko 2023-06-23T18:29:04.837 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-turkish.ko 2023-06-23T18:29:04.838 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp1250.ko 2023-06-23T18:29:04.838 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp1251.ko 2023-06-23T18:29:04.838 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp1255.ko 2023-06-23T18:29:04.838 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp737.ko 2023-06-23T18:29:04.838 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp775.ko 2023-06-23T18:29:04.838 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp850.ko 2023-06-23T18:29:04.838 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp852.ko 2023-06-23T18:29:04.838 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp855.ko 2023-06-23T18:29:04.839 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp857.ko 2023-06-23T18:29:04.839 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp860.ko 2023-06-23T18:29:04.839 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp861.ko 2023-06-23T18:29:04.839 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp862.ko 2023-06-23T18:29:04.839 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp863.ko 2023-06-23T18:29:04.839 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp864.ko 2023-06-23T18:29:04.839 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp865.ko 2023-06-23T18:29:04.839 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp866.ko 2023-06-23T18:29:04.840 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp869.ko 2023-06-23T18:29:04.840 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp874.ko 2023-06-23T18:29:04.840 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp932.ko 2023-06-23T18:29:04.840 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp936.ko 2023-06-23T18:29:04.840 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp949.ko 2023-06-23T18:29:04.840 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp950.ko 2023-06-23T18:29:04.840 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_euc-jp.ko 2023-06-23T18:29:04.841 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-1.ko 2023-06-23T18:29:04.841 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-13.ko 2023-06-23T18:29:04.841 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-14.ko 2023-06-23T18:29:04.841 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-15.ko 2023-06-23T18:29:04.841 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-2.ko 2023-06-23T18:29:04.841 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-3.ko 2023-06-23T18:29:04.841 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-4.ko 2023-06-23T18:29:04.841 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-5.ko 2023-06-23T18:29:04.842 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-6.ko 2023-06-23T18:29:04.842 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-7.ko 2023-06-23T18:29:04.842 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-9.ko 2023-06-23T18:29:04.842 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_koi8-r.ko 2023-06-23T18:29:04.842 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_koi8-ru.ko 2023-06-23T18:29:04.842 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_koi8-u.ko 2023-06-23T18:29:04.842 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_utf8.ko 2023-06-23T18:29:04.842 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2 2023-06-23T18:29:04.843 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/cluster 2023-06-23T18:29:04.843 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-06-23T18:29:04.843 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlm 2023-06-23T18:29:04.843 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-06-23T18:29:04.843 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlmfs 2023-06-23T18:29:04.843 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-06-23T18:29:04.843 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2.ko 2023-06-23T18:29:04.843 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-06-23T18:29:04.844 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-06-23T18:29:04.844 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-06-23T18:29:04.844 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/overlayfs 2023-06-23T18:29:04.844 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/overlayfs/overlay.ko 2023-06-23T18:29:04.844 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/pstore 2023-06-23T18:29:04.844 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/pstore/ramoops.ko 2023-06-23T18:29:04.844 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/reiserfs 2023-06-23T18:29:04.844 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/reiserfs/reiserfs.ko 2023-06-23T18:29:04.845 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/romfs 2023-06-23T18:29:04.845 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/romfs/romfs.ko 2023-06-23T18:29:04.845 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb 2023-06-23T18:29:04.845 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/client 2023-06-23T18:29:04.845 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/client/cifs.ko 2023-06-23T18:29:04.845 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/common 2023-06-23T18:29:04.845 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/common/cifs_arc4.ko 2023-06-23T18:29:04.846 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/common/cifs_md4.ko 2023-06-23T18:29:04.846 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/squashfs 2023-06-23T18:29:04.846 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/squashfs/squashfs.ko 2023-06-23T18:29:04.846 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/sysv 2023-06-23T18:29:04.846 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/sysv/sysv.ko 2023-06-23T18:29:04.846 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/udf 2023-06-23T18:29:04.846 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/udf/udf.ko 2023-06-23T18:29:04.846 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ufs 2023-06-23T18:29:04.847 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ufs/ufs.ko 2023-06-23T18:29:04.847 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/xfs 2023-06-23T18:29:04.847 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/xfs/xfs.ko 2023-06-23T18:29:04.847 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel 2023-06-23T18:29:04.847 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/rcu 2023-06-23T18:29:04.847 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/rcu/rcutorture.ko 2023-06-23T18:29:04.847 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/torture.ko 2023-06-23T18:29:04.847 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/trace 2023-06-23T18:29:04.848 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-06-23T18:29:04.848 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib 2023-06-23T18:29:04.848 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/asn1_encoder.ko 2023-06-23T18:29:04.848 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crc-itu-t.ko 2023-06-23T18:29:04.848 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crc8.ko 2023-06-23T18:29:04.848 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crypto 2023-06-23T18:29:04.848 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crypto/libarc4.ko 2023-06-23T18:29:04.848 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crypto/libdes.ko 2023-06-23T18:29:04.849 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/libcrc32c.ko 2023-06-23T18:29:04.849 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lru_cache.ko 2023-06-23T18:29:04.849 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lz4 2023-06-23T18:29:04.849 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lz4/lz4_compress.ko 2023-06-23T18:29:04.849 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lz4/lz4hc_compress.ko 2023-06-23T18:29:04.849 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/math 2023-06-23T18:29:04.849 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/math/cordic.ko 2023-06-23T18:29:04.850 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/raid6 2023-06-23T18:29:04.850 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/raid6/raid6_pq.ko 2023-06-23T18:29:04.850 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/reed_solomon 2023-06-23T18:29:04.850 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/reed_solomon/reed_solomon.ko 2023-06-23T18:29:04.850 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/ts_bm.ko 2023-06-23T18:29:04.850 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/ts_fsm.ko 2023-06-23T18:29:04.850 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/ts_kmp.ko 2023-06-23T18:29:04.850 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/zstd 2023-06-23T18:29:04.851 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/zstd/zstd_compress.ko 2023-06-23T18:29:04.851 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/mm 2023-06-23T18:29:04.851 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/mm/hwpoison-inject.ko 2023-06-23T18:29:04.851 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net 2023-06-23T18:29:04.851 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan 2023-06-23T18:29:04.851 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/6lowpan.ko 2023-06-23T18:29:04.851 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_dest.ko 2023-06-23T18:29:04.851 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_fragment.ko 2023-06-23T18:29:04.852 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_hop.ko 2023-06-23T18:29:04.852 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_ipv6.ko 2023-06-23T18:29:04.852 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_mobility.ko 2023-06-23T18:29:04.852 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_routing.ko 2023-06-23T18:29:04.852 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_udp.ko 2023-06-23T18:29:04.852 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802 2023-06-23T18:29:04.852 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/garp.ko 2023-06-23T18:29:04.852 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/mrp.ko 2023-06-23T18:29:04.853 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/p8022.ko 2023-06-23T18:29:04.853 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/psnap.ko 2023-06-23T18:29:04.853 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/stp.ko 2023-06-23T18:29:04.853 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/8021q 2023-06-23T18:29:04.853 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/8021q/8021q.ko 2023-06-23T18:29:04.853 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p 2023-06-23T18:29:04.853 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet.ko 2023-06-23T18:29:04.853 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet_fd.ko 2023-06-23T18:29:04.854 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet_rdma.ko 2023-06-23T18:29:04.854 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet_virtio.ko 2023-06-23T18:29:04.854 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/batman-adv 2023-06-23T18:29:04.854 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/batman-adv/batman-adv.ko 2023-06-23T18:29:04.854 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge 2023-06-23T18:29:04.854 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/br_netfilter.ko 2023-06-23T18:29:04.854 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/bridge.ko 2023-06-23T18:29:04.854 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter 2023-06-23T18:29:04.855 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-06-23T18:29:04.855 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_among.ko 2023-06-23T18:29:04.855 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_arp.ko 2023-06-23T18:29:04.855 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-06-23T18:29:04.855 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-06-23T18:29:04.855 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_ip.ko 2023-06-23T18:29:04.855 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-06-23T18:29:04.856 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_limit.ko 2023-06-23T18:29:04.856 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_log.ko 2023-06-23T18:29:04.856 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_mark.ko 2023-06-23T18:29:04.856 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-06-23T18:29:04.856 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-06-23T18:29:04.856 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-06-23T18:29:04.856 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-06-23T18:29:04.857 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_snat.ko 2023-06-23T18:29:04.857 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_stp.ko 2023-06-23T18:29:04.857 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-06-23T18:29:04.857 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-06-23T18:29:04.857 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-06-23T18:29:04.857 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-06-23T18:29:04.857 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtables.ko 2023-06-23T18:29:04.857 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-06-23T18:29:04.858 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-06-23T18:29:04.858 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-06-23T18:29:04.858 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ceph 2023-06-23T18:29:04.858 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ceph/libceph.ko 2023-06-23T18:29:04.858 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/core 2023-06-23T18:29:04.858 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/core/failover.ko 2023-06-23T18:29:04.858 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/core/pktgen.ko 2023-06-23T18:29:04.858 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp 2023-06-23T18:29:04.859 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp.ko 2023-06-23T18:29:04.859 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp_diag.ko 2023-06-23T18:29:04.859 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp_ipv4.ko 2023-06-23T18:29:04.859 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp_ipv6.ko 2023-06-23T18:29:04.859 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dns_resolver 2023-06-23T18:29:04.859 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dns_resolver/dns_resolver.ko 2023-06-23T18:29:04.859 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa 2023-06-23T18:29:04.860 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/dsa_core.ko 2023-06-23T18:29:04.860 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_brcm.ko 2023-06-23T18:29:04.860 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_dsa.ko 2023-06-23T18:29:04.860 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_none.ko 2023-06-23T18:29:04.860 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_trailer.ko 2023-06-23T18:29:04.860 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154 2023-06-23T18:29:04.860 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/6lowpan 2023-06-23T18:29:04.860 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-06-23T18:29:04.861 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/ieee802154.ko 2023-06-23T18:29:04.861 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/ieee802154_socket.ko 2023-06-23T18:29:04.861 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4 2023-06-23T18:29:04.861 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ah4.ko 2023-06-23T18:29:04.861 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/esp4.ko 2023-06-23T18:29:04.861 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/fou.ko 2023-06-23T18:29:04.861 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/gre.ko 2023-06-23T18:29:04.861 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/inet_diag.ko 2023-06-23T18:29:04.862 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ip_gre.ko 2023-06-23T18:29:04.862 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ip_tunnel.ko 2023-06-23T18:29:04.862 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ip_vti.ko 2023-06-23T18:29:04.862 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ipcomp.ko 2023-06-23T18:29:04.862 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ipip.ko 2023-06-23T18:29:04.862 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter 2023-06-23T18:29:04.862 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/arp_tables.ko 2023-06-23T18:29:04.863 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-06-23T18:29:04.863 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-06-23T18:29:04.863 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-06-23T18:29:04.863 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-06-23T18:29:04.863 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-06-23T18:29:04.863 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-06-23T18:29:04.863 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-06-23T18:29:04.863 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-06-23T18:29:04.864 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-06-23T18:29:04.864 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_security.ko 2023-06-23T18:29:04.864 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-06-23T18:29:04.864 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-06-23T18:29:04.864 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-06-23T18:29:04.864 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-06-23T18:29:04.864 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-06-23T18:29:04.865 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-06-23T18:29:04.865 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-06-23T18:29:04.865 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-06-23T18:29:04.865 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-06-23T18:29:04.865 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-06-23T18:29:04.865 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_bic.ko 2023-06-23T18:29:04.865 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_dctcp.ko 2023-06-23T18:29:04.865 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_diag.ko 2023-06-23T18:29:04.866 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_highspeed.ko 2023-06-23T18:29:04.866 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_htcp.ko 2023-06-23T18:29:04.866 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_hybla.ko 2023-06-23T18:29:04.866 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_illinois.ko 2023-06-23T18:29:04.866 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_lp.ko 2023-06-23T18:29:04.866 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_scalable.ko 2023-06-23T18:29:04.866 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_vegas.ko 2023-06-23T18:29:04.866 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_veno.ko 2023-06-23T18:29:04.867 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_westwood.ko 2023-06-23T18:29:04.867 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_yeah.ko 2023-06-23T18:29:04.867 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tunnel4.ko 2023-06-23T18:29:04.867 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/udp_diag.ko 2023-06-23T18:29:04.867 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/udp_tunnel.ko 2023-06-23T18:29:04.867 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/xfrm4_tunnel.ko 2023-06-23T18:29:04.867 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6 2023-06-23T18:29:04.867 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ah6.ko 2023-06-23T18:29:04.868 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/esp6.ko 2023-06-23T18:29:04.868 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/fou6.ko 2023-06-23T18:29:04.868 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ip6_tunnel.ko 2023-06-23T18:29:04.868 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-06-23T18:29:04.868 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ip6_vti.ko 2023-06-23T18:29:04.868 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ipcomp6.ko 2023-06-23T18:29:04.868 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter 2023-06-23T18:29:04.869 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-06-23T18:29:04.869 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-06-23T18:29:04.869 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-06-23T18:29:04.869 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-06-23T18:29:04.869 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-06-23T18:29:04.869 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-06-23T18:29:04.869 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-06-23T18:29:04.869 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-06-23T18:29:04.870 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-06-23T18:29:04.870 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-06-23T18:29:04.870 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-06-23T18:29:04.870 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-06-23T18:29:04.870 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-06-23T18:29:04.870 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-06-23T18:29:04.870 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-06-23T18:29:04.870 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-06-23T18:29:04.871 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-06-23T18:29:04.871 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-06-23T18:29:04.871 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-06-23T18:29:04.871 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-06-23T18:29:04.871 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-06-23T18:29:04.871 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-06-23T18:29:04.871 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-06-23T18:29:04.871 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-06-23T18:29:04.872 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/sit.ko 2023-06-23T18:29:04.872 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/tunnel6.ko 2023-06-23T18:29:04.872 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/xfrm6_tunnel.ko 2023-06-23T18:29:04.872 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/key 2023-06-23T18:29:04.872 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/key/af_key.ko 2023-06-23T18:29:04.872 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp 2023-06-23T18:29:04.872 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_core.ko 2023-06-23T18:29:04.873 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_debugfs.ko 2023-06-23T18:29:04.873 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_eth.ko 2023-06-23T18:29:04.873 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_ip.ko 2023-06-23T18:29:04.873 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_ip6.ko 2023-06-23T18:29:04.873 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_netlink.ko 2023-06-23T18:29:04.873 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_ppp.ko 2023-06-23T18:29:04.873 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/llc 2023-06-23T18:29:04.873 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/llc/llc.ko 2023-06-23T18:29:04.874 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mac802154 2023-06-23T18:29:04.874 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mac802154/mac802154.ko 2023-06-23T18:29:04.874 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mpls 2023-06-23T18:29:04.874 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mpls/mpls_gso.ko 2023-06-23T18:29:04.874 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter 2023-06-23T18:29:04.874 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset 2023-06-23T18:29:04.874 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set.ko 2023-06-23T18:29:04.874 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-06-23T18:29:04.875 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-06-23T18:29:04.875 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-06-23T18:29:04.875 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-06-23T18:29:04.875 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-06-23T18:29:04.875 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-06-23T18:29:04.875 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-06-23T18:29:04.875 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-06-23T18:29:04.875 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-06-23T18:29:04.876 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-06-23T18:29:04.876 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-06-23T18:29:04.876 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-06-23T18:29:04.876 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-06-23T18:29:04.876 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-06-23T18:29:04.876 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-06-23T18:29:04.876 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs 2023-06-23T18:29:04.876 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs.ko 2023-06-23T18:29:04.877 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-06-23T18:29:04.877 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-06-23T18:29:04.877 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-06-23T18:29:04.877 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-06-23T18:29:04.877 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-06-23T18:29:04.877 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-06-23T18:29:04.877 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-06-23T18:29:04.877 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-06-23T18:29:04.878 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-06-23T18:29:04.878 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-06-23T18:29:04.878 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-06-23T18:29:04.878 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-06-23T18:29:04.878 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-06-23T18:29:04.878 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conncount.ko 2023-06-23T18:29:04.878 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack.ko 2023-06-23T18:29:04.879 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-06-23T18:29:04.879 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-06-23T18:29:04.879 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-06-23T18:29:04.879 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_h323.ko 2023-06-23T18:29:04.879 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_irc.ko 2023-06-23T18:29:04.879 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-06-23T18:29:04.879 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-06-23T18:29:04.879 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-06-23T18:29:04.880 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_sane.ko 2023-06-23T18:29:04.880 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_sip.ko 2023-06-23T18:29:04.880 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-06-23T18:29:04.880 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-06-23T18:29:04.880 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_dup_netdev.ko 2023-06-23T18:29:04.880 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_flow_table.ko 2023-06-23T18:29:04.880 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_flow_table_inet.ko 2023-06-23T18:29:04.880 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_log_syslog.ko 2023-06-23T18:29:04.881 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat.ko 2023-06-23T18:29:04.881 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_amanda.ko 2023-06-23T18:29:04.881 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_ftp.ko 2023-06-23T18:29:04.881 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_irc.ko 2023-06-23T18:29:04.881 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_sip.ko 2023-06-23T18:29:04.881 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_tftp.ko 2023-06-23T18:29:04.881 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_synproxy_core.ko 2023-06-23T18:29:04.882 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_tables.ko 2023-06-23T18:29:04.882 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink.ko 2023-06-23T18:29:04.882 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_acct.ko 2023-06-23T18:29:04.882 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_log.ko 2023-06-23T18:29:04.882 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_osf.ko 2023-06-23T18:29:04.882 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_queue.ko 2023-06-23T18:29:04.882 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_chain_nat.ko 2023-06-23T18:29:04.882 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_compat.ko 2023-06-23T18:29:04.883 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_ct.ko 2023-06-23T18:29:04.883 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_dup_netdev.ko 2023-06-23T18:29:04.883 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_fib.ko 2023-06-23T18:29:04.883 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_fwd_netdev.ko 2023-06-23T18:29:04.883 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_hash.ko 2023-06-23T18:29:04.883 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_limit.ko 2023-06-23T18:29:04.883 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_log.ko 2023-06-23T18:29:04.883 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_masq.ko 2023-06-23T18:29:04.884 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_nat.ko 2023-06-23T18:29:04.884 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_numgen.ko 2023-06-23T18:29:04.884 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_queue.ko 2023-06-23T18:29:04.884 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_quota.ko 2023-06-23T18:29:04.884 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_redir.ko 2023-06-23T18:29:04.884 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_reject.ko 2023-06-23T18:29:04.884 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_reject_inet.ko 2023-06-23T18:29:04.885 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_socket.ko 2023-06-23T18:29:04.885 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_tunnel.ko 2023-06-23T18:29:04.885 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_AUDIT.ko 2023-06-23T18:29:04.885 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CHECKSUM.ko 2023-06-23T18:29:04.885 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CLASSIFY.ko 2023-06-23T18:29:04.885 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-06-23T18:29:04.885 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CT.ko 2023-06-23T18:29:04.885 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_DSCP.ko 2023-06-23T18:29:04.886 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_HL.ko 2023-06-23T18:29:04.886 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_HMARK.ko 2023-06-23T18:29:04.886 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_IDLETIMER.ko 2023-06-23T18:29:04.886 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_LED.ko 2023-06-23T18:29:04.886 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_LOG.ko 2023-06-23T18:29:04.886 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_MASQUERADE.ko 2023-06-23T18:29:04.886 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_NETMAP.ko 2023-06-23T18:29:04.886 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_NFLOG.ko 2023-06-23T18:29:04.887 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_NFQUEUE.ko 2023-06-23T18:29:04.887 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_RATEEST.ko 2023-06-23T18:29:04.887 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_REDIRECT.ko 2023-06-23T18:29:04.887 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_SECMARK.ko 2023-06-23T18:29:04.887 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TCPMSS.ko 2023-06-23T18:29:04.887 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-06-23T18:29:04.887 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TEE.ko 2023-06-23T18:29:04.887 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TPROXY.ko 2023-06-23T18:29:04.888 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TRACE.ko 2023-06-23T18:29:04.888 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_addrtype.ko 2023-06-23T18:29:04.888 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_bpf.ko 2023-06-23T18:29:04.888 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_cgroup.ko 2023-06-23T18:29:04.888 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_cluster.ko 2023-06-23T18:29:04.888 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_comment.ko 2023-06-23T18:29:04.888 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connbytes.ko 2023-06-23T18:29:04.888 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connlabel.ko 2023-06-23T18:29:04.889 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connlimit.ko 2023-06-23T18:29:04.889 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connmark.ko 2023-06-23T18:29:04.889 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_conntrack.ko 2023-06-23T18:29:04.889 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_cpu.ko 2023-06-23T18:29:04.889 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_dccp.ko 2023-06-23T18:29:04.889 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_devgroup.ko 2023-06-23T18:29:04.889 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_dscp.ko 2023-06-23T18:29:04.890 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_ecn.ko 2023-06-23T18:29:04.890 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_esp.ko 2023-06-23T18:29:04.890 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_hashlimit.ko 2023-06-23T18:29:04.890 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_helper.ko 2023-06-23T18:29:04.890 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_hl.ko 2023-06-23T18:29:04.890 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_ipcomp.ko 2023-06-23T18:29:04.890 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_iprange.ko 2023-06-23T18:29:04.891 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_ipvs.ko 2023-06-23T18:29:04.891 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_l2tp.ko 2023-06-23T18:29:04.891 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_length.ko 2023-06-23T18:29:04.891 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_limit.ko 2023-06-23T18:29:04.891 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_mac.ko 2023-06-23T18:29:04.891 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_mark.ko 2023-06-23T18:29:04.891 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_multiport.ko 2023-06-23T18:29:04.891 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_nat.ko 2023-06-23T18:29:04.892 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_nfacct.ko 2023-06-23T18:29:04.892 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_osf.ko 2023-06-23T18:29:04.892 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_owner.ko 2023-06-23T18:29:04.892 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_physdev.ko 2023-06-23T18:29:04.892 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_pkttype.ko 2023-06-23T18:29:04.892 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_policy.ko 2023-06-23T18:29:04.892 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_quota.ko 2023-06-23T18:29:04.893 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_rateest.ko 2023-06-23T18:29:04.893 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_realm.ko 2023-06-23T18:29:04.893 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_recent.ko 2023-06-23T18:29:04.893 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_sctp.ko 2023-06-23T18:29:04.893 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_set.ko 2023-06-23T18:29:04.893 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_socket.ko 2023-06-23T18:29:04.893 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_state.ko 2023-06-23T18:29:04.894 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_statistic.ko 2023-06-23T18:29:04.894 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_string.ko 2023-06-23T18:29:04.894 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_tcpmss.ko 2023-06-23T18:29:04.894 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_time.ko 2023-06-23T18:29:04.894 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_u32.ko 2023-06-23T18:29:04.894 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netlink 2023-06-23T18:29:04.894 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netlink/netlink_diag.ko 2023-06-23T18:29:04.894 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/nsh 2023-06-23T18:29:04.895 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/nsh/nsh.ko 2023-06-23T18:29:04.895 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch 2023-06-23T18:29:04.895 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/openvswitch.ko 2023-06-23T18:29:04.895 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/vport-geneve.ko 2023-06-23T18:29:04.895 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/vport-gre.ko 2023-06-23T18:29:04.895 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/vport-vxlan.ko 2023-06-23T18:29:04.895 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/packet 2023-06-23T18:29:04.896 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/packet/af_packet_diag.ko 2023-06-23T18:29:04.896 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds 2023-06-23T18:29:04.896 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds/rds.ko 2023-06-23T18:29:04.896 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds/rds_rdma.ko 2023-06-23T18:29:04.896 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds/rds_tcp.ko 2023-06-23T18:29:04.896 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched 2023-06-23T18:29:04.896 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_csum.ko 2023-06-23T18:29:04.896 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_gact.ko 2023-06-23T18:29:04.897 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_ipt.ko 2023-06-23T18:29:04.897 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_mirred.ko 2023-06-23T18:29:04.897 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_nat.ko 2023-06-23T18:29:04.897 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_pedit.ko 2023-06-23T18:29:04.897 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_police.ko 2023-06-23T18:29:04.897 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_simple.ko 2023-06-23T18:29:04.897 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_skbedit.ko 2023-06-23T18:29:04.898 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_vlan.ko 2023-06-23T18:29:04.898 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_basic.ko 2023-06-23T18:29:04.898 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_bpf.ko 2023-06-23T18:29:04.898 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_flow.ko 2023-06-23T18:29:04.898 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_fw.ko 2023-06-23T18:29:04.898 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_route.ko 2023-06-23T18:29:04.898 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_u32.ko 2023-06-23T18:29:04.899 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_cmp.ko 2023-06-23T18:29:04.899 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_ipset.ko 2023-06-23T18:29:04.899 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_meta.ko 2023-06-23T18:29:04.899 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_nbyte.ko 2023-06-23T18:29:04.899 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_text.ko 2023-06-23T18:29:04.899 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_u32.ko 2023-06-23T18:29:04.899 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_choke.ko 2023-06-23T18:29:04.899 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_codel.ko 2023-06-23T18:29:04.900 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_drr.ko 2023-06-23T18:29:04.900 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_fq.ko 2023-06-23T18:29:04.900 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_gred.ko 2023-06-23T18:29:04.900 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_hfsc.ko 2023-06-23T18:29:04.900 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_hhf.ko 2023-06-23T18:29:04.900 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_htb.ko 2023-06-23T18:29:04.900 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_ingress.ko 2023-06-23T18:29:04.901 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_mqprio.ko 2023-06-23T18:29:04.901 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_mqprio_lib.ko 2023-06-23T18:29:04.901 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_multiq.ko 2023-06-23T18:29:04.901 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_netem.ko 2023-06-23T18:29:04.901 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_pie.ko 2023-06-23T18:29:04.901 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_plug.ko 2023-06-23T18:29:04.901 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_prio.ko 2023-06-23T18:29:04.901 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_qfq.ko 2023-06-23T18:29:04.902 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_red.ko 2023-06-23T18:29:04.902 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_sfb.ko 2023-06-23T18:29:04.902 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_sfq.ko 2023-06-23T18:29:04.902 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_tbf.ko 2023-06-23T18:29:04.902 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_teql.ko 2023-06-23T18:29:04.902 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sctp 2023-06-23T18:29:04.902 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sctp/sctp.ko 2023-06-23T18:29:04.903 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sctp/sctp_diag.ko 2023-06-23T18:29:04.903 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc 2023-06-23T18:29:04.903 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/auth_gss 2023-06-23T18:29:04.903 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-06-23T18:29:04.903 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-06-23T18:29:04.903 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/sunrpc.ko 2023-06-23T18:29:04.903 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/xprtrdma 2023-06-23T18:29:04.903 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-06-23T18:29:04.904 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/tipc 2023-06-23T18:29:04.904 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/tipc/diag.ko 2023-06-23T18:29:04.904 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/tipc/tipc.ko 2023-06-23T18:29:04.904 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/unix 2023-06-23T18:29:04.904 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/unix/unix_diag.ko 2023-06-23T18:29:04.904 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock 2023-06-23T18:29:04.904 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-06-23T18:29:04.904 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-06-23T18:29:04.905 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vsock.ko 2023-06-23T18:29:04.905 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vsock_diag.ko 2023-06-23T18:29:04.905 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vsock_loopback.ko 2023-06-23T18:29:04.905 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/xfrm 2023-06-23T18:29:04.905 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/xfrm/xfrm_ipcomp.ko 2023-06-23T18:29:04.905 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security 2023-06-23T18:29:04.905 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys 2023-06-23T18:29:04.905 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/encrypted-keys 2023-06-23T18:29:04.906 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-06-23T18:29:04.906 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/trusted-keys 2023-06-23T18:29:04.906 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/trusted-keys/trusted.ko 2023-06-23T18:29:04.906 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/virt 2023-06-23T18:29:04.906 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/virt/lib 2023-06-23T18:29:04.906 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/virt/lib/irqbypass.ko 2023-06-23T18:29:04.906 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.alias 2023-06-23T18:29:04.907 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.alias.bin 2023-06-23T18:29:04.907 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.builtin 2023-06-23T18:29:04.907 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.builtin.bin 2023-06-23T18:29:04.907 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.builtin.modinfo 2023-06-23T18:29:04.907 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.dep 2023-06-23T18:29:04.907 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.dep.bin 2023-06-23T18:29:04.907 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.devname 2023-06-23T18:29:04.907 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.order 2023-06-23T18:29:04.908 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.softdep 2023-06-23T18:29:04.908 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.symbols 2023-06-23T18:29:04.908 INFO:teuthology.orchestra.run.smithi158.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.symbols.bin 2023-06-23T18:29:04.909 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:29:04.909 DEBUG:teuthology.orchestra.run.smithi158:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-06-23T18:29:04.934 INFO:teuthology.orchestra.run.smithi158.stdout:postinstall scriptlet (using /bin/sh): 2023-06-23T18:29:04.935 INFO:teuthology.orchestra.run.smithi158.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 -a -r /boot/System.map-6.4.0-rc5-g1c622d92b6f1 ]; then 2023-06-23T18:29:04.935 INFO:teuthology.orchestra.run.smithi158.stdout:cp /boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 /boot/.vmlinuz-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-23T18:29:04.935 INFO:teuthology.orchestra.run.smithi158.stdout:cp /boot/System.map-6.4.0-rc5-g1c622d92b6f1 /boot/.System.map-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-23T18:29:04.935 INFO:teuthology.orchestra.run.smithi158.stdout:rm -f /boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 /boot/System.map-6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:29:04.935 INFO:teuthology.orchestra.run.smithi158.stdout:/sbin/installkernel 6.4.0-rc5-g1c622d92b6f1 /boot/.vmlinuz-6.4.0-rc5-g1c622d92b6f1-rpm /boot/.System.map-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-23T18:29:04.935 INFO:teuthology.orchestra.run.smithi158.stdout:rm -f /boot/.vmlinuz-6.4.0-rc5-g1c622d92b6f1-rpm /boot/.System.map-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-23T18:29:04.936 INFO:teuthology.orchestra.run.smithi158.stdout:fi 2023-06-23T18:29:04.936 INFO:teuthology.orchestra.run.smithi158.stdout:preuninstall scriptlet (using /bin/sh): 2023-06-23T18:29:04.936 INFO:teuthology.orchestra.run.smithi158.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-06-23T18:29:04.936 INFO:teuthology.orchestra.run.smithi158.stdout:new-kernel-pkg --remove 6.4.0-rc5-g1c622d92b6f1 --rminitrd --initrdfile=/boot/initramfs-6.4.0-rc5-g1c622d92b6f1.img 2023-06-23T18:29:04.936 INFO:teuthology.orchestra.run.smithi158.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-06-23T18:29:04.936 INFO:teuthology.orchestra.run.smithi158.stdout:kernel-install remove 6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:29:04.936 INFO:teuthology.orchestra.run.smithi158.stdout:fi 2023-06-23T18:29:04.936 INFO:teuthology.orchestra.run.smithi158.stdout:postuninstall scriptlet (using /bin/sh): 2023-06-23T18:29:04.937 INFO:teuthology.orchestra.run.smithi158.stdout:if [ -x /sbin/update-bootloader ]; then 2023-06-23T18:29:04.937 INFO:teuthology.orchestra.run.smithi158.stdout:/sbin/update-bootloader --remove 6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:29:04.937 INFO:teuthology.orchestra.run.smithi158.stdout:fi 2023-06-23T18:29:04.938 DEBUG:teuthology.orchestra.run.smithi158:> sudo rpm -qi grub2-tools 2023-06-23T18:29:05.013 INFO:teuthology.orchestra.run.smithi158.stdout:Name : grub2-tools 2023-06-23T18:29:05.013 INFO:teuthology.orchestra.run.smithi158.stdout:Epoch : 1 2023-06-23T18:29:05.013 INFO:teuthology.orchestra.run.smithi158.stdout:Version : 2.02 2023-06-23T18:29:05.014 INFO:teuthology.orchestra.run.smithi158.stdout:Release : 129.el8 2023-06-23T18:29:05.014 INFO:teuthology.orchestra.run.smithi158.stdout:Architecture: x86_64 2023-06-23T18:29:05.014 INFO:teuthology.orchestra.run.smithi158.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-06-23T18:29:05.014 INFO:teuthology.orchestra.run.smithi158.stdout:Group : System Environment/Base 2023-06-23T18:29:05.014 INFO:teuthology.orchestra.run.smithi158.stdout:Size : 9265586 2023-06-23T18:29:05.014 INFO:teuthology.orchestra.run.smithi158.stdout:License : GPLv3+ 2023-06-23T18:29:05.014 INFO:teuthology.orchestra.run.smithi158.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-06-23T18:29:05.015 INFO:teuthology.orchestra.run.smithi158.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-06-23T18:29:05.015 INFO:teuthology.orchestra.run.smithi158.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-06-23T18:29:05.015 INFO:teuthology.orchestra.run.smithi158.stdout:Build Host : kbuilder.bsys.centos.org 2023-06-23T18:29:05.015 INFO:teuthology.orchestra.run.smithi158.stdout:Relocations : (not relocatable) 2023-06-23T18:29:05.015 INFO:teuthology.orchestra.run.smithi158.stdout:Packager : CentOS BuildSystem 2023-06-23T18:29:05.015 INFO:teuthology.orchestra.run.smithi158.stdout:Vendor : CentOS 2023-06-23T18:29:05.015 INFO:teuthology.orchestra.run.smithi158.stdout:URL : http://www.gnu.org/software/grub/ 2023-06-23T18:29:05.015 INFO:teuthology.orchestra.run.smithi158.stdout:Summary : Support tools for GRUB. 2023-06-23T18:29:05.016 INFO:teuthology.orchestra.run.smithi158.stdout:Description : 2023-06-23T18:29:05.016 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:29:05.016 INFO:teuthology.orchestra.run.smithi158.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-06-23T18:29:05.016 INFO:teuthology.orchestra.run.smithi158.stdout:customizable bootloader with modular architecture. It supports a rich 2023-06-23T18:29:05.016 INFO:teuthology.orchestra.run.smithi158.stdout:variety of kernel formats, file systems, computer architectures and 2023-06-23T18:29:05.016 INFO:teuthology.orchestra.run.smithi158.stdout:hardware devices. 2023-06-23T18:29:05.016 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:29:05.017 INFO:teuthology.orchestra.run.smithi158.stdout:This subpackage provides tools for support of all platforms. 2023-06-23T18:29:05.017 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-06-23T18:29:05.017 INFO:teuthology.task.kernel:Updating grub on smithi158 to boot 6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:29:05.018 DEBUG:teuthology.orchestra.run.smithi158:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-06-23T18:29:10.718 INFO:teuthology.orchestra.run.smithi158.stderr:Generating grub configuration file ... 2023-06-23T18:29:12.949 INFO:teuthology.orchestra.run.smithi158.stderr:done 2023-06-23T18:29:12.954 DEBUG:teuthology.orchestra.run.smithi158:> mktemp 2023-06-23T18:29:12.977 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.QSJt4yGIwa 2023-06-23T18:29:12.977 DEBUG:teuthology.orchestra.run.smithi158:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.QSJt4yGIwa 2023-06-23T18:29:13.050 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 0666 /tmp/tmp.QSJt4yGIwa 2023-06-23T18:29:13.199 DEBUG:teuthology.orchestra.remote:smithi158:/tmp/tmp.QSJt4yGIwa is 6KB 2023-06-23T18:29:13.223 DEBUG:teuthology.orchestra.run.smithi158:> rm -fr /tmp/tmp.QSJt4yGIwa 2023-06-23T18:29:13.240 DEBUG:teuthology.orchestra.run.smithi158:> sudo /bin/ls /boot/loader/entries || true 2023-06-23T18:29:13.317 INFO:teuthology.orchestra.run.smithi158.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-06-23T18:29:13.317 INFO:teuthology.orchestra.run.smithi158.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-06-23T18:29:13.317 INFO:teuthology.orchestra.run.smithi158.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-06-23T18:29:13.317 INFO:teuthology.orchestra.run.smithi158.stdout:a1b29d6c289747bdb22930598d39874a-6.4.0-rc5-g1c622d92b6f1.conf 2023-06-23T18:29:13.318 DEBUG:teuthology.orchestra.run.smithi158:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:29:13.510 DEBUG:teuthology.orchestra.run.smithi158:> sudo shutdown -r now 2023-06-23T18:29:43.513 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-06-23T18:29:43.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-06-23T18:29:43.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:30:17.968 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-06-23T18:30:47.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-06-23T18:30:47.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:31:06.356 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.158 2023-06-23T18:31:36.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-06-23T18:31:36.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:31:36.684 DEBUG:teuthology.orchestra.run.smithi158:> true 2023-06-23T18:31:37.093 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-06-23T18:31:37.094 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.4.0-rc5-g1c622d92b6f1"... 2023-06-23T18:31:37.094 DEBUG:teuthology.orchestra.run.smithi158:> uname -r 2023-06-23T18:31:37.138 INFO:teuthology.orchestra.run.smithi158.stdout:6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:31:37.138 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-rc5-g1c622d92b6f1 vs 6.4.0-rc5-g1c622d92b6f1 2023-06-23T18:31:37.139 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-23T18:31:37.139 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-06-23T18:31:38.140 DEBUG:teuthology.parallel:result is None 2023-06-23T18:31:38.141 INFO:teuthology.run_tasks:Running task internal.base... 2023-06-23T18:31:38.148 INFO:teuthology.task.internal:Creating test directory... 2023-06-23T18:31:38.149 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-23T18:31:38.153 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-23T18:31:38.156 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-23T18:31:38.206 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-06-23T18:31:38.216 INFO:teuthology.run_tasks:Running task internal.archive... 2023-06-23T18:31:38.308 INFO:teuthology.task.internal:Creating archive directory... 2023-06-23T18:31:38.309 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-23T18:31:38.311 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-23T18:31:38.313 DEBUG:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-23T18:31:38.452 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-06-23T18:31:38.460 INFO:teuthology.task.internal:Enabling coredump saving... 2023-06-23T18:31:38.460 DEBUG:teuthology.orchestra.run.smithi052:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-23T18:31:38.481 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:31:38.483 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-23T18:31:38.502 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:31:38.503 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-23T18:31:38.526 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-23T18:31:38.545 DEBUG:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-23T18:31:38.588 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T18:31:38.607 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T18:31:38.609 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T18:31:38.627 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T18:31:38.663 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T18:31:38.695 INFO:teuthology.orchestra.run.smithi158.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T18:31:38.699 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-06-23T18:31:38.706 INFO:teuthology.task.internal:Configuring sudo... 2023-06-23T18:31:38.707 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-23T18:31:38.709 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-23T18:31:38.711 DEBUG:teuthology.orchestra.run.smithi158:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-23T18:31:38.782 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-06-23T18:31:38.793 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-06-23T18:31:38.794 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-23T18:31:38.797 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-23T18:31:38.799 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-23T18:31:38.844 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-23T18:31:38.908 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-23T18:31:38.952 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-23T18:31:39.043 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-23T18:31:39.084 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-06-23T18:31:39.084 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-23T18:31:39.153 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-23T18:31:39.207 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-23T18:31:39.277 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-23T18:31:39.330 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-23T18:31:39.369 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-23T18:31:39.369 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-23T18:31:39.438 DEBUG:teuthology.orchestra.run.smithi158:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-23T18:31:39.515 DEBUG:teuthology.orchestra.run.smithi158:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-23T18:31:39.584 DEBUG:teuthology.orchestra.run.smithi158:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-23T18:31:39.659 DEBUG:teuthology.orchestra.run.smithi158:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-23T18:31:39.728 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-06-23T18:31:39.728 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-23T18:31:39.796 DEBUG:teuthology.orchestra.run.smithi052:> sudo service rsyslog restart 2023-06-23T18:31:39.798 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2023-06-23T18:31:39.800 DEBUG:teuthology.orchestra.run.smithi158:> sudo service rsyslog restart 2023-06-23T18:31:39.854 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-06-23T18:31:39.883 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-06-23T18:31:39.947 INFO:teuthology.orchestra.run.smithi158.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-06-23T18:31:40.221 INFO:teuthology.run_tasks:Running task internal.timer... 2023-06-23T18:31:40.232 INFO:teuthology.task.internal:Starting timer... 2023-06-23T18:31:40.232 INFO:teuthology.run_tasks:Running task pcp... 2023-06-23T18:31:40.288 INFO:teuthology.run_tasks:Running task selinux... 2023-06-23T18:31:40.357 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-06-23T18:31:40.357 DEBUG:teuthology.orchestra.run.smithi052:> sudo service auditd rotate 2023-06-23T18:31:40.423 INFO:teuthology.orchestra.run.smithi052.stdout:Rotating logs: 2023-06-23T18:31:40.425 DEBUG:teuthology.orchestra.run.smithi089:> sudo service auditd rotate 2023-06-23T18:31:40.515 INFO:teuthology.orchestra.run.smithi089.stdout:Rotating logs: 2023-06-23T18:31:40.516 DEBUG:teuthology.orchestra.run.smithi158:> sudo service auditd rotate 2023-06-23T18:31:40.667 INFO:teuthology.orchestra.run.smithi158.stdout:Rotating logs: 2023-06-23T18:31:40.669 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-06-23T18:31:40.669 DEBUG:teuthology.orchestra.run.smithi052:> /usr/sbin/getenforce 2023-06-23T18:31:40.699 INFO:teuthology.orchestra.run.smithi052.stdout:Permissive 2023-06-23T18:31:40.699 DEBUG:teuthology.orchestra.run.smithi089:> /usr/sbin/getenforce 2023-06-23T18:31:40.726 INFO:teuthology.orchestra.run.smithi089.stdout:Permissive 2023-06-23T18:31:40.727 DEBUG:teuthology.orchestra.run.smithi158:> /usr/sbin/getenforce 2023-06-23T18:31:40.780 INFO:teuthology.orchestra.run.smithi158.stdout:Permissive 2023-06-23T18:31:40.780 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi052.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi089.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi158.front.sepia.ceph.com': 'permissive'} 2023-06-23T18:31:40.781 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-06-23T18:31:40.812 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:31:40.813 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-06-23T18:31:40.841 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:31:40.842 DEBUG:teuthology.orchestra.run.smithi158:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-06-23T18:31:40.911 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:31:40.912 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-06-23T18:31:40.912 DEBUG:teuthology.orchestra.run.smithi052:> sudo /usr/sbin/setenforce permissive 2023-06-23T18:31:40.940 DEBUG:teuthology.orchestra.run.smithi089:> sudo /usr/sbin/setenforce permissive 2023-06-23T18:31:40.969 DEBUG:teuthology.orchestra.run.smithi158:> sudo /usr/sbin/setenforce permissive 2023-06-23T18:31:41.049 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-06-23T18:31:41.060 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-06-23T18:31:41.061 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-06-23T18:31:41.082 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-06-23T18:31:41.083 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi052.front.sepia.ceph.com,smithi089.front.sepia.ceph.com,smithi158.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-06-23T18:41:18.340 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi052.front.sepia.ceph.com'), Remote(name='ubuntu@smithi089.front.sepia.ceph.com'), Remote(name='ubuntu@smithi158.front.sepia.ceph.com')] 2023-06-23T18:41:18.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2023-06-23T18:41:18.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:41:18.412 DEBUG:teuthology.orchestra.run.smithi052:> true 2023-06-23T18:41:18.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-06-23T18:41:18.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:41:18.509 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-06-23T18:41:18.584 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2023-06-23T18:41:18.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T18:41:18.668 DEBUG:teuthology.orchestra.run.smithi158:> true 2023-06-23T18:41:18.779 INFO:teuthology.run_tasks:Running task clock... 2023-06-23T18:41:18.789 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-06-23T18:41:18.789 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-23T18:41:18.790 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-23T18:41:18.792 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-23T18:41:18.793 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-23T18:41:18.795 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-23T18:41:18.795 DEBUG:teuthology.orchestra.run.smithi158:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-23T18:41:18.829 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-06-23T18:41:18.830 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-06-23T18:41:18.845 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-06-23T18:41:18.846 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-06-23T18:41:18.870 INFO:teuthology.orchestra.run.smithi158.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-06-23T18:41:18.903 INFO:teuthology.orchestra.run.smithi158.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-06-23T18:41:18.916 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: ntpd: command not found 2023-06-23T18:41:18.916 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: ntpd: command not found 2023-06-23T18:41:18.928 INFO:teuthology.orchestra.run.smithi089.stdout:506 Cannot talk to daemon 2023-06-23T18:41:18.929 INFO:teuthology.orchestra.run.smithi052.stdout:506 Cannot talk to daemon 2023-06-23T18:41:18.943 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-06-23T18:41:18.944 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-06-23T18:41:18.957 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-06-23T18:41:18.958 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-06-23T18:41:18.988 INFO:teuthology.orchestra.run.smithi158.stderr:sudo: ntpd: command not found 2023-06-23T18:41:19.015 INFO:teuthology.orchestra.run.smithi158.stdout:506 Cannot talk to daemon 2023-06-23T18:41:19.031 INFO:teuthology.orchestra.run.smithi052.stderr:bash: ntpq: command not found 2023-06-23T18:41:19.032 INFO:teuthology.orchestra.run.smithi089.stderr:bash: ntpq: command not found 2023-06-23T18:41:19.034 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-06-23T18:41:19.034 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2023-06-23T18:41:19.035 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-23T18:41:19.035 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-23T18:41:19.035 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-23T18:41:19.035 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-23T18:41:19.036 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-06-23T18:41:19.036 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2023-06-23T18:41:19.037 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-23T18:41:19.037 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-23T18:41:19.037 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-23T18:41:19.037 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-23T18:41:19.047 INFO:teuthology.orchestra.run.smithi158.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-06-23T18:41:19.079 INFO:teuthology.orchestra.run.smithi158.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-06-23T18:41:19.170 INFO:teuthology.orchestra.run.smithi158.stderr:bash: ntpq: command not found 2023-06-23T18:41:19.177 INFO:teuthology.orchestra.run.smithi158.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-06-23T18:41:19.178 INFO:teuthology.orchestra.run.smithi158.stdout:=============================================================================== 2023-06-23T18:41:19.178 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-23T18:41:19.178 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-23T18:41:19.178 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-23T18:41:19.178 INFO:teuthology.orchestra.run.smithi158.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-23T18:41:19.179 INFO:teuthology.run_tasks:Running task install... 2023-06-23T18:41:19.188 DEBUG:teuthology.task.install:project ceph 2023-06-23T18:41:19.188 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b'}} 2023-06-23T18:41:19.189 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b'} 2023-06-23T18:41:19.189 INFO:teuthology.task.install:Using flavor: default 2023-06-23T18:41:19.194 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-06-23T18:41:19.195 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-06-23T18:41:19.195 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b', 'tag': None, 'wait_for_package': False} 2023-06-23T18:41:19.196 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8627af3e0adcb765a3c249fcc209cba9f4873e1b 2023-06-23T18:41:19.198 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b', 'tag': None, 'wait_for_package': False} 2023-06-23T18:41:19.199 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8627af3e0adcb765a3c249fcc209cba9f4873e1b 2023-06-23T18:41:19.200 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b', 'tag': None, 'wait_for_package': False} 2023-06-23T18:41:19.200 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8627af3e0adcb765a3c249fcc209cba9f4873e1b 2023-06-23T18:41:19.470 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/centos/8/flavors/default/ 2023-06-23T18:41:19.470 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4479.g8627af3e 2023-06-23T18:41:19.475 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/centos/8/flavors/default/ 2023-06-23T18:41:19.475 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4479.g8627af3e 2023-06-23T18:41:19.479 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/centos/8/flavors/default/ 2023-06-23T18:41:19.480 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4479.g8627af3e 2023-06-23T18:41:19.744 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-06-23T18:41:19.744 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-06-23T18:41:19.745 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-06-23T18:41:19.780 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-06-23T18:41:19.780 DEBUG:teuthology.orchestra.run.smithi052:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8627af3e0adcb765a3c249fcc209cba9f4873e1b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-06-23T18:41:19.821 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-06-23T18:41:19.821 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-06-23T18:41:19.821 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-06-23T18:41:19.830 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-improvements-authmon/8627af3e0adcb765a3c249fcc209cba9f4873e1b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-06-23T18:41:19.830 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-23T18:41:19.830 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-06-23T18:41:19.854 DEBUG:teuthology.orchestra.run.smithi052:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-06-23T18:41:19.862 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-06-23T18:41:19.863 DEBUG:teuthology.orchestra.run.smithi089:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8627af3e0adcb765a3c249fcc209cba9f4873e1b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-06-23T18:41:19.892 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-06-23T18:41:19.893 DEBUG:teuthology.orchestra.run.smithi158:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8627af3e0adcb765a3c249fcc209cba9f4873e1b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-06-23T18:41:19.932 DEBUG:teuthology.orchestra.run.smithi089:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-06-23T18:41:19.935 DEBUG:teuthology.orchestra.run.smithi052:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-06-23T18:41:20.003 DEBUG:teuthology.orchestra.run.smithi158:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-06-23T18:41:20.004 INFO:teuthology.orchestra.run.smithi052.stdout:check_obsoletes = 1 2023-06-23T18:41:20.005 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum clean all 2023-06-23T18:41:20.012 DEBUG:teuthology.orchestra.run.smithi089:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-06-23T18:41:20.081 INFO:teuthology.orchestra.run.smithi089.stdout:check_obsoletes = 1 2023-06-23T18:41:20.082 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum clean all 2023-06-23T18:41:20.097 DEBUG:teuthology.orchestra.run.smithi158:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-06-23T18:41:20.164 INFO:teuthology.orchestra.run.smithi158.stdout:check_obsoletes = 1 2023-06-23T18:41:20.167 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum clean all 2023-06-23T18:41:20.288 INFO:teuthology.orchestra.run.smithi052.stdout:67 files removed 2023-06-23T18:41:20.317 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-06-23T18:41:20.350 INFO:teuthology.orchestra.run.smithi089.stdout:67 files removed 2023-06-23T18:41:20.377 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-06-23T18:41:20.502 INFO:teuthology.orchestra.run.smithi158.stdout:67 files removed 2023-06-23T18:41:20.537 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-06-23T18:41:21.495 INFO:teuthology.orchestra.run.smithi089.stdout:ceph packages for x86_64 109 kB/s | 81 kB 00:00 2023-06-23T18:41:21.637 INFO:teuthology.orchestra.run.smithi052.stdout:ceph packages for x86_64 88 kB/s | 81 kB 00:00 2023-06-23T18:41:21.932 INFO:teuthology.orchestra.run.smithi158.stdout:ceph packages for x86_64 95 kB/s | 81 kB 00:00 2023-06-23T18:41:22.237 INFO:teuthology.orchestra.run.smithi089.stdout:ceph noarch packages 13 kB/s | 9.4 kB 00:00 2023-06-23T18:41:22.380 INFO:teuthology.orchestra.run.smithi052.stdout:ceph noarch packages 13 kB/s | 9.4 kB 00:00 2023-06-23T18:41:22.592 INFO:teuthology.orchestra.run.smithi158.stdout:ceph noarch packages 15 kB/s | 9.4 kB 00:00 2023-06-23T18:41:22.896 INFO:teuthology.orchestra.run.smithi089.stdout:ceph source packages 2.4 kB/s | 1.5 kB 00:00 2023-06-23T18:41:23.130 INFO:teuthology.orchestra.run.smithi052.stdout:ceph source packages 2.1 kB/s | 1.5 kB 00:00 2023-06-23T18:41:23.367 INFO:teuthology.orchestra.run.smithi158.stdout:ceph source packages 2.0 kB/s | 1.5 kB 00:00 2023-06-23T18:41:25.347 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 8 - AppStream 14 MB/s | 30 MB 00:02 2023-06-23T18:41:26.275 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - AppStream 10 MB/s | 30 MB 00:02 2023-06-23T18:41:27.571 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 8 - AppStream 6.4 MB/s | 30 MB 00:04 2023-06-23T18:41:32.622 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 8 - BaseOS 25 MB/s | 39 MB 00:01 2023-06-23T18:41:33.442 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - BaseOS 27 MB/s | 39 MB 00:01 2023-06-23T18:41:34.471 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 8 - BaseOS 26 MB/s | 39 MB 00:01 2023-06-23T18:41:39.339 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 8 - Extras 27 kB/s | 18 kB 00:00 2023-06-23T18:41:39.898 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.6 kB 00:00 2023-06-23T18:41:39.900 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - Extras 37 kB/s | 18 kB 00:00 2023-06-23T18:41:40.242 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - Extras common packages 37 kB/s | 6.6 kB 00:00 2023-06-23T18:41:40.804 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 8 - Extras 35 kB/s | 18 kB 00:00 2023-06-23T18:41:40.883 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 8 - PowerTools 7.2 MB/s | 6.0 MB 00:00 2023-06-23T18:41:41.197 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 8 - Extras common packages 29 kB/s | 6.6 kB 00:00 2023-06-23T18:41:41.202 INFO:teuthology.orchestra.run.smithi158.stdout:CentOS Stream 8 - PowerTools 7.4 MB/s | 6.0 MB 00:00 2023-06-23T18:41:42.048 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 8 - PowerTools 8.5 MB/s | 6.0 MB 00:00 2023-06-23T18:41:44.750 INFO:teuthology.orchestra.run.smithi052.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-06-23T18:41:45.128 INFO:teuthology.orchestra.run.smithi158.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-06-23T18:41:45.199 INFO:teuthology.orchestra.run.smithi089.stdout:Copr repo for python3-asyncssh owned by ceph 1.8 kB/s | 3.5 kB 00:01 2023-06-23T18:41:46.220 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-06-23T18:41:46.516 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-06-23T18:41:47.278 INFO:teuthology.orchestra.run.smithi158.stdout:Extra Packages for Enterprise Linux 7.8 MB/s | 16 MB 00:01 2023-06-23T18:41:50.226 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 439 kB/s | 24 kB 00:00 2023-06-23T18:41:50.266 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 421 kB/s | 24 kB 00:00 2023-06-23T18:41:51.662 INFO:teuthology.orchestra.run.smithi158.stdout:lab-extras 310 kB/s | 24 kB 00:00 2023-06-23T18:41:54.067 INFO:teuthology.orchestra.run.smithi089.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-23T18:41:54.067 INFO:teuthology.orchestra.run.smithi089.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-23T18:41:54.080 INFO:teuthology.orchestra.run.smithi089.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-06-23T18:41:54.080 INFO:teuthology.orchestra.run.smithi089.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-06-23T18:41:54.081 INFO:teuthology.orchestra.run.smithi089.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-06-23T18:41:54.082 INFO:teuthology.orchestra.run.smithi089.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-06-23T18:41:54.083 INFO:teuthology.orchestra.run.smithi089.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-06-23T18:41:54.085 INFO:teuthology.orchestra.run.smithi089.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-06-23T18:41:54.088 INFO:teuthology.orchestra.run.smithi089.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-06-23T18:41:54.088 INFO:teuthology.orchestra.run.smithi089.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-06-23T18:41:54.241 INFO:teuthology.orchestra.run.smithi052.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-23T18:41:54.242 INFO:teuthology.orchestra.run.smithi052.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-23T18:41:54.255 INFO:teuthology.orchestra.run.smithi052.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-06-23T18:41:54.256 INFO:teuthology.orchestra.run.smithi052.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-06-23T18:41:54.256 INFO:teuthology.orchestra.run.smithi052.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-06-23T18:41:54.257 INFO:teuthology.orchestra.run.smithi052.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-06-23T18:41:54.258 INFO:teuthology.orchestra.run.smithi052.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-06-23T18:41:54.260 INFO:teuthology.orchestra.run.smithi052.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-06-23T18:41:54.263 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-06-23T18:41:54.263 INFO:teuthology.orchestra.run.smithi052.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-06-23T18:41:54.264 INFO:teuthology.orchestra.run.smithi052.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-06-23T18:41:54.276 INFO:teuthology.orchestra.run.smithi089.stdout:==================================================================================================== 2023-06-23T18:41:54.277 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-06-23T18:41:54.277 INFO:teuthology.orchestra.run.smithi089.stdout:==================================================================================================== 2023-06-23T18:41:54.277 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-06-23T18:41:54.277 INFO:teuthology.orchestra.run.smithi089.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-06-23T18:41:54.277 INFO:teuthology.orchestra.run.smithi089.stdout: ceph x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 6.4 k 2023-06-23T18:41:54.277 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 5.4 M 2023-06-23T18:41:54.278 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 848 k 2023-06-23T18:41:54.278 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 165 k 2023-06-23T18:41:54.278 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 1.5 M 2023-06-23T18:41:54.278 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 128 k 2023-06-23T18:41:54.278 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 1.7 M 2023-06-23T18:41:54.278 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 7.4 M 2023-06-23T18:41:54.278 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 47 k 2023-06-23T18:41:54.279 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 13 M 2023-06-23T18:41:54.279 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 48 M 2023-06-23T18:41:54.279 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 258 k 2023-06-23T18:41:54.279 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 161 k 2023-06-23T18:41:54.279 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-mirror x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 258 k 2023-06-23T18:41:54.279 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-top noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 18 k 2023-06-23T18:41:54.279 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-06-23T18:41:54.279 INFO:teuthology.orchestra.run.smithi089.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-06-23T18:41:54.280 INFO:teuthology.orchestra.run.smithi089.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-06-23T18:41:54.280 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 31 k 2023-06-23T18:41:54.280 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2 x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 771 k 2023-06-23T18:41:54.280 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 139 k 2023-06-23T18:41:54.280 INFO:teuthology.orchestra.run.smithi089.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-06-23T18:41:54.280 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-06-23T18:41:54.280 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-06-23T18:41:54.281 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-06-23T18:41:54.281 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-06-23T18:41:54.281 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-06-23T18:41:54.281 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 197 k 2023-06-23T18:41:54.281 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 370 k 2023-06-23T18:41:54.281 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 365 k 2023-06-23T18:41:54.281 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 107 k 2023-06-23T18:41:54.281 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 94 k 2023-06-23T18:41:54.282 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 3.4 M 2023-06-23T18:41:54.282 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 179 k 2023-06-23T18:41:54.282 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-06-23T18:41:54.282 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrading: 2023-06-23T18:41:54.282 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-7.el8 baseos 143 k 2023-06-23T18:41:54.282 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-06-23T18:41:54.282 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-06-23T18:41:54.283 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-06-23T18:41:54.283 INFO:teuthology.orchestra.run.smithi089.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-06-23T18:41:54.283 INFO:teuthology.orchestra.run.smithi089.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-06-23T18:41:54.283 INFO:teuthology.orchestra.run.smithi089.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-06-23T18:41:54.283 INFO:teuthology.orchestra.run.smithi089.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-06-23T18:41:54.283 INFO:teuthology.orchestra.run.smithi089.stdout: librados2 x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 3.7 M 2023-06-23T18:41:54.283 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1 x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 3.6 M 2023-06-23T18:41:54.283 INFO:teuthology.orchestra.run.smithi089.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-06-23T18:41:54.284 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-06-23T18:41:54.284 INFO:teuthology.orchestra.run.smithi089.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-06-23T18:41:54.284 INFO:teuthology.orchestra.run.smithi089.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-06-23T18:41:54.284 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-06-23T18:41:54.284 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-06-23T18:41:54.284 INFO:teuthology.orchestra.run.smithi089.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-06-23T18:41:54.284 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 22 M 2023-06-23T18:41:54.285 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 23 k 2023-06-23T18:41:54.285 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 2.3 M 2023-06-23T18:41:54.285 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 240 k 2023-06-23T18:41:54.285 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 4.6 M 2023-06-23T18:41:54.285 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 18 M 2023-06-23T18:41:54.285 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 15 k 2023-06-23T18:41:54.285 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 24 k 2023-06-23T18:41:54.285 INFO:teuthology.orchestra.run.smithi089.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-06-23T18:41:54.286 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-06-23T18:41:54.286 INFO:teuthology.orchestra.run.smithi089.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-06-23T18:41:54.287 INFO:teuthology.orchestra.run.smithi089.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-06-23T18:41:54.287 INFO:teuthology.orchestra.run.smithi089.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-06-23T18:41:54.287 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 137 k 2023-06-23T18:41:54.287 INFO:teuthology.orchestra.run.smithi089.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-06-23T18:41:54.287 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran x86_64 8.5.0-19.el8 baseos 645 k 2023-06-23T18:41:54.288 INFO:teuthology.orchestra.run.smithi089.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-06-23T18:41:54.288 INFO:teuthology.orchestra.run.smithi089.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-06-23T18:41:54.288 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath x86_64 8.5.0-19.el8 baseos 172 k 2023-06-23T18:41:54.288 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq x86_64 0.9.0-3.el8 baseos 47 k 2023-06-23T18:41:54.288 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1 x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 474 k 2023-06-23T18:41:54.288 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-06-23T18:41:54.288 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2 x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 6.7 M 2023-06-23T18:41:54.288 INFO:teuthology.orchestra.run.smithi089.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-06-23T18:41:54.289 INFO:teuthology.orchestra.run.smithi089.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-06-23T18:41:54.289 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-06-23T18:41:54.289 INFO:teuthology.orchestra.run.smithi089.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-06-23T18:41:54.289 INFO:teuthology.orchestra.run.smithi089.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-06-23T18:41:54.289 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-06-23T18:41:54.289 INFO:teuthology.orchestra.run.smithi089.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-06-23T18:41:54.289 INFO:teuthology.orchestra.run.smithi089.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-06-23T18:41:54.290 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-06-23T18:41:54.290 INFO:teuthology.orchestra.run.smithi089.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-06-23T18:41:54.290 INFO:teuthology.orchestra.run.smithi089.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-06-23T18:41:54.290 INFO:teuthology.orchestra.run.smithi089.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-06-23T18:41:54.290 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-06-23T18:41:54.290 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-06-23T18:41:54.290 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-06-23T18:41:54.290 INFO:teuthology.orchestra.run.smithi089.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-06-23T18:41:54.291 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-06-23T18:41:54.291 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 45 k 2023-06-23T18:41:54.291 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 119 k 2023-06-23T18:41:54.291 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-06-23T18:41:54.291 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-06-23T18:41:54.291 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-06-23T18:41:54.291 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-06-23T18:41:54.291 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-06-23T18:41:54.292 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-06-23T18:41:54.292 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-06-23T18:41:54.292 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-06-23T18:41:54.292 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-06-23T18:41:54.292 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-06-23T18:41:54.292 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-06-23T18:41:54.292 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-06-23T18:41:54.293 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-06-23T18:41:54.293 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-06-23T18:41:54.293 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-06-23T18:41:54.293 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-06-23T18:41:54.293 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-06-23T18:41:54.293 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-06-23T18:41:54.293 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-06-23T18:41:54.293 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-06-23T18:41:54.294 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-06-23T18:41:54.294 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-06-23T18:41:54.294 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-06-23T18:41:54.294 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-06-23T18:41:54.294 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-06-23T18:41:54.294 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-06-23T18:41:54.294 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-06-23T18:41:54.294 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-06-23T18:41:54.295 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-06-23T18:41:54.295 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-06-23T18:41:54.295 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-06-23T18:41:54.295 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-06-23T18:41:54.295 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-06-23T18:41:54.295 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-06-23T18:41:54.295 INFO:teuthology.orchestra.run.smithi089.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-06-23T18:41:54.296 INFO:teuthology.orchestra.run.smithi089.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-06-23T18:41:54.296 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-06-23T18:41:54.296 INFO:teuthology.orchestra.run.smithi089.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-06-23T18:41:54.296 INFO:teuthology.orchestra.run.smithi089.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-06-23T18:41:54.296 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-06-23T18:41:54.296 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-06-23T18:41:54.296 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-06-23T18:41:54.296 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-06-23T18:41:54.297 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-06-23T18:41:54.297 INFO:teuthology.orchestra.run.smithi089.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-06-23T18:41:54.297 INFO:teuthology.orchestra.run.smithi089.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-06-23T18:41:54.297 INFO:teuthology.orchestra.run.smithi089.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-06-23T18:41:54.297 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-06-23T18:41:54.297 INFO:teuthology.orchestra.run.smithi089.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-06-23T18:41:54.297 INFO:teuthology.orchestra.run.smithi089.stdout:Enabling module streams: 2023-06-23T18:41:54.297 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql 10 2023-06-23T18:41:54.298 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:41:54.298 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-06-23T18:41:54.298 INFO:teuthology.orchestra.run.smithi089.stdout:==================================================================================================== 2023-06-23T18:41:54.298 INFO:teuthology.orchestra.run.smithi089.stdout:Install 128 Packages 2023-06-23T18:41:54.298 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrade 15 Packages 2023-06-23T18:41:54.298 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:41:54.299 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 212 M 2023-06-23T18:41:54.299 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-06-23T18:41:54.454 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2023-06-23T18:41:54.468 INFO:teuthology.orchestra.run.smithi052.stdout:==================================================================================================== 2023-06-23T18:41:54.469 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2023-06-23T18:41:54.469 INFO:teuthology.orchestra.run.smithi052.stdout:==================================================================================================== 2023-06-23T18:41:54.469 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2023-06-23T18:41:54.469 INFO:teuthology.orchestra.run.smithi052.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-06-23T18:41:54.469 INFO:teuthology.orchestra.run.smithi052.stdout: ceph x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 6.4 k 2023-06-23T18:41:54.470 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 5.4 M 2023-06-23T18:41:54.470 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 848 k 2023-06-23T18:41:54.470 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 165 k 2023-06-23T18:41:54.470 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 1.5 M 2023-06-23T18:41:54.470 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 128 k 2023-06-23T18:41:54.470 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 1.7 M 2023-06-23T18:41:54.470 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 7.4 M 2023-06-23T18:41:54.471 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 47 k 2023-06-23T18:41:54.471 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 13 M 2023-06-23T18:41:54.471 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 48 M 2023-06-23T18:41:54.471 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 258 k 2023-06-23T18:41:54.471 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 161 k 2023-06-23T18:41:54.471 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-mirror x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 258 k 2023-06-23T18:41:54.471 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-top noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 18 k 2023-06-23T18:41:54.471 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-06-23T18:41:54.472 INFO:teuthology.orchestra.run.smithi052.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-06-23T18:41:54.472 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-06-23T18:41:54.472 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 31 k 2023-06-23T18:41:54.472 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2 x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 771 k 2023-06-23T18:41:54.472 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 139 k 2023-06-23T18:41:54.472 INFO:teuthology.orchestra.run.smithi052.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-06-23T18:41:54.472 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-06-23T18:41:54.473 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-06-23T18:41:54.473 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-06-23T18:41:54.473 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-06-23T18:41:54.473 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-06-23T18:41:54.473 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 197 k 2023-06-23T18:41:54.473 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 370 k 2023-06-23T18:41:54.473 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 365 k 2023-06-23T18:41:54.474 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 107 k 2023-06-23T18:41:54.474 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 94 k 2023-06-23T18:41:54.474 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 3.4 M 2023-06-23T18:41:54.474 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 179 k 2023-06-23T18:41:54.474 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-06-23T18:41:54.474 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrading: 2023-06-23T18:41:54.474 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-7.el8 baseos 143 k 2023-06-23T18:41:54.474 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-06-23T18:41:54.475 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-06-23T18:41:54.475 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-06-23T18:41:54.475 INFO:teuthology.orchestra.run.smithi052.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-06-23T18:41:54.475 INFO:teuthology.orchestra.run.smithi052.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-06-23T18:41:54.475 INFO:teuthology.orchestra.run.smithi052.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-06-23T18:41:54.475 INFO:teuthology.orchestra.run.smithi052.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-06-23T18:41:54.475 INFO:teuthology.orchestra.run.smithi052.stdout: librados2 x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 3.7 M 2023-06-23T18:41:54.475 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1 x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 3.6 M 2023-06-23T18:41:54.476 INFO:teuthology.orchestra.run.smithi052.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-06-23T18:41:54.476 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-06-23T18:41:54.476 INFO:teuthology.orchestra.run.smithi052.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-06-23T18:41:54.476 INFO:teuthology.orchestra.run.smithi052.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-06-23T18:41:54.476 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-06-23T18:41:54.476 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2023-06-23T18:41:54.476 INFO:teuthology.orchestra.run.smithi052.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-06-23T18:41:54.477 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 22 M 2023-06-23T18:41:54.477 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 23 k 2023-06-23T18:41:54.477 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 2.3 M 2023-06-23T18:41:54.477 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 240 k 2023-06-23T18:41:54.477 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 4.6 M 2023-06-23T18:41:54.477 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 18 M 2023-06-23T18:41:54.477 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 15 k 2023-06-23T18:41:54.478 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 24 k 2023-06-23T18:41:54.478 INFO:teuthology.orchestra.run.smithi052.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-06-23T18:41:54.478 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-06-23T18:41:54.478 INFO:teuthology.orchestra.run.smithi052.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-06-23T18:41:54.478 INFO:teuthology.orchestra.run.smithi052.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-06-23T18:41:54.478 INFO:teuthology.orchestra.run.smithi052.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-06-23T18:41:54.478 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 137 k 2023-06-23T18:41:54.478 INFO:teuthology.orchestra.run.smithi052.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-06-23T18:41:54.479 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran x86_64 8.5.0-19.el8 baseos 645 k 2023-06-23T18:41:54.479 INFO:teuthology.orchestra.run.smithi052.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-06-23T18:41:54.479 INFO:teuthology.orchestra.run.smithi052.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-06-23T18:41:54.479 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath x86_64 8.5.0-19.el8 baseos 172 k 2023-06-23T18:41:54.479 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq x86_64 0.9.0-3.el8 baseos 47 k 2023-06-23T18:41:54.479 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1 x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 474 k 2023-06-23T18:41:54.479 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-06-23T18:41:54.480 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2 x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 6.7 M 2023-06-23T18:41:54.480 INFO:teuthology.orchestra.run.smithi052.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-06-23T18:41:54.480 INFO:teuthology.orchestra.run.smithi052.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-06-23T18:41:54.480 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-06-23T18:41:54.480 INFO:teuthology.orchestra.run.smithi052.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-06-23T18:41:54.480 INFO:teuthology.orchestra.run.smithi052.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-06-23T18:41:54.480 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-06-23T18:41:54.480 INFO:teuthology.orchestra.run.smithi052.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-06-23T18:41:54.481 INFO:teuthology.orchestra.run.smithi052.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-06-23T18:41:54.481 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-06-23T18:41:54.481 INFO:teuthology.orchestra.run.smithi052.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-06-23T18:41:54.481 INFO:teuthology.orchestra.run.smithi052.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-06-23T18:41:54.481 INFO:teuthology.orchestra.run.smithi052.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-06-23T18:41:54.481 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-06-23T18:41:54.481 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-06-23T18:41:54.482 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-06-23T18:41:54.482 INFO:teuthology.orchestra.run.smithi052.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-06-23T18:41:54.482 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-06-23T18:41:54.482 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 45 k 2023-06-23T18:41:54.482 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 119 k 2023-06-23T18:41:54.482 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-06-23T18:41:54.482 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-06-23T18:41:54.482 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-06-23T18:41:54.483 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-06-23T18:41:54.483 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-06-23T18:41:54.483 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-06-23T18:41:54.483 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-06-23T18:41:54.483 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-06-23T18:41:54.483 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-06-23T18:41:54.483 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-06-23T18:41:54.483 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-06-23T18:41:54.484 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-06-23T18:41:54.484 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-06-23T18:41:54.484 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-06-23T18:41:54.484 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-06-23T18:41:54.484 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-06-23T18:41:54.484 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-06-23T18:41:54.484 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-06-23T18:41:54.485 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-06-23T18:41:54.485 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-06-23T18:41:54.485 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-06-23T18:41:54.485 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-06-23T18:41:54.485 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-06-23T18:41:54.485 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-06-23T18:41:54.485 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-06-23T18:41:54.485 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-06-23T18:41:54.486 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-06-23T18:41:54.486 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-06-23T18:41:54.486 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-06-23T18:41:54.486 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-06-23T18:41:54.486 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-06-23T18:41:54.486 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-06-23T18:41:54.486 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-06-23T18:41:54.486 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-06-23T18:41:54.487 INFO:teuthology.orchestra.run.smithi052.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-06-23T18:41:54.487 INFO:teuthology.orchestra.run.smithi052.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-06-23T18:41:54.487 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-06-23T18:41:54.487 INFO:teuthology.orchestra.run.smithi052.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-06-23T18:41:54.487 INFO:teuthology.orchestra.run.smithi052.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-06-23T18:41:54.487 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-06-23T18:41:54.487 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-06-23T18:41:54.487 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-06-23T18:41:54.488 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-06-23T18:41:54.488 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-06-23T18:41:54.488 INFO:teuthology.orchestra.run.smithi052.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-06-23T18:41:54.488 INFO:teuthology.orchestra.run.smithi052.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-06-23T18:41:54.488 INFO:teuthology.orchestra.run.smithi052.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-06-23T18:41:54.488 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-06-23T18:41:54.488 INFO:teuthology.orchestra.run.smithi052.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-06-23T18:41:54.489 INFO:teuthology.orchestra.run.smithi052.stdout:Enabling module streams: 2023-06-23T18:41:54.489 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql 10 2023-06-23T18:41:54.489 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:41:54.489 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2023-06-23T18:41:54.489 INFO:teuthology.orchestra.run.smithi052.stdout:==================================================================================================== 2023-06-23T18:41:54.489 INFO:teuthology.orchestra.run.smithi052.stdout:Install 128 Packages 2023-06-23T18:41:54.489 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrade 15 Packages 2023-06-23T18:41:54.489 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:41:54.490 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 212 M 2023-06-23T18:41:54.490 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2023-06-23T18:41:54.926 INFO:teuthology.orchestra.run.smithi089.stdout:(1/143): ceph-18.0.0-4479.g8627af3e.el8.x86_64. 19 kB/s | 6.4 kB 00:00 2023-06-23T18:41:55.212 INFO:teuthology.orchestra.run.smithi052.stdout:(1/143): ceph-18.0.0-4479.g8627af3e.el8.x86_64. 20 kB/s | 6.4 kB 00:00 2023-06-23T18:41:55.385 INFO:teuthology.orchestra.run.smithi089.stdout:(2/143): ceph-fuse-18.0.0-4479.g8627af3e.el8.x8 1.8 MB/s | 848 kB 00:00 2023-06-23T18:41:55.469 INFO:teuthology.orchestra.run.smithi089.stdout:(3/143): ceph-immutable-object-cache-18.0.0-447 1.9 MB/s | 165 kB 00:00 2023-06-23T18:41:55.493 INFO:teuthology.orchestra.run.smithi158.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-23T18:41:55.494 INFO:teuthology.orchestra.run.smithi158.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-23T18:41:55.507 INFO:teuthology.orchestra.run.smithi158.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-06-23T18:41:55.507 INFO:teuthology.orchestra.run.smithi158.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-06-23T18:41:55.508 INFO:teuthology.orchestra.run.smithi158.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-06-23T18:41:55.509 INFO:teuthology.orchestra.run.smithi158.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-06-23T18:41:55.510 INFO:teuthology.orchestra.run.smithi158.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-06-23T18:41:55.512 INFO:teuthology.orchestra.run.smithi158.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-06-23T18:41:55.514 INFO:teuthology.orchestra.run.smithi158.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-06-23T18:41:55.515 INFO:teuthology.orchestra.run.smithi158.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-06-23T18:41:55.698 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-06-23T18:41:55.712 INFO:teuthology.orchestra.run.smithi158.stdout:==================================================================================================== 2023-06-23T18:41:55.712 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repository Size 2023-06-23T18:41:55.712 INFO:teuthology.orchestra.run.smithi158.stdout:==================================================================================================== 2023-06-23T18:41:55.713 INFO:teuthology.orchestra.run.smithi158.stdout:Installing: 2023-06-23T18:41:55.713 INFO:teuthology.orchestra.run.smithi158.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-06-23T18:41:55.713 INFO:teuthology.orchestra.run.smithi158.stdout: ceph x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 6.4 k 2023-06-23T18:41:55.713 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-base x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 5.4 M 2023-06-23T18:41:55.713 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-fuse x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 848 k 2023-06-23T18:41:55.713 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 165 k 2023-06-23T18:41:55.713 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 1.5 M 2023-06-23T18:41:55.713 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 128 k 2023-06-23T18:41:55.714 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 1.7 M 2023-06-23T18:41:55.714 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 7.4 M 2023-06-23T18:41:55.714 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-rook noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 47 k 2023-06-23T18:41:55.714 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-radosgw x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 13 M 2023-06-23T18:41:55.714 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-test x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 48 M 2023-06-23T18:41:55.714 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-volume noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 258 k 2023-06-23T18:41:55.714 INFO:teuthology.orchestra.run.smithi158.stdout: cephadm noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 161 k 2023-06-23T18:41:55.715 INFO:teuthology.orchestra.run.smithi158.stdout: cephfs-mirror x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 258 k 2023-06-23T18:41:55.715 INFO:teuthology.orchestra.run.smithi158.stdout: cephfs-top noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 18 k 2023-06-23T18:41:55.715 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-06-23T18:41:55.715 INFO:teuthology.orchestra.run.smithi158.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-06-23T18:41:55.715 INFO:teuthology.orchestra.run.smithi158.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-06-23T18:41:55.715 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs-devel x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 31 k 2023-06-23T18:41:55.715 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs2 x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 771 k 2023-06-23T18:41:55.715 INFO:teuthology.orchestra.run.smithi158.stdout: librados-devel x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 139 k 2023-06-23T18:41:55.716 INFO:teuthology.orchestra.run.smithi158.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-06-23T18:41:55.716 INFO:teuthology.orchestra.run.smithi158.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-06-23T18:41:55.716 INFO:teuthology.orchestra.run.smithi158.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-06-23T18:41:55.716 INFO:teuthology.orchestra.run.smithi158.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-06-23T18:41:55.716 INFO:teuthology.orchestra.run.smithi158.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-06-23T18:41:55.716 INFO:teuthology.orchestra.run.smithi158.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-06-23T18:41:55.717 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cephfs x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 197 k 2023-06-23T18:41:55.717 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rados x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 370 k 2023-06-23T18:41:55.717 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rbd x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 365 k 2023-06-23T18:41:55.717 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rgw x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 107 k 2023-06-23T18:41:55.718 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-fuse x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 94 k 2023-06-23T18:41:55.718 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-mirror x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 3.4 M 2023-06-23T18:41:55.718 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-nbd x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 179 k 2023-06-23T18:41:55.718 INFO:teuthology.orchestra.run.smithi158.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-06-23T18:41:55.718 INFO:teuthology.orchestra.run.smithi158.stdout:Upgrading: 2023-06-23T18:41:55.718 INFO:teuthology.orchestra.run.smithi158.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-7.el8 baseos 143 k 2023-06-23T18:41:55.719 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-06-23T18:41:55.719 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-06-23T18:41:55.719 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-06-23T18:41:55.719 INFO:teuthology.orchestra.run.smithi158.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-06-23T18:41:55.719 INFO:teuthology.orchestra.run.smithi158.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-06-23T18:41:55.719 INFO:teuthology.orchestra.run.smithi158.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-06-23T18:41:55.719 INFO:teuthology.orchestra.run.smithi158.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-06-23T18:41:55.719 INFO:teuthology.orchestra.run.smithi158.stdout: librados2 x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 3.7 M 2023-06-23T18:41:55.720 INFO:teuthology.orchestra.run.smithi158.stdout: librbd1 x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 3.6 M 2023-06-23T18:41:55.720 INFO:teuthology.orchestra.run.smithi158.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-06-23T18:41:55.720 INFO:teuthology.orchestra.run.smithi158.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-06-23T18:41:55.720 INFO:teuthology.orchestra.run.smithi158.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-06-23T18:41:55.720 INFO:teuthology.orchestra.run.smithi158.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-06-23T18:41:55.720 INFO:teuthology.orchestra.run.smithi158.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-06-23T18:41:55.720 INFO:teuthology.orchestra.run.smithi158.stdout:Installing dependencies: 2023-06-23T18:41:55.721 INFO:teuthology.orchestra.run.smithi158.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-06-23T18:41:55.721 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-common x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 22 M 2023-06-23T18:41:55.721 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 23 k 2023-06-23T18:41:55.721 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mds x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 2.3 M 2023-06-23T18:41:55.721 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 240 k 2023-06-23T18:41:55.721 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mon x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 4.6 M 2023-06-23T18:41:55.721 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-osd x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 18 M 2023-06-23T18:41:55.721 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4479.g8627af3e.el8 ceph-noarch 15 k 2023-06-23T18:41:55.722 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-selinux x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 24 k 2023-06-23T18:41:55.722 INFO:teuthology.orchestra.run.smithi158.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-06-23T18:41:55.722 INFO:teuthology.orchestra.run.smithi158.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-06-23T18:41:55.722 INFO:teuthology.orchestra.run.smithi158.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-06-23T18:41:55.722 INFO:teuthology.orchestra.run.smithi158.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-06-23T18:41:55.722 INFO:teuthology.orchestra.run.smithi158.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-06-23T18:41:55.722 INFO:teuthology.orchestra.run.smithi158.stdout: libcephsqlite x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 137 k 2023-06-23T18:41:55.723 INFO:teuthology.orchestra.run.smithi158.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-06-23T18:41:55.723 INFO:teuthology.orchestra.run.smithi158.stdout: libgfortran x86_64 8.5.0-19.el8 baseos 645 k 2023-06-23T18:41:55.723 INFO:teuthology.orchestra.run.smithi158.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-06-23T18:41:55.723 INFO:teuthology.orchestra.run.smithi158.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-06-23T18:41:55.723 INFO:teuthology.orchestra.run.smithi158.stdout: libquadmath x86_64 8.5.0-19.el8 baseos 172 k 2023-06-23T18:41:55.723 INFO:teuthology.orchestra.run.smithi158.stdout: librabbitmq x86_64 0.9.0-3.el8 baseos 47 k 2023-06-23T18:41:55.723 INFO:teuthology.orchestra.run.smithi158.stdout: libradosstriper1 x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 474 k 2023-06-23T18:41:55.723 INFO:teuthology.orchestra.run.smithi158.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-06-23T18:41:55.724 INFO:teuthology.orchestra.run.smithi158.stdout: librgw2 x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 6.7 M 2023-06-23T18:41:55.724 INFO:teuthology.orchestra.run.smithi158.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-06-23T18:41:55.724 INFO:teuthology.orchestra.run.smithi158.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-06-23T18:41:55.724 INFO:teuthology.orchestra.run.smithi158.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-06-23T18:41:55.724 INFO:teuthology.orchestra.run.smithi158.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-06-23T18:41:55.724 INFO:teuthology.orchestra.run.smithi158.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-06-23T18:41:55.724 INFO:teuthology.orchestra.run.smithi158.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-06-23T18:41:55.725 INFO:teuthology.orchestra.run.smithi158.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-06-23T18:41:55.725 INFO:teuthology.orchestra.run.smithi158.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-06-23T18:41:55.725 INFO:teuthology.orchestra.run.smithi158.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-06-23T18:41:55.725 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-06-23T18:41:55.725 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-06-23T18:41:55.725 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-06-23T18:41:55.725 INFO:teuthology.orchestra.run.smithi158.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-06-23T18:41:55.726 INFO:teuthology.orchestra.run.smithi158.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-06-23T18:41:55.726 INFO:teuthology.orchestra.run.smithi158.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-06-23T18:41:55.726 INFO:teuthology.orchestra.run.smithi158.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-06-23T18:41:55.726 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-06-23T18:41:55.726 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-argparse x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 45 k 2023-06-23T18:41:55.726 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-common x86_64 2:18.0.0-4479.g8627af3e.el8 ceph 119 k 2023-06-23T18:41:55.726 INFO:teuthology.orchestra.run.smithi158.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-06-23T18:41:55.726 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-06-23T18:41:55.727 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-06-23T18:41:55.727 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-06-23T18:41:55.727 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-06-23T18:41:55.727 INFO:teuthology.orchestra.run.smithi158.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-06-23T18:41:55.727 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-06-23T18:41:55.727 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-06-23T18:41:55.727 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-06-23T18:41:55.727 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-06-23T18:41:55.728 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-06-23T18:41:55.728 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-06-23T18:41:55.728 INFO:teuthology.orchestra.run.smithi158.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-06-23T18:41:55.728 INFO:teuthology.orchestra.run.smithi158.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-06-23T18:41:55.728 INFO:teuthology.orchestra.run.smithi158.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-06-23T18:41:55.729 INFO:teuthology.orchestra.run.smithi158.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-06-23T18:41:55.729 INFO:teuthology.orchestra.run.smithi158.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-06-23T18:41:55.729 INFO:teuthology.orchestra.run.smithi158.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-06-23T18:41:55.729 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-06-23T18:41:55.730 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-06-23T18:41:55.730 INFO:teuthology.orchestra.run.smithi158.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-06-23T18:41:55.730 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-06-23T18:41:55.730 INFO:teuthology.orchestra.run.smithi158.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-06-23T18:41:55.730 INFO:teuthology.orchestra.run.smithi158.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-06-23T18:41:55.730 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-06-23T18:41:55.731 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-06-23T18:41:55.731 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-06-23T18:41:55.731 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-06-23T18:41:55.731 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-06-23T18:41:55.731 INFO:teuthology.orchestra.run.smithi158.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-06-23T18:41:55.731 INFO:teuthology.orchestra.run.smithi158.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-06-23T18:41:55.731 INFO:teuthology.orchestra.run.smithi158.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-06-23T18:41:55.731 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-06-23T18:41:55.732 INFO:teuthology.orchestra.run.smithi158.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-06-23T18:41:55.732 INFO:teuthology.orchestra.run.smithi158.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-06-23T18:41:55.732 INFO:teuthology.orchestra.run.smithi158.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-06-23T18:41:55.732 INFO:teuthology.orchestra.run.smithi158.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-06-23T18:41:55.732 INFO:teuthology.orchestra.run.smithi158.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-06-23T18:41:55.733 INFO:teuthology.orchestra.run.smithi158.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-06-23T18:41:55.733 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-06-23T18:41:55.733 INFO:teuthology.orchestra.run.smithi158.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-06-23T18:41:55.733 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-06-23T18:41:55.733 INFO:teuthology.orchestra.run.smithi158.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-06-23T18:41:55.733 INFO:teuthology.orchestra.run.smithi158.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-06-23T18:41:55.733 INFO:teuthology.orchestra.run.smithi158.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-06-23T18:41:55.734 INFO:teuthology.orchestra.run.smithi158.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-06-23T18:41:55.734 INFO:teuthology.orchestra.run.smithi158.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-06-23T18:41:55.734 INFO:teuthology.orchestra.run.smithi158.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-06-23T18:41:55.734 INFO:teuthology.orchestra.run.smithi158.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-06-23T18:41:55.734 INFO:teuthology.orchestra.run.smithi158.stdout:Enabling module streams: 2023-06-23T18:41:55.734 INFO:teuthology.orchestra.run.smithi158.stdout: postgresql 10 2023-06-23T18:41:55.734 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:41:55.734 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-06-23T18:41:55.735 INFO:teuthology.orchestra.run.smithi158.stdout:==================================================================================================== 2023-06-23T18:41:55.735 INFO:teuthology.orchestra.run.smithi158.stdout:Install 128 Packages 2023-06-23T18:41:55.735 INFO:teuthology.orchestra.run.smithi158.stdout:Upgrade 15 Packages 2023-06-23T18:41:55.735 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:41:55.736 INFO:teuthology.orchestra.run.smithi089.stdout:(4/143): ceph-base-18.0.0-4479.g8627af3e.el8.x8 4.7 MB/s | 5.4 MB 00:01 2023-06-23T18:41:55.736 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 212 M 2023-06-23T18:41:55.736 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2023-06-23T18:41:55.969 INFO:teuthology.orchestra.run.smithi089.stdout:(5/143): ceph-mds-18.0.0-4479.g8627af3e.el8.x86 4.6 MB/s | 2.3 MB 00:00 2023-06-23T18:41:55.986 INFO:teuthology.orchestra.run.smithi052.stdout:(2/143): ceph-fuse-18.0.0-4479.g8627af3e.el8.x8 1.1 MB/s | 848 kB 00:00 2023-06-23T18:41:56.011 INFO:teuthology.orchestra.run.smithi089.stdout:(6/143): ceph-mgr-18.0.0-4479.g8627af3e.el8.x86 5.5 MB/s | 1.5 MB 00:00 2023-06-23T18:41:56.095 INFO:teuthology.orchestra.run.smithi052.stdout:(3/143): ceph-immutable-object-cache-18.0.0-447 1.5 MB/s | 165 kB 00:00 2023-06-23T18:41:56.646 INFO:teuthology.orchestra.run.smithi158.stdout:(1/143): ceph-18.0.0-4479.g8627af3e.el8.x86_64. 22 kB/s | 6.4 kB 00:00 2023-06-23T18:41:56.753 INFO:teuthology.orchestra.run.smithi089.stdout:(7/143): ceph-mon-18.0.0-4479.g8627af3e.el8.x86 5.9 MB/s | 4.6 MB 00:00 2023-06-23T18:41:57.112 INFO:teuthology.orchestra.run.smithi052.stdout:(4/143): ceph-mds-18.0.0-4479.g8627af3e.el8.x86 2.2 MB/s | 2.3 MB 00:01 2023-06-23T18:41:57.238 INFO:teuthology.orchestra.run.smithi158.stdout:(2/143): ceph-fuse-18.0.0-4479.g8627af3e.el8.x8 1.4 MB/s | 848 kB 00:00 2023-06-23T18:41:57.295 INFO:teuthology.orchestra.run.smithi089.stdout:(8/143): ceph-common-18.0.0-4479.g8627af3e.el8. 8.2 MB/s | 22 MB 00:02 2023-06-23T18:41:57.339 INFO:teuthology.orchestra.run.smithi158.stdout:(3/143): ceph-immutable-object-cache-18.0.0-447 1.6 MB/s | 165 kB 00:00 2023-06-23T18:41:57.379 INFO:teuthology.orchestra.run.smithi089.stdout:(9/143): ceph-selinux-18.0.0-4479.g8627af3e.el8 292 kB/s | 24 kB 00:00 2023-06-23T18:41:57.618 INFO:teuthology.orchestra.run.smithi052.stdout:(5/143): ceph-mgr-18.0.0-4479.g8627af3e.el8.x86 3.1 MB/s | 1.5 MB 00:00 2023-06-23T18:41:58.288 INFO:teuthology.orchestra.run.smithi052.stdout:(6/143): ceph-base-18.0.0-4479.g8627af3e.el8.x8 1.6 MB/s | 5.4 MB 00:03 2023-06-23T18:41:58.372 INFO:teuthology.orchestra.run.smithi158.stdout:(4/143): ceph-base-18.0.0-4479.g8627af3e.el8.x8 2.7 MB/s | 5.4 MB 00:02 2023-06-23T18:41:58.964 INFO:teuthology.orchestra.run.smithi158.stdout:(5/143): ceph-mds-18.0.0-4479.g8627af3e.el8.x86 1.4 MB/s | 2.3 MB 00:01 2023-06-23T18:41:58.998 INFO:teuthology.orchestra.run.smithi158.stdout:(6/143): ceph-mgr-18.0.0-4479.g8627af3e.el8.x86 2.5 MB/s | 1.5 MB 00:00 2023-06-23T18:41:59.270 INFO:teuthology.orchestra.run.smithi089.stdout:(10/143): ceph-radosgw-18.0.0-4479.g8627af3e.el 5.4 MB/s | 13 MB 00:02 2023-06-23T18:41:59.370 INFO:teuthology.orchestra.run.smithi089.stdout:(11/143): cephfs-mirror-18.0.0-4479.g8627af3e.e 2.5 MB/s | 258 kB 00:00 2023-06-23T18:41:59.429 INFO:teuthology.orchestra.run.smithi052.stdout:(7/143): ceph-mon-18.0.0-4479.g8627af3e.el8.x86 2.5 MB/s | 4.6 MB 00:01 2023-06-23T18:41:59.454 INFO:teuthology.orchestra.run.smithi089.stdout:(12/143): libcephfs-devel-18.0.0-4479.g8627af3e 373 kB/s | 31 kB 00:00 2023-06-23T18:41:59.779 INFO:teuthology.orchestra.run.smithi089.stdout:(13/143): libcephfs2-18.0.0-4479.g8627af3e.el8. 2.3 MB/s | 771 kB 00:00 2023-06-23T18:41:59.902 INFO:teuthology.orchestra.run.smithi089.stdout:(14/143): libcephsqlite-18.0.0-4479.g8627af3e.e 1.1 MB/s | 137 kB 00:00 2023-06-23T18:41:59.997 INFO:teuthology.orchestra.run.smithi089.stdout:(15/143): librados-devel-18.0.0-4479.g8627af3e. 1.4 MB/s | 139 kB 00:00 2023-06-23T18:42:00.172 INFO:teuthology.orchestra.run.smithi089.stdout:(16/143): libradosstriper1-18.0.0-4479.g8627af3 2.6 MB/s | 474 kB 00:00 2023-06-23T18:42:00.772 INFO:teuthology.orchestra.run.smithi089.stdout:(17/143): ceph-osd-18.0.0-4479.g8627af3e.el8.x8 3.7 MB/s | 18 MB 00:04 2023-06-23T18:42:00.831 INFO:teuthology.orchestra.run.smithi089.stdout:(18/143): python3-ceph-argparse-18.0.0-4479.g86 773 kB/s | 45 kB 00:00 2023-06-23T18:42:00.897 INFO:teuthology.orchestra.run.smithi089.stdout:(19/143): python3-ceph-common-18.0.0-4479.g8627 1.7 MB/s | 119 kB 00:00 2023-06-23T18:42:00.954 INFO:teuthology.orchestra.run.smithi052.stdout:(8/143): ceph-common-18.0.0-4479.g8627af3e.el8. 3.6 MB/s | 22 MB 00:06 2023-06-23T18:42:00.964 INFO:teuthology.orchestra.run.smithi089.stdout:(20/143): python3-cephfs-18.0.0-4479.g8627af3e. 2.9 MB/s | 197 kB 00:00 2023-06-23T18:42:01.046 INFO:teuthology.orchestra.run.smithi052.stdout:(9/143): ceph-selinux-18.0.0-4479.g8627af3e.el8 266 kB/s | 24 kB 00:00 2023-06-23T18:42:01.106 INFO:teuthology.orchestra.run.smithi089.stdout:(21/143): python3-rados-18.0.0-4479.g8627af3e.e 2.6 MB/s | 370 kB 00:00 2023-06-23T18:42:01.214 INFO:teuthology.orchestra.run.smithi158.stdout:(7/143): ceph-mon-18.0.0-4479.g8627af3e.el8.x86 2.1 MB/s | 4.6 MB 00:02 2023-06-23T18:42:01.248 INFO:teuthology.orchestra.run.smithi089.stdout:(22/143): python3-rbd-18.0.0-4479.g8627af3e.el8 2.5 MB/s | 365 kB 00:00 2023-06-23T18:42:01.366 INFO:teuthology.orchestra.run.smithi089.stdout:(23/143): python3-rgw-18.0.0-4479.g8627af3e.el8 908 kB/s | 107 kB 00:00 2023-06-23T18:42:01.474 INFO:teuthology.orchestra.run.smithi089.stdout:(24/143): rbd-fuse-18.0.0-4479.g8627af3e.el8.x8 878 kB/s | 94 kB 00:00 2023-06-23T18:42:01.991 INFO:teuthology.orchestra.run.smithi089.stdout:(25/143): librgw2-18.0.0-4479.g8627af3e.el8.x86 3.7 MB/s | 6.7 MB 00:01 2023-06-23T18:42:02.066 INFO:teuthology.orchestra.run.smithi089.stdout:(26/143): rbd-nbd-18.0.0-4479.g8627af3e.el8.x86 2.3 MB/s | 179 kB 00:00 2023-06-23T18:42:02.158 INFO:teuthology.orchestra.run.smithi089.stdout:(27/143): ceph-grafana-dashboards-18.0.0-4479.g 251 kB/s | 23 kB 00:00 2023-06-23T18:42:02.242 INFO:teuthology.orchestra.run.smithi089.stdout:(28/143): ceph-mgr-cephadm-18.0.0-4479.g8627af3 1.5 MB/s | 128 kB 00:00 2023-06-23T18:42:02.725 INFO:teuthology.orchestra.run.smithi089.stdout:(29/143): ceph-mgr-dashboard-18.0.0-4479.g8627a 3.5 MB/s | 1.7 MB 00:00 2023-06-23T18:42:02.784 INFO:teuthology.orchestra.run.smithi089.stdout:(30/143): rbd-mirror-18.0.0-4479.g8627af3e.el8. 2.6 MB/s | 3.4 MB 00:01 2023-06-23T18:42:02.918 INFO:teuthology.orchestra.run.smithi089.stdout:(31/143): ceph-mgr-modules-core-18.0.0-4479.g86 1.8 MB/s | 240 kB 00:00 2023-06-23T18:42:02.985 INFO:teuthology.orchestra.run.smithi089.stdout:(32/143): ceph-mgr-rook-18.0.0-4479.g8627af3e.e 712 kB/s | 47 kB 00:00 2023-06-23T18:42:03.014 INFO:teuthology.orchestra.run.smithi158.stdout:(8/143): ceph-osd-18.0.0-4479.g8627af3e.el8.x86 4.4 MB/s | 18 MB 00:04 2023-06-23T18:42:03.052 INFO:teuthology.orchestra.run.smithi089.stdout:(33/143): ceph-prometheus-alerts-18.0.0-4479.g8 219 kB/s | 15 kB 00:00 2023-06-23T18:42:03.098 INFO:teuthology.orchestra.run.smithi158.stdout:(9/143): ceph-selinux-18.0.0-4479.g8627af3e.el8 294 kB/s | 24 kB 00:00 2023-06-23T18:42:03.219 INFO:teuthology.orchestra.run.smithi089.stdout:(34/143): ceph-volume-18.0.0-4479.g8627af3e.el8 1.5 MB/s | 258 kB 00:00 2023-06-23T18:42:03.302 INFO:teuthology.orchestra.run.smithi089.stdout:(35/143): cephadm-18.0.0-4479.g8627af3e.el8.noa 1.9 MB/s | 161 kB 00:00 2023-06-23T18:42:03.378 INFO:teuthology.orchestra.run.smithi089.stdout:(36/143): cephfs-top-18.0.0-4479.g8627af3e.el8. 240 kB/s | 18 kB 00:00 2023-06-23T18:42:03.413 INFO:teuthology.orchestra.run.smithi052.stdout:(10/143): ceph-radosgw-18.0.0-4479.g8627af3e.el 3.4 MB/s | 13 MB 00:03 2023-06-23T18:42:03.563 INFO:teuthology.orchestra.run.smithi052.stdout:(11/143): cephfs-mirror-18.0.0-4479.g8627af3e.e 1.7 MB/s | 258 kB 00:00 2023-06-23T18:42:03.639 INFO:teuthology.orchestra.run.smithi052.stdout:(12/143): libcephfs-devel-18.0.0-4479.g8627af3e 414 kB/s | 31 kB 00:00 2023-06-23T18:42:03.761 INFO:teuthology.orchestra.run.smithi089.stdout:(37/143): automake-1.16.1-7.el8.noarch.rpm 1.8 MB/s | 713 kB 00:00 2023-06-23T18:42:03.914 INFO:teuthology.orchestra.run.smithi052.stdout:(13/143): libcephfs2-18.0.0-4479.g8627af3e.el8. 2.7 MB/s | 771 kB 00:00 2023-06-23T18:42:03.962 INFO:teuthology.orchestra.run.smithi089.stdout:(38/143): bison-3.0.4-10.el8.x86_64.rpm 3.4 MB/s | 688 kB 00:00 2023-06-23T18:42:03.998 INFO:teuthology.orchestra.run.smithi052.stdout:(14/143): libcephsqlite-18.0.0-4479.g8627af3e.e 1.6 MB/s | 137 kB 00:00 2023-06-23T18:42:04.081 INFO:teuthology.orchestra.run.smithi052.stdout:(15/143): librados-devel-18.0.0-4479.g8627af3e. 1.6 MB/s | 139 kB 00:00 2023-06-23T18:42:04.095 INFO:teuthology.orchestra.run.smithi089.stdout:(39/143): flex-2.6.1-9.el8.x86_64.rpm 2.3 MB/s | 320 kB 00:00 2023-06-23T18:42:04.229 INFO:teuthology.orchestra.run.smithi089.stdout:(40/143): jq-1.6-7.el8.x86_64.rpm 1.5 MB/s | 202 kB 00:00 2023-06-23T18:42:04.281 INFO:teuthology.orchestra.run.smithi052.stdout:(16/143): libradosstriper1-18.0.0-4479.g8627af3 2.3 MB/s | 474 kB 00:00 2023-06-23T18:42:04.346 INFO:teuthology.orchestra.run.smithi089.stdout:(41/143): ceph-mgr-diskprediction-local-18.0.0- 4.6 MB/s | 7.4 MB 00:01 2023-06-23T18:42:04.371 INFO:teuthology.orchestra.run.smithi089.stdout:(42/143): libpq-13.5-1.el8.x86_64.rpm 1.4 MB/s | 198 kB 00:00 2023-06-23T18:42:04.555 INFO:teuthology.orchestra.run.smithi089.stdout:(43/143): libtool-2.4.6-25.el8.x86_64.rpm 3.8 MB/s | 709 kB 00:00 2023-06-23T18:42:04.588 INFO:teuthology.orchestra.run.smithi089.stdout:(44/143): librdkafka-0.11.4-3.el8.x86_64.rpm 1.4 MB/s | 354 kB 00:00 2023-06-23T18:42:04.705 INFO:teuthology.orchestra.run.smithi089.stdout:(45/143): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.7 MB/s | 259 kB 00:00 2023-06-23T18:42:04.739 INFO:teuthology.orchestra.run.smithi089.stdout:(46/143): oniguruma-6.8.2-2.el8.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2023-06-23T18:42:05.148 INFO:teuthology.orchestra.run.smithi089.stdout:(47/143): openblas-0.3.15-4.el8.x86_64.rpm 11 MB/s | 4.7 MB 00:00 2023-06-23T18:42:05.381 INFO:teuthology.orchestra.run.smithi089.stdout:(48/143): openblas-threads-0.3.15-4.el8.x86_64. 7.6 MB/s | 4.9 MB 00:00 2023-06-23T18:42:05.448 INFO:teuthology.orchestra.run.smithi089.stdout:(49/143): postgresql-10.23-1.module_el8+300+2c5 5.2 MB/s | 1.6 MB 00:00 2023-06-23T18:42:05.548 INFO:teuthology.orchestra.run.smithi089.stdout:(50/143): postgresql-contrib-10.23-1.module_el8 5.3 MB/s | 903 kB 00:00 2023-06-23T18:42:05.857 INFO:teuthology.orchestra.run.smithi089.stdout:(51/143): postgresql-server-10.23-1.module_el8+ 13 MB/s | 5.1 MB 00:00 2023-06-23T18:42:05.898 INFO:teuthology.orchestra.run.smithi052.stdout:(17/143): librgw2-18.0.0-4479.g8627af3e.el8.x86 4.2 MB/s | 6.7 MB 00:01 2023-06-23T18:42:05.957 INFO:teuthology.orchestra.run.smithi052.stdout:(18/143): python3-ceph-argparse-18.0.0-4479.g86 775 kB/s | 45 kB 00:00 2023-06-23T18:42:06.015 INFO:teuthology.orchestra.run.smithi052.stdout:(19/143): python3-ceph-common-18.0.0-4479.g8627 2.0 MB/s | 119 kB 00:00 2023-06-23T18:42:06.016 INFO:teuthology.orchestra.run.smithi089.stdout:(52/143): python3-babel-2.5.1-7.el8.noarch.rpm 10 MB/s | 4.8 MB 00:00 2023-06-23T18:42:06.041 INFO:teuthology.orchestra.run.smithi089.stdout:(53/143): python3-jinja2-2.10.1-3.el8.noarch.rp 2.9 MB/s | 538 kB 00:00 2023-06-23T18:42:06.100 INFO:teuthology.orchestra.run.smithi089.stdout:(54/143): python3-jsonpatch-1.21-2.el8.noarch.r 317 kB/s | 27 kB 00:00 2023-06-23T18:42:06.132 INFO:teuthology.orchestra.run.smithi052.stdout:(20/143): python3-cephfs-18.0.0-4479.g8627af3e. 1.7 MB/s | 197 kB 00:00 2023-06-23T18:42:06.146 INFO:teuthology.orchestra.run.smithi089.stdout:(55/143): python3-jsonpointer-1.10-11.el8.noarc 190 kB/s | 20 kB 00:00 2023-06-23T18:42:06.181 INFO:teuthology.orchestra.run.smithi158.stdout:(10/143): ceph-radosgw-18.0.0-4479.g8627af3e.el 2.7 MB/s | 13 MB 00:04 2023-06-23T18:42:06.224 INFO:teuthology.orchestra.run.smithi052.stdout:(21/143): python3-rados-18.0.0-4479.g8627af3e.e 4.0 MB/s | 370 kB 00:00 2023-06-23T18:42:06.233 INFO:teuthology.orchestra.run.smithi089.stdout:(56/143): python3-mako-1.0.6-14.el8.noarch.rpm 1.1 MB/s | 157 kB 00:00 2023-06-23T18:42:06.259 INFO:teuthology.orchestra.run.smithi089.stdout:(57/143): python3-markupsafe-0.23-19.el8.x86_64 345 kB/s | 39 kB 00:00 2023-06-23T18:42:06.298 INFO:teuthology.orchestra.run.smithi158.stdout:(11/143): cephfs-mirror-18.0.0-4479.g8627af3e.e 2.2 MB/s | 258 kB 00:00 2023-06-23T18:42:06.341 INFO:teuthology.orchestra.run.smithi052.stdout:(22/143): python3-rbd-18.0.0-4479.g8627af3e.el8 3.1 MB/s | 365 kB 00:00 2023-06-23T18:42:06.365 INFO:teuthology.orchestra.run.smithi158.stdout:(12/143): libcephfs-devel-18.0.0-4479.g8627af3e 465 kB/s | 31 kB 00:00 2023-06-23T18:42:06.384 INFO:teuthology.orchestra.run.smithi089.stdout:(58/143): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.8 MB/s | 225 kB 00:00 2023-06-23T18:42:06.416 INFO:teuthology.orchestra.run.smithi052.stdout:(23/143): python3-rgw-18.0.0-4479.g8627af3e.el8 1.4 MB/s | 107 kB 00:00 2023-06-23T18:42:06.500 INFO:teuthology.orchestra.run.smithi052.stdout:(24/143): rbd-fuse-18.0.0-4479.g8627af3e.el8.x8 1.1 MB/s | 94 kB 00:00 2023-06-23T18:42:06.517 INFO:teuthology.orchestra.run.smithi089.stdout:(59/143): python3-prettytable-0.7.2-14.el8.noar 331 kB/s | 44 kB 00:00 2023-06-23T18:42:06.593 INFO:teuthology.orchestra.run.smithi089.stdout:(60/143): python3-numpy-1.14.3-10.el8.x86_64.rp 10 MB/s | 3.7 MB 00:00 2023-06-23T18:42:06.598 INFO:teuthology.orchestra.run.smithi158.stdout:(13/143): libcephfs2-18.0.0-4479.g8627af3e.el8. 3.2 MB/s | 771 kB 00:00 2023-06-23T18:42:06.635 INFO:teuthology.orchestra.run.smithi089.stdout:(61/143): python3-pyOpenSSL-19.0.0-1.el8.noarch 882 kB/s | 103 kB 00:00 2023-06-23T18:42:06.682 INFO:teuthology.orchestra.run.smithi158.stdout:(14/143): libcephsqlite-18.0.0-4479.g8627af3e.e 1.6 MB/s | 137 kB 00:00 2023-06-23T18:42:06.774 INFO:teuthology.orchestra.run.smithi158.stdout:(15/143): librados-devel-18.0.0-4479.g8627af3e. 1.5 MB/s | 139 kB 00:00 2023-06-23T18:42:06.900 INFO:teuthology.orchestra.run.smithi158.stdout:(16/143): libradosstriper1-18.0.0-4479.g8627af3 3.7 MB/s | 474 kB 00:00 2023-06-23T18:42:06.902 INFO:teuthology.orchestra.run.smithi089.stdout:(62/143): python3-pyasn1-0.3.7-6.el8.noarch.rpm 409 kB/s | 126 kB 00:00 2023-06-23T18:42:06.934 INFO:teuthology.orchestra.run.smithi052.stdout:(25/143): ceph-osd-18.0.0-4479.g8627af3e.el8.x8 2.0 MB/s | 18 MB 00:08 2023-06-23T18:42:06.961 INFO:teuthology.orchestra.run.smithi089.stdout:(63/143): python3-pyasn1-modules-0.3.7-6.el8.no 398 kB/s | 110 kB 00:00 2023-06-23T18:42:07.003 INFO:teuthology.orchestra.run.smithi089.stdout:(64/143): python3-pytz-2017.2-9.el8.noarch.rpm 540 kB/s | 54 kB 00:00 2023-06-23T18:42:07.042 INFO:teuthology.orchestra.run.smithi052.stdout:(26/143): rbd-nbd-18.0.0-4479.g8627af3e.el8.x86 1.6 MB/s | 179 kB 00:00 2023-06-23T18:42:07.142 INFO:teuthology.orchestra.run.smithi052.stdout:(27/143): ceph-grafana-dashboards-18.0.0-4479.g 231 kB/s | 23 kB 00:00 2023-06-23T18:42:07.161 INFO:teuthology.orchestra.run.smithi089.stdout:(65/143): python3-werkzeug-0.12.2-4.el8.noarch. 2.8 MB/s | 457 kB 00:00 2023-06-23T18:42:07.279 INFO:teuthology.orchestra.run.smithi052.stdout:(28/143): ceph-mgr-cephadm-18.0.0-4479.g8627af3 936 kB/s | 128 kB 00:00 2023-06-23T18:42:07.329 INFO:teuthology.orchestra.run.smithi089.stdout:(66/143): socat-1.7.4.1-1.el8.x86_64.rpm 1.9 MB/s | 323 kB 00:00 2023-06-23T18:42:07.335 INFO:teuthology.orchestra.run.smithi052.stdout:(29/143): rbd-mirror-18.0.0-4479.g8627af3e.el8. 4.1 MB/s | 3.4 MB 00:00 2023-06-23T18:42:07.437 INFO:teuthology.orchestra.run.smithi089.stdout:(67/143): uuid-1.6.2-43.el8.x86_64.rpm 591 kB/s | 64 kB 00:00 2023-06-23T18:42:07.546 INFO:teuthology.orchestra.run.smithi089.stdout:(68/143): xmlstarlet-1.6.1-20.el8.x86_64.rpm 653 kB/s | 71 kB 00:00 2023-06-23T18:42:07.721 INFO:teuthology.orchestra.run.smithi089.stdout:(69/143): python3-scipy-1.0.0-21.module_el8.5.0 18 MB/s | 14 MB 00:00 2023-06-23T18:42:07.863 INFO:teuthology.orchestra.run.smithi089.stdout:(70/143): elfutils-libelf-devel-0.189-2.el8.x86 194 kB/s | 61 kB 00:00 2023-06-23T18:42:07.913 INFO:teuthology.orchestra.run.smithi089.stdout:(71/143): fuse-2.9.7-17.el8.x86_64.rpm 433 kB/s | 83 kB 00:00 2023-06-23T18:42:07.930 INFO:teuthology.orchestra.run.smithi089.stdout:(72/143): keyutils-libs-devel-1.5.10-9.el8.x86_ 720 kB/s | 48 kB 00:00 2023-06-23T18:42:07.989 INFO:teuthology.orchestra.run.smithi089.stdout:(73/143): libaio-devel-0.3.112-1.el8.x86_64.rpm 320 kB/s | 19 kB 00:00 2023-06-23T18:42:08.073 INFO:teuthology.orchestra.run.smithi089.stdout:(74/143): libcom_err-devel-1.45.6-5.el8.x86_64. 464 kB/s | 39 kB 00:00 2023-06-23T18:42:08.098 INFO:teuthology.orchestra.run.smithi089.stdout:(75/143): krb5-devel-1.18.2-22.el8.x86_64.rpm 3.0 MB/s | 561 kB 00:00 2023-06-23T18:42:08.227 INFO:teuthology.orchestra.run.smithi052.stdout:(30/143): ceph-test-18.0.0-4479.g8627af3e.el8.x 6.6 MB/s | 48 MB 00:07 2023-06-23T18:42:08.269 INFO:teuthology.orchestra.run.smithi052.stdout:(31/143): ceph-mgr-dashboard-18.0.0-4479.g8627a 1.7 MB/s | 1.7 MB 00:00 2023-06-23T18:42:08.302 INFO:teuthology.orchestra.run.smithi052.stdout:(32/143): ceph-mgr-modules-core-18.0.0-4479.g86 3.1 MB/s | 240 kB 00:00 2023-06-23T18:42:08.336 INFO:teuthology.orchestra.run.smithi052.stdout:(33/143): ceph-mgr-rook-18.0.0-4479.g8627af3e.e 711 kB/s | 47 kB 00:00 2023-06-23T18:42:08.370 INFO:teuthology.orchestra.run.smithi052.stdout:(34/143): ceph-prometheus-alerts-18.0.0-4479.g8 217 kB/s | 15 kB 00:00 2023-06-23T18:42:08.450 INFO:teuthology.orchestra.run.smithi158.stdout:(17/143): librgw2-18.0.0-4479.g8627af3e.el8.x86 4.4 MB/s | 6.7 MB 00:01 2023-06-23T18:42:08.462 INFO:teuthology.orchestra.run.smithi052.stdout:(35/143): cephadm-18.0.0-4479.g8627af3e.el8.noa 1.7 MB/s | 161 kB 00:00 2023-06-23T18:42:08.487 INFO:teuthology.orchestra.run.smithi052.stdout:(36/143): ceph-volume-18.0.0-4479.g8627af3e.el8 1.7 MB/s | 258 kB 00:00 2023-06-23T18:42:08.500 INFO:teuthology.orchestra.run.smithi158.stdout:(18/143): python3-ceph-argparse-18.0.0-4479.g86 899 kB/s | 45 kB 00:00 2023-06-23T18:42:08.529 INFO:teuthology.orchestra.run.smithi052.stdout:(37/143): cephfs-top-18.0.0-4479.g8627af3e.el8. 268 kB/s | 18 kB 00:00 2023-06-23T18:42:08.556 INFO:teuthology.orchestra.run.smithi089.stdout:(76/143): ceph-test-18.0.0-4479.g8627af3e.el8.x 4.3 MB/s | 48 MB 00:11 2023-06-23T18:42:08.582 INFO:teuthology.orchestra.run.smithi089.stdout:(77/143): libquadmath-8.5.0-19.el8.x86_64.rpm 356 kB/s | 172 kB 00:00 2023-06-23T18:42:08.600 INFO:teuthology.orchestra.run.smithi158.stdout:(19/143): python3-ceph-common-18.0.0-4479.g8627 1.2 MB/s | 119 kB 00:00 2023-06-23T18:42:08.648 INFO:teuthology.orchestra.run.smithi089.stdout:(78/143): libselinux-devel-2.9-8.el8.x86_64.rpm 2.9 MB/s | 200 kB 00:00 2023-06-23T18:42:08.684 INFO:teuthology.orchestra.run.smithi158.stdout:(20/143): python3-cephfs-18.0.0-4479.g8627af3e. 2.3 MB/s | 197 kB 00:00 2023-06-23T18:42:08.704 INFO:teuthology.orchestra.run.smithi052.stdout:(38/143): automake-1.16.1-7.el8.noarch.rpm 3.2 MB/s | 713 kB 00:00 2023-06-23T18:42:08.707 INFO:teuthology.orchestra.run.smithi089.stdout:(79/143): libgfortran-8.5.0-19.el8.x86_64.rpm 1.0 MB/s | 645 kB 00:00 2023-06-23T18:42:08.732 INFO:teuthology.orchestra.run.smithi089.stdout:(80/143): libsepol-devel-2.9-3.el8.x86_64.rpm 1.0 MB/s | 87 kB 00:00 2023-06-23T18:42:08.760 INFO:teuthology.orchestra.run.smithi089.stdout:(81/143): librabbitmq-0.9.0-3.el8.x86_64.rpm 231 kB/s | 47 kB 00:00 2023-06-23T18:42:08.767 INFO:teuthology.orchestra.run.smithi158.stdout:(21/143): python3-rados-18.0.0-4479.g8627af3e.e 4.3 MB/s | 370 kB 00:00 2023-06-23T18:42:08.785 INFO:teuthology.orchestra.run.smithi089.stdout:(82/143): libuuid-devel-2.32.1-42.el8.x86_64.rp 1.3 MB/s | 99 kB 00:00 2023-06-23T18:42:08.811 INFO:teuthology.orchestra.run.smithi089.stdout:(83/143): libverto-devel-0.3.2-2.el8.x86_64.rpm 232 kB/s | 18 kB 00:00 2023-06-23T18:42:08.814 INFO:teuthology.orchestra.run.smithi052.stdout:(39/143): ceph-mgr-diskprediction-local-18.0.0- 5.0 MB/s | 7.4 MB 00:01 2023-06-23T18:42:08.834 INFO:teuthology.orchestra.run.smithi158.stdout:(22/143): python3-rbd-18.0.0-4479.g8627af3e.el8 5.4 MB/s | 365 kB 00:00 2023-06-23T18:42:08.836 INFO:teuthology.orchestra.run.smithi089.stdout:(84/143): libzstd-devel-1.4.4-1.el8.x86_64.rpm 580 kB/s | 44 kB 00:00 2023-06-23T18:42:08.846 INFO:teuthology.orchestra.run.smithi052.stdout:(40/143): bison-3.0.4-10.el8.x86_64.rpm 2.1 MB/s | 688 kB 00:00 2023-06-23T18:42:08.880 INFO:teuthology.orchestra.run.smithi052.stdout:(41/143): flex-2.6.1-9.el8.x86_64.rpm 1.8 MB/s | 320 kB 00:00 2023-06-23T18:42:08.884 INFO:teuthology.orchestra.run.smithi158.stdout:(23/143): python3-rgw-18.0.0-4479.g8627af3e.el8 2.1 MB/s | 107 kB 00:00 2023-06-23T18:42:08.936 INFO:teuthology.orchestra.run.smithi089.stdout:(85/143): pcre2-devel-10.32-3.el8.x86_64.rpm 4.7 MB/s | 605 kB 00:00 2023-06-23T18:42:08.943 INFO:teuthology.orchestra.run.smithi158.stdout:(24/143): rbd-fuse-18.0.0-4479.g8627af3e.el8.x8 1.6 MB/s | 94 kB 00:00 2023-06-23T18:42:08.955 INFO:teuthology.orchestra.run.smithi052.stdout:(42/143): libpq-13.5-1.el8.x86_64.rpm 1.8 MB/s | 198 kB 00:00 2023-06-23T18:42:08.961 INFO:teuthology.orchestra.run.smithi089.stdout:(86/143): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.8 MB/s | 229 kB 00:00 2023-06-23T18:42:08.989 INFO:teuthology.orchestra.run.smithi052.stdout:(43/143): jq-1.6-7.el8.x86_64.rpm 1.1 MB/s | 202 kB 00:00 2023-06-23T18:42:09.014 INFO:teuthology.orchestra.run.smithi052.stdout:(44/143): librdkafka-0.11.4-3.el8.x86_64.rpm 2.6 MB/s | 354 kB 00:00 2023-06-23T18:42:09.020 INFO:teuthology.orchestra.run.smithi089.stdout:(87/143): openssl-devel-1.1.1k-9.el8.x86_64.rpm 14 MB/s | 3.2 MB 00:00 2023-06-23T18:42:09.045 INFO:teuthology.orchestra.run.smithi089.stdout:(88/143): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.0 MB/s | 220 kB 00:00 2023-06-23T18:42:09.098 INFO:teuthology.orchestra.run.smithi052.stdout:(45/143): libtool-2.4.6-25.el8.x86_64.rpm 4.9 MB/s | 709 kB 00:00 2023-06-23T18:42:09.104 INFO:teuthology.orchestra.run.smithi089.stdout:(89/143): python3-cryptography-3.2.1-6.el8.x86_ 7.5 MB/s | 641 kB 00:00 2023-06-23T18:42:09.123 INFO:teuthology.orchestra.run.smithi052.stdout:(46/143): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.9 MB/s | 259 kB 00:00 2023-06-23T18:42:09.129 INFO:teuthology.orchestra.run.smithi089.stdout:(90/143): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.5 MB/s | 249 kB 00:00 2023-06-23T18:42:09.148 INFO:teuthology.orchestra.run.smithi052.stdout:(47/143): oniguruma-6.8.2-2.el8.x86_64.rpm 1.4 MB/s | 187 kB 00:00 2023-06-23T18:42:09.154 INFO:teuthology.orchestra.run.smithi089.stdout:(91/143): python3-jwt-1.6.1-2.el8.noarch.rpm 392 kB/s | 43 kB 00:00 2023-06-23T18:42:09.180 INFO:teuthology.orchestra.run.smithi089.stdout:(92/143): python3-oauthlib-2.1.0-1.el8.noarch.r 2.0 MB/s | 155 kB 00:00 2023-06-23T18:42:09.205 INFO:teuthology.orchestra.run.smithi089.stdout:(93/143): python3-pycparser-2.14-14.el8.noarch. 1.4 MB/s | 109 kB 00:00 2023-06-23T18:42:09.231 INFO:teuthology.orchestra.run.smithi089.stdout:(94/143): python3-requests-oauthlib-1.0.0-1.el8 563 kB/s | 43 kB 00:00 2023-06-23T18:42:09.269 INFO:teuthology.orchestra.run.smithi158.stdout:(25/143): ceph-common-18.0.0-4479.g8627af3e.el8 1.7 MB/s | 22 MB 00:12 2023-06-23T18:42:09.289 INFO:teuthology.orchestra.run.smithi089.stdout:(95/143): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 684 kB/s | 74 kB 00:00 2023-06-23T18:42:09.314 INFO:teuthology.orchestra.run.smithi089.stdout:(96/143): zlib-devel-1.2.11-21.el8.x86_64.rpm 532 kB/s | 58 kB 00:00 2023-06-23T18:42:09.349 INFO:teuthology.orchestra.run.smithi052.stdout:(48/143): postgresql-10.23-1.module_el8+300+2c5 7.8 MB/s | 1.6 MB 00:00 2023-06-23T18:42:09.361 INFO:teuthology.orchestra.run.smithi158.stdout:(26/143): rbd-nbd-18.0.0-4479.g8627af3e.el8.x86 1.9 MB/s | 179 kB 00:00 2023-06-23T18:42:09.432 INFO:teuthology.orchestra.run.smithi052.stdout:(49/143): openblas-threads-0.3.15-4.el8.x86_64. 16 MB/s | 4.9 MB 00:00 2023-06-23T18:42:09.436 INFO:teuthology.orchestra.run.smithi158.stdout:(27/143): ceph-grafana-dashboards-18.0.0-4479.g 309 kB/s | 23 kB 00:00 2023-06-23T18:42:09.494 INFO:teuthology.orchestra.run.smithi158.stdout:(28/143): rbd-mirror-18.0.0-4479.g8627af3e.el8. 6.3 MB/s | 3.4 MB 00:00 2023-06-23T18:42:09.499 INFO:teuthology.orchestra.run.smithi052.stdout:(50/143): openblas-0.3.15-4.el8.x86_64.rpm 12 MB/s | 4.7 MB 00:00 2023-06-23T18:42:09.520 INFO:teuthology.orchestra.run.smithi158.stdout:(29/143): ceph-mgr-cephadm-18.0.0-4479.g8627af3 1.5 MB/s | 128 kB 00:00 2023-06-23T18:42:09.567 INFO:teuthology.orchestra.run.smithi052.stdout:(51/143): postgresql-contrib-10.23-1.module_el8 4.0 MB/s | 903 kB 00:00 2023-06-23T18:42:09.687 INFO:teuthology.orchestra.run.smithi158.stdout:(30/143): ceph-mgr-dashboard-18.0.0-4479.g8627a 8.9 MB/s | 1.7 MB 00:00 2023-06-23T18:42:09.716 INFO:teuthology.orchestra.run.smithi052.stdout:(52/143): python3-jinja2-2.10.1-3.el8.noarch.rp 3.5 MB/s | 538 kB 00:00 2023-06-23T18:42:09.746 INFO:teuthology.orchestra.run.smithi158.stdout:(31/143): ceph-mgr-modules-core-18.0.0-4479.g86 4.0 MB/s | 240 kB 00:00 2023-06-23T18:42:09.748 INFO:teuthology.orchestra.run.smithi089.stdout:(97/143): liboath-2.6.2-3.el8.x86_64.rpm 128 kB/s | 59 kB 00:00 2023-06-23T18:42:09.765 INFO:teuthology.orchestra.run.smithi089.stdout:(98/143): libunwind-1.3.1-3.el8.x86_64.rpm 167 kB/s | 75 kB 00:00 2023-06-23T18:42:09.796 INFO:teuthology.orchestra.run.smithi158.stdout:(32/143): ceph-mgr-rook-18.0.0-4479.g8627af3e.e 951 kB/s | 47 kB 00:00 2023-06-23T18:42:09.800 INFO:teuthology.orchestra.run.smithi052.stdout:(53/143): postgresql-server-10.23-1.module_el8+ 14 MB/s | 5.1 MB 00:00 2023-06-23T18:42:09.817 INFO:teuthology.orchestra.run.smithi052.stdout:(54/143): python3-jsonpatch-1.21-2.el8.noarch.r 265 kB/s | 27 kB 00:00 2023-06-23T18:42:09.854 INFO:teuthology.orchestra.run.smithi158.stdout:(33/143): ceph-prometheus-alerts-18.0.0-4479.g8 251 kB/s | 15 kB 00:00 2023-06-23T18:42:09.873 INFO:teuthology.orchestra.run.smithi089.stdout:(99/143): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 402 kB/s | 44 kB 00:00 2023-06-23T18:42:09.875 INFO:teuthology.orchestra.run.smithi052.stdout:(55/143): python3-babel-2.5.1-7.el8.noarch.rpm 13 MB/s | 4.8 MB 00:00 2023-06-23T18:42:09.901 INFO:teuthology.orchestra.run.smithi052.stdout:(56/143): python3-jsonpointer-1.10-11.el8.noarc 199 kB/s | 20 kB 00:00 2023-06-23T18:42:09.907 INFO:teuthology.orchestra.run.smithi089.stdout:(100/143): gperftools-libs-2.7-9.el8.x86_64.rpm 453 kB/s | 306 kB 00:00 2023-06-23T18:42:09.929 INFO:teuthology.orchestra.run.smithi158.stdout:(34/143): ceph-volume-18.0.0-4479.g8627af3e.el8 3.4 MB/s | 258 kB 00:00 2023-06-23T18:42:09.959 INFO:teuthology.orchestra.run.smithi052.stdout:(57/143): python3-mako-1.0.6-14.el8.noarch.rpm 1.1 MB/s | 157 kB 00:00 2023-06-23T18:42:09.980 INFO:teuthology.orchestra.run.smithi158.stdout:(35/143): cephadm-18.0.0-4479.g8627af3e.el8.noa 3.2 MB/s | 161 kB 00:00 2023-06-23T18:42:09.984 INFO:teuthology.orchestra.run.smithi052.stdout:(58/143): python3-markupsafe-0.23-19.el8.x86_64 356 kB/s | 39 kB 00:00 2023-06-23T18:42:10.032 INFO:teuthology.orchestra.run.smithi089.stdout:(101/143): python3-cachetools-3.1.1-4.el8.noarc 264 kB/s | 33 kB 00:00 2023-06-23T18:42:10.039 INFO:teuthology.orchestra.run.smithi158.stdout:(36/143): cephfs-top-18.0.0-4479.g8627af3e.el8. 308 kB/s | 18 kB 00:00 2023-06-23T18:42:10.066 INFO:teuthology.orchestra.run.smithi089.stdout:(102/143): python3-asyncssh-2.7.0-2.el8.noarch. 1.5 MB/s | 476 kB 00:00 2023-06-23T18:42:10.085 INFO:teuthology.orchestra.run.smithi052.stdout:(59/143): python3-prettytable-0.7.2-14.el8.noar 439 kB/s | 44 kB 00:00 2023-06-23T18:42:10.091 INFO:teuthology.orchestra.run.smithi089.stdout:(103/143): python3-beautifulsoup4-4.6.3-2.el8.1 851 kB/s | 185 kB 00:00 2023-06-23T18:42:10.110 INFO:teuthology.orchestra.run.smithi052.stdout:(60/143): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.5 MB/s | 225 kB 00:00 2023-06-23T18:42:10.133 INFO:teuthology.orchestra.run.smithi089.stdout:(104/143): python3-certifi-2018.10.15-7.el8.noa 162 kB/s | 16 kB 00:00 2023-06-23T18:42:10.175 INFO:teuthology.orchestra.run.smithi089.stdout:(105/143): python3-cheroot-8.5.2-1.el8.noarch.r 1.5 MB/s | 173 kB 00:00 2023-06-23T18:42:10.177 INFO:teuthology.orchestra.run.smithi052.stdout:(61/143): python3-numpy-1.14.3-10.el8.x86_64.rp 14 MB/s | 3.7 MB 00:00 2023-06-23T18:42:10.202 INFO:teuthology.orchestra.run.smithi052.stdout:(62/143): python3-pyOpenSSL-19.0.0-1.el8.noarch 882 kB/s | 103 kB 00:00 2023-06-23T18:42:10.228 INFO:teuthology.orchestra.run.smithi052.stdout:(63/143): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-06-23T18:42:10.242 INFO:teuthology.orchestra.run.smithi089.stdout:(106/143): python3-google-auth-1.1.1-10.el8.noa 747 kB/s | 81 kB 00:00 2023-06-23T18:42:10.247 INFO:teuthology.orchestra.run.smithi158.stdout:(37/143): automake-1.16.1-7.el8.noarch.rpm 3.4 MB/s | 713 kB 00:00 2023-06-23T18:42:10.284 INFO:teuthology.orchestra.run.smithi089.stdout:(107/143): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2023-06-23T18:42:10.308 INFO:teuthology.orchestra.run.smithi052.stdout:(64/143): python3-pyasn1-modules-0.3.7-6.el8.no 844 kB/s | 110 kB 00:00 2023-06-23T18:42:10.327 INFO:teuthology.orchestra.run.smithi089.stdout:(108/143): python3-cherrypy-18.4.0-1.el8.noarch 1.6 MB/s | 384 kB 00:00 2023-06-23T18:42:10.337 INFO:teuthology.orchestra.run.smithi052.stdout:(65/143): python3-pytz-2017.2-9.el8.noarch.rpm 403 kB/s | 54 kB 00:00 2023-06-23T18:42:10.385 INFO:teuthology.orchestra.run.smithi089.stdout:(109/143): python3-jaraco-functools-2.0-4.el8.n 123 kB/s | 18 kB 00:00 2023-06-23T18:42:10.423 INFO:teuthology.orchestra.run.smithi158.stdout:(38/143): bison-3.0.4-10.el8.x86_64.rpm 3.8 MB/s | 688 kB 00:00 2023-06-23T18:42:10.452 INFO:teuthology.orchestra.run.smithi089.stdout:(110/143): python3-logutils-0.3.5-11.el8.noarch 389 kB/s | 49 kB 00:00 2023-06-23T18:42:10.470 INFO:teuthology.orchestra.run.smithi052.stdout:(66/143): python3-werkzeug-0.12.2-4.el8.noarch. 2.8 MB/s | 457 kB 00:00 2023-06-23T18:42:10.495 INFO:teuthology.orchestra.run.smithi052.stdout:(67/143): socat-1.7.4.1-1.el8.x86_64.rpm 2.0 MB/s | 323 kB 00:00 2023-06-23T18:42:10.502 INFO:teuthology.orchestra.run.smithi089.stdout:(111/143): python3-more-itertools-7.2.0-3.el8.n 502 kB/s | 59 kB 00:00 2023-06-23T18:42:10.565 INFO:teuthology.orchestra.run.smithi158.stdout:(39/143): flex-2.6.1-9.el8.x86_64.rpm 2.2 MB/s | 320 kB 00:00 2023-06-23T18:42:10.569 INFO:teuthology.orchestra.run.smithi089.stdout:(112/143): python3-natsort-7.1.1-2.el8.noarch.r 516 kB/s | 60 kB 00:00 2023-06-23T18:42:10.579 INFO:teuthology.orchestra.run.smithi052.stdout:(68/143): uuid-1.6.2-43.el8.x86_64.rpm 590 kB/s | 64 kB 00:00 2023-06-23T18:42:10.605 INFO:teuthology.orchestra.run.smithi052.stdout:(69/143): xmlstarlet-1.6.1-20.el8.x86_64.rpm 650 kB/s | 71 kB 00:00 2023-06-23T18:42:10.611 INFO:teuthology.orchestra.run.smithi089.stdout:(113/143): python3-kubernetes-11.0.0-6.el8.noar 3.6 MB/s | 1.2 MB 00:00 2023-06-23T18:42:10.637 INFO:teuthology.orchestra.run.smithi089.stdout:(114/143): python3-pecan-1.3.2-9.el8.noarch.rpm 2.1 MB/s | 283 kB 00:00 2023-06-23T18:42:10.687 INFO:teuthology.orchestra.run.smithi089.stdout:(115/143): python3-portend-2.6-1.el8.noarch.rpm 133 kB/s | 16 kB 00:00 2023-06-23T18:42:10.698 INFO:teuthology.orchestra.run.smithi158.stdout:(40/143): jq-1.6-7.el8.x86_64.rpm 1.5 MB/s | 202 kB 00:00 2023-06-23T18:42:10.754 INFO:teuthology.orchestra.run.smithi089.stdout:(116/143): python3-repoze-lru-0.7-6.el8.noarch. 236 kB/s | 34 kB 00:00 2023-06-23T18:42:10.779 INFO:teuthology.orchestra.run.smithi089.stdout:(117/143): python3-routes-2.4.1-12.el8.noarch.r 1.3 MB/s | 196 kB 00:00 2023-06-23T18:42:10.805 INFO:teuthology.orchestra.run.smithi089.stdout:(118/143): python3-rsa-4.8-1.el8.noarch.rpm 525 kB/s | 61 kB 00:00 2023-06-23T18:42:10.847 INFO:teuthology.orchestra.run.smithi052.stdout:(70/143): python3-scipy-1.0.0-21.module_el8.5.0 22 MB/s | 14 MB 00:00 2023-06-23T18:42:10.863 INFO:teuthology.orchestra.run.smithi089.stdout:(119/143): python3-simplegeneric-0.8.1-17.el8.n 172 kB/s | 19 kB 00:00 2023-06-23T18:42:10.872 INFO:teuthology.orchestra.run.smithi052.stdout:(71/143): elfutils-libelf-devel-0.189-2.el8.x86 211 kB/s | 61 kB 00:00 2023-06-23T18:42:10.889 INFO:teuthology.orchestra.run.smithi089.stdout:(120/143): python3-singledispatch-3.4.0.3-18.el 220 kB/s | 24 kB 00:00 2023-06-23T18:42:10.897 INFO:teuthology.orchestra.run.smithi052.stdout:(72/143): fuse-2.9.7-17.el8.x86_64.rpm 284 kB/s | 83 kB 00:00 2023-06-23T18:42:10.914 INFO:teuthology.orchestra.run.smithi089.stdout:(121/143): python3-tempora-1.14.1-5.el8.noarch. 268 kB/s | 29 kB 00:00 2023-06-23T18:42:10.964 INFO:teuthology.orchestra.run.smithi052.stdout:(73/143): libaio-devel-0.3.112-1.el8.x86_64.rpm 280 kB/s | 19 kB 00:00 2023-06-23T18:42:10.972 INFO:teuthology.orchestra.run.smithi089.stdout:(122/143): python3-trustme-0.6.0-4.el8.noarch.r 253 kB/s | 27 kB 00:00 2023-06-23T18:42:10.998 INFO:teuthology.orchestra.run.smithi089.stdout:(123/143): python3-waitress-1.4.3-1.el8.noarch. 2.3 MB/s | 255 kB 00:00 2023-06-23T18:42:11.031 INFO:teuthology.orchestra.run.smithi089.stdout:(124/143): python3-webob-1.8.5-1.el8.1.noarch.r 2.1 MB/s | 251 kB 00:00 2023-06-23T18:42:11.057 INFO:teuthology.orchestra.run.smithi052.stdout:(74/143): libcom_err-devel-1.45.6-5.el8.x86_64. 419 kB/s | 39 kB 00:00 2023-06-23T18:42:11.090 INFO:teuthology.orchestra.run.smithi052.stdout:(75/143): keyutils-libs-devel-1.5.10-9.el8.x86_ 198 kB/s | 48 kB 00:00 2023-06-23T18:42:11.107 INFO:teuthology.orchestra.run.smithi089.stdout:(125/143): python3-websocket-client-0.56.0-5.el 457 kB/s | 61 kB 00:00 2023-06-23T18:42:11.115 INFO:teuthology.orchestra.run.smithi052.stdout:(76/143): krb5-devel-1.18.2-22.el8.x86_64.rpm 2.3 MB/s | 561 kB 00:00 2023-06-23T18:42:11.132 INFO:teuthology.orchestra.run.smithi089.stdout:(126/143): python3-webtest-2.0.33-1.el8.noarch. 638 kB/s | 85 kB 00:00 2023-06-23T18:42:11.157 INFO:teuthology.orchestra.run.smithi089.stdout:(127/143): python3-zc-lockfile-2.0-2.el8.noarch 182 kB/s | 23 kB 00:00 2023-06-23T18:42:11.182 INFO:teuthology.orchestra.run.smithi052.stdout:(77/143): librabbitmq-0.9.0-3.el8.x86_64.rpm 705 kB/s | 47 kB 00:00 2023-06-23T18:42:11.207 INFO:teuthology.orchestra.run.smithi052.stdout:(78/143): libquadmath-8.5.0-19.el8.x86_64.rpm 1.4 MB/s | 172 kB 00:00 2023-06-23T18:42:11.249 INFO:teuthology.orchestra.run.smithi052.stdout:(79/143): libgfortran-8.5.0-19.el8.x86_64.rpm 3.3 MB/s | 645 kB 00:00 2023-06-23T18:42:11.266 INFO:teuthology.orchestra.run.smithi052.stdout:(80/143): libsepol-devel-2.9-3.el8.x86_64.rpm 1.4 MB/s | 87 kB 00:00 2023-06-23T18:42:11.291 INFO:teuthology.orchestra.run.smithi052.stdout:(81/143): libselinux-devel-2.9-8.el8.x86_64.rpm 1.8 MB/s | 200 kB 00:00 2023-06-23T18:42:11.316 INFO:teuthology.orchestra.run.smithi052.stdout:(82/143): libuuid-devel-2.32.1-42.el8.x86_64.rp 1.4 MB/s | 99 kB 00:00 2023-06-23T18:42:11.333 INFO:teuthology.orchestra.run.smithi052.stdout:(83/143): libverto-devel-0.3.2-2.el8.x86_64.rpm 268 kB/s | 18 kB 00:00 2023-06-23T18:42:11.350 INFO:teuthology.orchestra.run.smithi052.stdout:(84/143): libzstd-devel-1.4.4-1.el8.x86_64.rpm 748 kB/s | 44 kB 00:00 2023-06-23T18:42:11.408 INFO:teuthology.orchestra.run.smithi158.stdout:(41/143): ceph-test-18.0.0-4479.g8627af3e.el8.x 5.7 MB/s | 48 MB 00:08 2023-06-23T18:42:11.433 INFO:teuthology.orchestra.run.smithi158.stdout:(42/143): libpq-13.5-1.el8.x86_64.rpm 269 kB/s | 198 kB 00:00 2023-06-23T18:42:11.451 INFO:teuthology.orchestra.run.smithi089.stdout:(128/143): thrift-0.13.0-2.el8.x86_64.rpm 5.1 MB/s | 1.7 MB 00:00 2023-06-23T18:42:11.451 INFO:teuthology.orchestra.run.smithi052.stdout:(85/143): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.2 MB/s | 229 kB 00:00 2023-06-23T18:42:11.476 INFO:teuthology.orchestra.run.smithi052.stdout:(86/143): pcre2-devel-10.32-3.el8.x86_64.rpm 4.2 MB/s | 605 kB 00:00 2023-06-23T18:42:11.543 INFO:teuthology.orchestra.run.smithi052.stdout:(87/143): openssl-devel-1.1.1k-9.el8.x86_64.rpm 14 MB/s | 3.2 MB 00:00 2023-06-23T18:42:11.568 INFO:teuthology.orchestra.run.smithi052.stdout:(88/143): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-06-23T18:42:11.583 INFO:teuthology.orchestra.run.smithi158.stdout:(43/143): librdkafka-0.11.4-3.el8.x86_64.rpm 2.0 MB/s | 354 kB 00:00 2023-06-23T18:42:11.593 INFO:teuthology.orchestra.run.smithi052.stdout:(89/143): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.1 MB/s | 249 kB 00:00 2023-06-23T18:42:11.608 INFO:teuthology.orchestra.run.smithi089.stdout:(129/143): librados2-18.0.0-4479.g8627af3e.el8. 7.7 MB/s | 3.7 MB 00:00 2023-06-23T18:42:11.608 INFO:teuthology.orchestra.run.smithi158.stdout:(44/143): libtool-2.4.6-25.el8.x86_64.rpm 4.0 MB/s | 709 kB 00:00 2023-06-23T18:42:11.627 INFO:teuthology.orchestra.run.smithi052.stdout:(90/143): python3-cryptography-3.2.1-6.el8.x86_ 7.5 MB/s | 641 kB 00:00 2023-06-23T18:42:11.644 INFO:teuthology.orchestra.run.smithi052.stdout:(91/143): python3-jwt-1.6.1-2.el8.noarch.rpm 564 kB/s | 43 kB 00:00 2023-06-23T18:42:11.669 INFO:teuthology.orchestra.run.smithi052.stdout:(92/143): python3-oauthlib-2.1.0-1.el8.noarch.r 2.0 MB/s | 155 kB 00:00 2023-06-23T18:42:11.675 INFO:teuthology.orchestra.run.smithi089.stdout:(130/143): NetworkManager-initscripts-updown-1. 640 kB/s | 143 kB 00:00 2023-06-23T18:42:11.686 INFO:teuthology.orchestra.run.smithi052.stdout:(93/143): python3-pycparser-2.14-14.el8.noarch. 1.8 MB/s | 109 kB 00:00 2023-06-23T18:42:11.703 INFO:teuthology.orchestra.run.smithi052.stdout:(94/143): python3-requests-oauthlib-1.0.0-1.el8 722 kB/s | 43 kB 00:00 2023-06-23T18:42:11.725 INFO:teuthology.orchestra.run.smithi158.stdout:(45/143): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.8 MB/s | 259 kB 00:00 2023-06-23T18:42:11.737 INFO:teuthology.orchestra.run.smithi052.stdout:(95/143): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.1 MB/s | 74 kB 00:00 2023-06-23T18:42:11.758 INFO:teuthology.orchestra.run.smithi089.stdout:(131/143): librbd1-18.0.0-4479.g8627af3e.el8.x8 5.9 MB/s | 3.6 MB 00:00 2023-06-23T18:42:11.798 INFO:teuthology.orchestra.run.smithi052.stdout:(96/143): zlib-devel-1.2.11-21.el8.x86_64.rpm 525 kB/s | 58 kB 00:00 2023-06-23T18:42:11.817 INFO:teuthology.orchestra.run.smithi158.stdout:(46/143): ceph-mgr-diskprediction-local-18.0.0- 3.2 MB/s | 7.4 MB 00:02 2023-06-23T18:42:11.843 INFO:teuthology.orchestra.run.smithi158.stdout:(47/143): oniguruma-6.8.2-2.el8.x86_64.rpm 801 kB/s | 187 kB 00:00 2023-06-23T18:42:12.026 INFO:teuthology.orchestra.run.smithi089.stdout:(132/143): elfutils-debuginfod-client-0.189-2.e 182 kB/s | 76 kB 00:00 2023-06-23T18:42:12.043 INFO:teuthology.orchestra.run.smithi158.stdout:(48/143): postgresql-10.23-1.module_el8+300+2c5 7.8 MB/s | 1.6 MB 00:00 2023-06-23T18:42:12.076 INFO:teuthology.orchestra.run.smithi089.stdout:(133/143): elfutils-libelf-0.189-2.el8.x86_64.r 578 kB/s | 232 kB 00:00 2023-06-23T18:42:12.079 INFO:teuthology.orchestra.run.smithi052.stdout:(97/143): liboath-2.6.2-3.el8.x86_64.rpm 172 kB/s | 59 kB 00:00 2023-06-23T18:42:12.101 INFO:teuthology.orchestra.run.smithi089.stdout:(134/143): elfutils-libs-0.189-2.el8.x86_64.rpm 883 kB/s | 302 kB 00:00 2023-06-23T18:42:12.121 INFO:teuthology.orchestra.run.smithi052.stdout:(98/143): libunwind-1.3.1-3.el8.x86_64.rpm 239 kB/s | 75 kB 00:00 2023-06-23T18:42:12.160 INFO:teuthology.orchestra.run.smithi158.stdout:(49/143): openblas-0.3.15-4.el8.x86_64.rpm 11 MB/s | 4.7 MB 00:00 2023-06-23T18:42:12.168 INFO:teuthology.orchestra.run.smithi089.stdout:(135/143): libfdisk-2.32.1-42.el8.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2023-06-23T18:42:12.193 INFO:teuthology.orchestra.run.smithi089.stdout:(136/143): libblkid-2.32.1-42.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-06-23T18:42:12.202 INFO:teuthology.orchestra.run.smithi158.stdout:(50/143): postgresql-contrib-10.23-1.module_el8 5.6 MB/s | 903 kB 00:00 2023-06-23T18:42:12.205 INFO:teuthology.orchestra.run.smithi052.stdout:(99/143): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 524 kB/s | 44 kB 00:00 2023-06-23T18:42:12.230 INFO:teuthology.orchestra.run.smithi052.stdout:(100/143): gperftools-libs-2.7-9.el8.x86_64.rpm 581 kB/s | 306 kB 00:00 2023-06-23T18:42:12.274 INFO:teuthology.orchestra.run.smithi089.stdout:(137/143): libmount-2.32.1-42.el8.x86_64.rpm 2.2 MB/s | 236 kB 00:00 2023-06-23T18:42:12.303 INFO:teuthology.orchestra.run.smithi089.stdout:(138/143): libsmartcols-2.32.1-42.el8.x86_64.rp 1.6 MB/s | 179 kB 00:00 2023-06-23T18:42:12.313 INFO:teuthology.orchestra.run.smithi052.stdout:(101/143): python3-cachetools-3.1.1-4.el8.noarc 396 kB/s | 33 kB 00:00 2023-06-23T18:42:12.336 INFO:teuthology.orchestra.run.smithi089.stdout:(139/143): iproute-6.2.0-2.el8.x86_64.rpm 2.8 MB/s | 880 kB 00:00 2023-06-23T18:42:12.339 INFO:teuthology.orchestra.run.smithi052.stdout:(102/143): python3-beautifulsoup4-4.6.3-2.el8.1 1.4 MB/s | 185 kB 00:00 2023-06-23T18:42:12.362 INFO:teuthology.orchestra.run.smithi089.stdout:(140/143): libuuid-2.32.1-42.el8.x86_64.rpm 1.1 MB/s | 98 kB 00:00 2023-06-23T18:42:12.398 INFO:teuthology.orchestra.run.smithi052.stdout:(103/143): python3-asyncssh-2.7.0-2.el8.noarch. 1.5 MB/s | 476 kB 00:00 2023-06-23T18:42:12.403 INFO:teuthology.orchestra.run.smithi089.stdout:(141/143): util-linux-user-2.32.1-42.el8.x86_64 1.5 MB/s | 102 kB 00:00 2023-06-23T18:42:12.423 INFO:teuthology.orchestra.run.smithi052.stdout:(104/143): python3-certifi-2018.10.15-7.el8.noa 149 kB/s | 16 kB 00:00 2023-06-23T18:42:12.477 INFO:teuthology.orchestra.run.smithi158.stdout:(51/143): openblas-threads-0.3.15-4.el8.x86_64. 7.4 MB/s | 4.9 MB 00:00 2023-06-23T18:42:12.490 INFO:teuthology.orchestra.run.smithi052.stdout:(105/143): python3-cheroot-8.5.2-1.el8.noarch.r 1.1 MB/s | 173 kB 00:00 2023-06-23T18:42:12.495 INFO:teuthology.orchestra.run.smithi089.stdout:(142/143): xfsprogs-5.0.0-12.el8.x86_64.rpm 8.1 MB/s | 1.1 MB 00:00 2023-06-23T18:42:12.548 INFO:teuthology.orchestra.run.smithi052.stdout:(106/143): python3-google-auth-1.1.1-10.el8.noa 649 kB/s | 81 kB 00:00 2023-06-23T18:42:12.554 INFO:teuthology.orchestra.run.smithi089.stdout:(143/143): util-linux-2.32.1-42.el8.x86_64.rpm 10 MB/s | 2.6 MB 00:00 2023-06-23T18:42:12.559 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-06-23T18:42:12.560 INFO:teuthology.orchestra.run.smithi089.stdout:Total 12 MB/s | 212 MB 00:18 2023-06-23T18:42:12.561 INFO:teuthology.orchestra.run.smithi158.stdout:(52/143): postgresql-server-10.23-1.module_el8+ 13 MB/s | 5.1 MB 00:00 2023-06-23T18:42:12.574 INFO:teuthology.orchestra.run.smithi052.stdout:(107/143): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2023-06-23T18:42:12.633 INFO:teuthology.orchestra.run.smithi052.stdout:(108/143): python3-jaraco-functools-2.0-4.el8.n 211 kB/s | 18 kB 00:00 2023-06-23T18:42:12.636 INFO:teuthology.orchestra.run.smithi158.stdout:(53/143): python3-babel-2.5.1-7.el8.noarch.rpm 11 MB/s | 4.8 MB 00:00 2023-06-23T18:42:12.658 INFO:teuthology.orchestra.run.smithi052.stdout:(109/143): python3-cherrypy-18.4.0-1.el8.noarch 1.4 MB/s | 384 kB 00:00 2023-06-23T18:42:12.661 INFO:teuthology.orchestra.run.smithi158.stdout:(54/143): python3-jsonpatch-1.21-2.el8.noarch.r 265 kB/s | 27 kB 00:00 2023-06-23T18:42:12.686 INFO:teuthology.orchestra.run.smithi158.stdout:(55/143): python3-jinja2-2.10.1-3.el8.noarch.rp 2.5 MB/s | 538 kB 00:00 2023-06-23T18:42:12.708 INFO:teuthology.orchestra.run.smithi052.stdout:(110/143): python3-logutils-0.3.5-11.el8.noarch 648 kB/s | 49 kB 00:00 2023-06-23T18:42:12.720 INFO:teuthology.orchestra.run.smithi158.stdout:(56/143): python3-jsonpointer-1.10-11.el8.noarc 239 kB/s | 20 kB 00:00 2023-06-23T18:42:12.733 INFO:teuthology.orchestra.run.smithi052.stdout:(111/143): python3-more-itertools-7.2.0-3.el8.n 780 kB/s | 59 kB 00:00 2023-06-23T18:42:12.770 INFO:teuthology.orchestra.run.smithi158.stdout:(57/143): python3-markupsafe-0.23-19.el8.x86_64 464 kB/s | 39 kB 00:00 2023-06-23T18:42:12.783 INFO:teuthology.orchestra.run.smithi052.stdout:(112/143): python3-natsort-7.1.1-2.el8.noarch.r 803 kB/s | 60 kB 00:00 2023-06-23T18:42:12.796 INFO:teuthology.orchestra.run.smithi158.stdout:(58/143): python3-mako-1.0.6-14.el8.noarch.rpm 1.1 MB/s | 157 kB 00:00 2023-06-23T18:42:12.896 INFO:teuthology.orchestra.run.smithi158.stdout:(59/143): python3-prettytable-0.7.2-14.el8.noar 439 kB/s | 44 kB 00:00 2023-06-23T18:42:12.921 INFO:teuthology.orchestra.run.smithi158.stdout:(60/143): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.5 MB/s | 225 kB 00:00 2023-06-23T18:42:12.988 INFO:teuthology.orchestra.run.smithi158.stdout:(61/143): python3-numpy-1.14.3-10.el8.x86_64.rp 14 MB/s | 3.7 MB 00:00 2023-06-23T18:42:13.013 INFO:teuthology.orchestra.run.smithi158.stdout:(62/143): python3-pyOpenSSL-19.0.0-1.el8.noarch 885 kB/s | 103 kB 00:00 2023-06-23T18:42:13.039 INFO:teuthology.orchestra.run.smithi158.stdout:(63/143): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-06-23T18:42:13.076 INFO:teuthology.orchestra.run.smithi052.stdout:(113/143): python3-portend-2.6-1.el8.noarch.rpm 53 kB/s | 16 kB 00:00 2023-06-23T18:42:13.097 INFO:teuthology.orchestra.run.smithi158.stdout:(64/143): python3-pyasn1-modules-0.3.7-6.el8.no 1.0 MB/s | 110 kB 00:00 2023-06-23T18:42:13.101 INFO:teuthology.orchestra.run.smithi052.stdout:(114/143): python3-pecan-1.3.2-9.el8.noarch.rpm 770 kB/s | 283 kB 00:00 2023-06-23T18:42:13.123 INFO:teuthology.orchestra.run.smithi158.stdout:(65/143): python3-pytz-2017.2-9.el8.noarch.rpm 495 kB/s | 54 kB 00:00 2023-06-23T18:42:13.151 INFO:teuthology.orchestra.run.smithi052.stdout:(115/143): python3-repoze-lru-0.7-6.el8.noarch. 447 kB/s | 34 kB 00:00 2023-06-23T18:42:13.235 INFO:teuthology.orchestra.run.smithi052.stdout:(116/143): python3-rsa-4.8-1.el8.noarch.rpm 739 kB/s | 61 kB 00:00 2023-06-23T18:42:13.248 INFO:teuthology.orchestra.run.smithi158.stdout:(66/143): python3-werkzeug-0.12.2-4.el8.noarch. 3.0 MB/s | 457 kB 00:00 2023-06-23T18:42:13.260 INFO:teuthology.orchestra.run.smithi052.stdout:(117/143): python3-routes-2.4.1-12.el8.noarch.r 1.2 MB/s | 196 kB 00:00 2023-06-23T18:42:13.273 INFO:teuthology.orchestra.run.smithi158.stdout:(67/143): socat-1.7.4.1-1.el8.x86_64.rpm 2.1 MB/s | 323 kB 00:00 2023-06-23T18:42:13.327 INFO:teuthology.orchestra.run.smithi052.stdout:(118/143): python3-kubernetes-11.0.0-6.el8.noar 1.5 MB/s | 1.2 MB 00:00 2023-06-23T18:42:13.344 INFO:teuthology.orchestra.run.smithi052.stdout:(119/143): python3-simplegeneric-0.8.1-17.el8.n 172 kB/s | 19 kB 00:00 2023-06-23T18:42:13.349 INFO:teuthology.orchestra.run.smithi158.stdout:(68/143): uuid-1.6.2-43.el8.x86_64.rpm 638 kB/s | 64 kB 00:00 2023-06-23T18:42:13.361 INFO:teuthology.orchestra.run.smithi052.stdout:(120/143): python3-singledispatch-3.4.0.3-18.el 238 kB/s | 24 kB 00:00 2023-06-23T18:42:13.374 INFO:teuthology.orchestra.run.smithi158.stdout:(69/143): xmlstarlet-1.6.1-20.el8.x86_64.rpm 702 kB/s | 71 kB 00:00 2023-06-23T18:42:13.403 INFO:teuthology.orchestra.run.smithi052.stdout:(121/143): python3-tempora-1.14.1-5.el8.noarch. 388 kB/s | 29 kB 00:00 2023-06-23T18:42:13.437 INFO:teuthology.orchestra.run.smithi052.stdout:(122/143): python3-trustme-0.6.0-4.el8.noarch.r 364 kB/s | 27 kB 00:00 2023-06-23T18:42:13.485 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-06-23T18:42:13.512 INFO:teuthology.orchestra.run.smithi052.stdout:(123/143): python3-websocket-client-0.56.0-5.el 818 kB/s | 61 kB 00:00 2023-06-23T18:42:13.541 INFO:teuthology.orchestra.run.smithi158.stdout:(70/143): elfutils-libelf-devel-0.189-2.el8.x86 321 kB/s | 61 kB 00:00 2023-06-23T18:42:13.554 INFO:teuthology.orchestra.run.smithi052.stdout:(124/143): python3-waitress-1.4.3-1.el8.noarch. 1.3 MB/s | 255 kB 00:00 2023-06-23T18:42:13.566 INFO:teuthology.orchestra.run.smithi158.stdout:(71/143): fuse-2.9.7-17.el8.x86_64.rpm 433 kB/s | 83 kB 00:00 2023-06-23T18:42:13.596 INFO:teuthology.orchestra.run.smithi052.stdout:(125/143): python3-webtest-2.0.33-1.el8.noarch. 1.0 MB/s | 85 kB 00:00 2023-06-23T18:42:13.621 INFO:teuthology.orchestra.run.smithi052.stdout:(126/143): python3-webob-1.8.5-1.el8.1.noarch.r 1.1 MB/s | 251 kB 00:00 2023-06-23T18:42:13.650 INFO:teuthology.orchestra.run.smithi158.stdout:(72/143): keyutils-libs-devel-1.5.10-9.el8.x86_ 443 kB/s | 48 kB 00:00 2023-06-23T18:42:13.666 INFO:teuthology.orchestra.run.smithi052.stdout:(127/143): python3-zc-lockfile-2.0-2.el8.noarch 205 kB/s | 23 kB 00:00 2023-06-23T18:42:13.708 INFO:teuthology.orchestra.run.smithi158.stdout:(73/143): libaio-devel-0.3.112-1.el8.x86_64.rpm 321 kB/s | 19 kB 00:00 2023-06-23T18:42:13.846 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-06-23T18:42:13.846 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-06-23T18:42:13.850 INFO:teuthology.orchestra.run.smithi158.stdout:(74/143): python3-scipy-1.0.0-21.module_el8.5.0 17 MB/s | 14 MB 00:00 2023-06-23T18:42:13.876 INFO:teuthology.orchestra.run.smithi158.stdout:(75/143): libcom_err-devel-1.45.6-5.el8.x86_64. 232 kB/s | 39 kB 00:00 2023-06-23T18:42:13.909 INFO:teuthology.orchestra.run.smithi158.stdout:(76/143): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.6 MB/s | 561 kB 00:00 2023-06-23T18:42:13.976 INFO:teuthology.orchestra.run.smithi158.stdout:(77/143): librabbitmq-0.9.0-3.el8.x86_64.rpm 702 kB/s | 47 kB 00:00 2023-06-23T18:42:14.001 INFO:teuthology.orchestra.run.smithi158.stdout:(78/143): libquadmath-8.5.0-19.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2023-06-23T18:42:14.043 INFO:teuthology.orchestra.run.smithi158.stdout:(79/143): libselinux-devel-2.9-8.el8.x86_64.rpm 2.9 MB/s | 200 kB 00:00 2023-06-23T18:42:14.055 INFO:teuthology.orchestra.run.smithi052.stdout:(128/143): librados2-18.0.0-4479.g8627af3e.el8. 8.4 MB/s | 3.7 MB 00:00 2023-06-23T18:42:14.069 INFO:teuthology.orchestra.run.smithi158.stdout:(80/143): libsepol-devel-2.9-3.el8.x86_64.rpm 1.3 MB/s | 87 kB 00:00 2023-06-23T18:42:14.111 INFO:teuthology.orchestra.run.smithi158.stdout:(81/143): libuuid-devel-2.32.1-42.el8.x86_64.rp 1.4 MB/s | 99 kB 00:00 2023-06-23T18:42:14.136 INFO:teuthology.orchestra.run.smithi158.stdout:(82/143): libverto-devel-0.3.2-2.el8.x86_64.rpm 269 kB/s | 18 kB 00:00 2023-06-23T18:42:14.178 INFO:teuthology.orchestra.run.smithi158.stdout:(83/143): libzstd-devel-1.4.4-1.el8.x86_64.rpm 658 kB/s | 44 kB 00:00 2023-06-23T18:42:14.211 INFO:teuthology.orchestra.run.smithi158.stdout:(84/143): libgfortran-8.5.0-19.el8.x86_64.rpm 1.7 MB/s | 645 kB 00:00 2023-06-23T18:42:14.247 INFO:teuthology.orchestra.run.smithi052.stdout:(129/143): NetworkManager-initscripts-updown-1. 748 kB/s | 143 kB 00:00 2023-06-23T18:42:14.279 INFO:teuthology.orchestra.run.smithi158.stdout:(85/143): pcre2-utf16-10.32-3.el8.x86_64.rpm 3.4 MB/s | 229 kB 00:00 2023-06-23T18:42:14.312 INFO:teuthology.orchestra.run.smithi158.stdout:(86/143): pcre2-devel-10.32-3.el8.x86_64.rpm 4.4 MB/s | 605 kB 00:00 2023-06-23T18:42:14.314 INFO:teuthology.orchestra.run.smithi052.stdout:(130/143): elfutils-debuginfod-client-0.189-2.e 1.1 MB/s | 76 kB 00:00 2023-06-23T18:42:14.379 INFO:teuthology.orchestra.run.smithi158.stdout:(87/143): openssl-devel-1.1.1k-9.el8.x86_64.rpm 13 MB/s | 3.2 MB 00:00 2023-06-23T18:42:14.404 INFO:teuthology.orchestra.run.smithi158.stdout:(88/143): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.7 MB/s | 220 kB 00:00 2023-06-23T18:42:14.429 INFO:teuthology.orchestra.run.smithi158.stdout:(89/143): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.1 MB/s | 249 kB 00:00 2023-06-23T18:42:14.431 INFO:teuthology.orchestra.run.smithi052.stdout:(131/143): elfutils-libelf-0.189-2.el8.x86_64.r 1.9 MB/s | 232 kB 00:00 2023-06-23T18:42:14.471 INFO:teuthology.orchestra.run.smithi158.stdout:(90/143): python3-jwt-1.6.1-2.el8.noarch.rpm 640 kB/s | 43 kB 00:00 2023-06-23T18:42:14.496 INFO:teuthology.orchestra.run.smithi158.stdout:(91/143): python3-oauthlib-2.1.0-1.el8.noarch.r 2.3 MB/s | 155 kB 00:00 2023-06-23T18:42:14.497 INFO:teuthology.orchestra.run.smithi052.stdout:(132/143): elfutils-libs-0.189-2.el8.x86_64.rpm 4.4 MB/s | 302 kB 00:00 2023-06-23T18:42:14.522 INFO:teuthology.orchestra.run.smithi158.stdout:(92/143): python3-cryptography-3.2.1-6.el8.x86_ 5.3 MB/s | 641 kB 00:00 2023-06-23T18:42:14.540 INFO:teuthology.orchestra.run.smithi052.stdout:(133/143): thrift-0.13.0-2.el8.x86_64.rpm 1.8 MB/s | 1.7 MB 00:00 2023-06-23T18:42:14.547 INFO:teuthology.orchestra.run.smithi158.stdout:(93/143): python3-pycparser-2.14-14.el8.noarch. 1.4 MB/s | 109 kB 00:00 2023-06-23T18:42:14.572 INFO:teuthology.orchestra.run.smithi158.stdout:(94/143): python3-requests-oauthlib-1.0.0-1.el8 566 kB/s | 43 kB 00:00 2023-06-23T18:42:14.598 INFO:teuthology.orchestra.run.smithi158.stdout:(95/143): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 984 kB/s | 74 kB 00:00 2023-06-23T18:42:14.615 INFO:teuthology.orchestra.run.smithi158.stdout:(96/143): zlib-devel-1.2.11-21.el8.x86_64.rpm 860 kB/s | 58 kB 00:00 2023-06-23T18:42:14.623 INFO:teuthology.orchestra.run.smithi052.stdout:(134/143): iproute-6.2.0-2.el8.x86_64.rpm 6.9 MB/s | 880 kB 00:00 2023-06-23T18:42:14.682 INFO:teuthology.orchestra.run.smithi052.stdout:(135/143): librbd1-18.0.0-4479.g8627af3e.el8.x8 3.5 MB/s | 3.6 MB 00:01 2023-06-23T18:42:14.707 INFO:teuthology.orchestra.run.smithi052.stdout:(136/143): libfdisk-2.32.1-42.el8.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2023-06-23T18:42:14.791 INFO:teuthology.orchestra.run.smithi052.stdout:(137/143): libsmartcols-2.32.1-42.el8.x86_64.rp 2.1 MB/s | 179 kB 00:00 2023-06-23T18:42:14.816 INFO:teuthology.orchestra.run.smithi052.stdout:(138/143): libblkid-2.32.1-42.el8.x86_64.rpm 797 kB/s | 220 kB 00:00 2023-06-23T18:42:14.850 INFO:teuthology.orchestra.run.smithi052.stdout:(139/143): libuuid-2.32.1-42.el8.x86_64.rpm 1.6 MB/s | 98 kB 00:00 2023-06-23T18:42:14.908 INFO:teuthology.orchestra.run.smithi052.stdout:(140/143): libmount-2.32.1-42.el8.x86_64.rpm 1.0 MB/s | 236 kB 00:00 2023-06-23T18:42:14.934 INFO:teuthology.orchestra.run.smithi052.stdout:(141/143): util-linux-user-2.32.1-42.el8.x86_64 1.2 MB/s | 102 kB 00:00 2023-06-23T18:42:15.006 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-06-23T18:42:15.010 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-06-23T18:42:15.051 INFO:teuthology.orchestra.run.smithi052.stdout:(142/143): util-linux-2.32.1-42.el8.x86_64.rpm 11 MB/s | 2.6 MB 00:00 2023-06-23T18:42:15.200 INFO:teuthology.orchestra.run.smithi158.stdout:(97/143): liboath-2.6.2-3.el8.x86_64.rpm 122 kB/s | 59 kB 00:00 2023-06-23T18:42:15.201 INFO:teuthology.orchestra.run.smithi158.stdout:(98/143): libunwind-1.3.1-3.el8.x86_64.rpm 155 kB/s | 75 kB 00:00 2023-06-23T18:42:15.201 INFO:teuthology.orchestra.run.smithi052.stdout:(143/143): xfsprogs-5.0.0-12.el8.x86_64.rpm 6.2 MB/s | 1.1 MB 00:00 2023-06-23T18:42:15.201 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2023-06-23T18:42:15.201 INFO:teuthology.orchestra.run.smithi052.stdout:Total 10 MB/s | 212 MB 00:20 2023-06-23T18:42:15.216 INFO:teuthology.orchestra.run.smithi158.stdout:(99/143): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 374 kB/s | 44 kB 00:00 2023-06-23T18:42:15.249 INFO:teuthology.orchestra.run.smithi158.stdout:(100/143): gperftools-libs-2.7-9.el8.x86_64.rpm 453 kB/s | 306 kB 00:00 2023-06-23T18:42:15.358 INFO:teuthology.orchestra.run.smithi158.stdout:(101/143): python3-cachetools-3.1.1-4.el8.noarc 304 kB/s | 33 kB 00:00 2023-06-23T18:42:15.392 INFO:teuthology.orchestra.run.smithi158.stdout:(102/143): python3-asyncssh-2.7.0-2.el8.noarch. 1.5 MB/s | 476 kB 00:00 2023-06-23T18:42:15.417 INFO:teuthology.orchestra.run.smithi158.stdout:(103/143): python3-beautifulsoup4-4.6.3-2.el8.1 922 kB/s | 185 kB 00:00 2023-06-23T18:42:15.475 INFO:teuthology.orchestra.run.smithi158.stdout:(104/143): python3-certifi-2018.10.15-7.el8.noa 139 kB/s | 16 kB 00:00 2023-06-23T18:42:15.509 INFO:teuthology.orchestra.run.smithi158.stdout:(105/143): python3-cheroot-8.5.2-1.el8.noarch.r 1.4 MB/s | 173 kB 00:00 2023-06-23T18:42:15.618 INFO:teuthology.orchestra.run.smithi158.stdout:(106/143): python3-google-auth-1.1.1-10.el8.noa 572 kB/s | 81 kB 00:00 2023-06-23T18:42:15.660 INFO:teuthology.orchestra.run.smithi158.stdout:(107/143): python3-jaraco-6.2-6.el8.noarch.rpm 74 kB/s | 11 kB 00:00 2023-06-23T18:42:15.685 INFO:teuthology.orchestra.run.smithi158.stdout:(108/143): python3-cherrypy-18.4.0-1.el8.noarch 1.4 MB/s | 384 kB 00:00 2023-06-23T18:42:15.735 INFO:teuthology.orchestra.run.smithi158.stdout:(109/143): python3-jaraco-functools-2.0-4.el8.n 150 kB/s | 18 kB 00:00 2023-06-23T18:42:15.811 INFO:teuthology.orchestra.run.smithi158.stdout:(110/143): python3-logutils-0.3.5-11.el8.noarch 388 kB/s | 49 kB 00:00 2023-06-23T18:42:15.852 INFO:teuthology.orchestra.run.smithi158.stdout:(111/143): python3-more-itertools-7.2.0-3.el8.n 502 kB/s | 59 kB 00:00 2023-06-23T18:42:15.894 INFO:teuthology.orchestra.run.smithi158.stdout:(112/143): python3-kubernetes-11.0.0-6.el8.noar 5.0 MB/s | 1.2 MB 00:00 2023-06-23T18:42:15.928 INFO:teuthology.orchestra.run.smithi158.stdout:(113/143): python3-natsort-7.1.1-2.el8.noarch.r 514 kB/s | 60 kB 00:00 2023-06-23T18:42:16.012 INFO:teuthology.orchestra.run.smithi158.stdout:(114/143): python3-portend-2.6-1.el8.noarch.rpm 133 kB/s | 16 kB 00:00 2023-06-23T18:42:16.038 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2023-06-23T18:42:16.054 INFO:teuthology.orchestra.run.smithi158.stdout:(115/143): python3-repoze-lru-0.7-6.el8.noarch. 268 kB/s | 34 kB 00:00 2023-06-23T18:42:16.079 INFO:teuthology.orchestra.run.smithi158.stdout:(116/143): python3-pecan-1.3.2-9.el8.noarch.rpm 1.2 MB/s | 283 kB 00:00 2023-06-23T18:42:16.213 INFO:teuthology.orchestra.run.smithi158.stdout:(117/143): python3-routes-2.4.1-12.el8.noarch.r 979 kB/s | 196 kB 00:00 2023-06-23T18:42:16.238 INFO:teuthology.orchestra.run.smithi158.stdout:(118/143): python3-simplegeneric-0.8.1-17.el8.n 118 kB/s | 19 kB 00:00 2023-06-23T18:42:16.263 INFO:teuthology.orchestra.run.smithi158.stdout:(119/143): python3-rsa-4.8-1.el8.noarch.rpm 294 kB/s | 61 kB 00:00 2023-06-23T18:42:16.330 INFO:teuthology.orchestra.run.smithi158.stdout:(120/143): python3-singledispatch-3.4.0.3-18.el 204 kB/s | 24 kB 00:00 2023-06-23T18:42:16.364 INFO:teuthology.orchestra.run.smithi158.stdout:(121/143): python3-tempora-1.14.1-5.el8.noarch. 233 kB/s | 29 kB 00:00 2023-06-23T18:42:16.389 INFO:teuthology.orchestra.run.smithi158.stdout:(122/143): python3-trustme-0.6.0-4.el8.noarch.r 219 kB/s | 27 kB 00:00 2023-06-23T18:42:16.425 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2023-06-23T18:42:16.426 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2023-06-23T18:42:16.465 INFO:teuthology.orchestra.run.smithi158.stdout:(123/143): python3-waitress-1.4.3-1.el8.noarch. 1.9 MB/s | 255 kB 00:00 2023-06-23T18:42:16.490 INFO:teuthology.orchestra.run.smithi158.stdout:(124/143): python3-webob-1.8.5-1.el8.1.noarch.r 2.0 MB/s | 251 kB 00:00 2023-06-23T18:42:16.515 INFO:teuthology.orchestra.run.smithi158.stdout:(125/143): python3-websocket-client-0.56.0-5.el 487 kB/s | 61 kB 00:00 2023-06-23T18:42:16.574 INFO:teuthology.orchestra.run.smithi158.stdout:(126/143): python3-webtest-2.0.33-1.el8.noarch. 787 kB/s | 85 kB 00:00 2023-06-23T18:42:16.599 INFO:teuthology.orchestra.run.smithi158.stdout:(127/143): python3-zc-lockfile-2.0-2.el8.noarch 211 kB/s | 23 kB 00:00 2023-06-23T18:42:16.833 INFO:teuthology.orchestra.run.smithi158.stdout:(128/143): thrift-0.13.0-2.el8.x86_64.rpm 5.5 MB/s | 1.7 MB 00:00 2023-06-23T18:42:17.016 INFO:teuthology.orchestra.run.smithi158.stdout:(129/143): librados2-18.0.0-4479.g8627af3e.el8. 8.3 MB/s | 3.7 MB 00:00 2023-06-23T18:42:17.042 INFO:teuthology.orchestra.run.smithi158.stdout:(130/143): NetworkManager-initscripts-updown-1. 688 kB/s | 143 kB 00:00 2023-06-23T18:42:17.150 INFO:teuthology.orchestra.run.smithi158.stdout:(131/143): elfutils-libelf-0.189-2.el8.x86_64.r 2.1 MB/s | 232 kB 00:00 2023-06-23T18:42:17.176 INFO:teuthology.orchestra.run.smithi158.stdout:(132/143): elfutils-debuginfod-client-0.189-2.e 478 kB/s | 76 kB 00:00 2023-06-23T18:42:17.251 INFO:teuthology.orchestra.run.smithi158.stdout:(133/143): librbd1-18.0.0-4479.g8627af3e.el8.x8 5.5 MB/s | 3.6 MB 00:00 2023-06-23T18:42:17.276 INFO:teuthology.orchestra.run.smithi158.stdout:(134/143): elfutils-libs-0.189-2.el8.x86_64.rpm 2.4 MB/s | 302 kB 00:00 2023-06-23T18:42:17.351 INFO:teuthology.orchestra.run.smithi158.stdout:(135/143): libfdisk-2.32.1-42.el8.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2023-06-23T18:42:17.385 INFO:teuthology.orchestra.run.smithi158.stdout:(136/143): iproute-6.2.0-2.el8.x86_64.rpm 4.1 MB/s | 880 kB 00:00 2023-06-23T18:42:17.427 INFO:teuthology.orchestra.run.smithi158.stdout:(137/143): libmount-2.32.1-42.el8.x86_64.rpm 3.1 MB/s | 236 kB 00:00 2023-06-23T18:42:17.452 INFO:teuthology.orchestra.run.smithi158.stdout:(138/143): libsmartcols-2.32.1-42.el8.x86_64.rp 2.6 MB/s | 179 kB 00:00 2023-06-23T18:42:17.478 INFO:teuthology.orchestra.run.smithi158.stdout:(139/143): libblkid-2.32.1-42.el8.x86_64.rpm 973 kB/s | 220 kB 00:00 2023-06-23T18:42:17.503 INFO:teuthology.orchestra.run.smithi158.stdout:(140/143): libuuid-2.32.1-42.el8.x86_64.rpm 1.3 MB/s | 98 kB 00:00 2023-06-23T18:42:17.545 INFO:teuthology.orchestra.run.smithi158.stdout:(141/143): util-linux-user-2.32.1-42.el8.x86_64 1.5 MB/s | 102 kB 00:00 2023-06-23T18:42:17.628 INFO:teuthology.orchestra.run.smithi158.stdout:(142/143): util-linux-2.32.1-42.el8.x86_64.rpm 15 MB/s | 2.6 MB 00:00 2023-06-23T18:42:17.654 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2023-06-23T18:42:17.658 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2023-06-23T18:42:17.662 INFO:teuthology.orchestra.run.smithi158.stdout:(143/143): xfsprogs-5.0.0-12.el8.x86_64.rpm 6.8 MB/s | 1.1 MB 00:00 2023-06-23T18:42:17.667 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2023-06-23T18:42:17.667 INFO:teuthology.orchestra.run.smithi158.stdout:Total 9.6 MB/s | 212 MB 00:21 2023-06-23T18:42:19.449 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-06-23T18:42:19.864 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-06-23T18:42:19.865 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-06-23T18:42:20.652 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-06-23T18:42:20.829 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-06-23T18:42:21.013 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/158 2023-06-23T18:42:21.184 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/158 2023-06-23T18:42:21.262 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/158 2023-06-23T18:42:21.423 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-06-23T18:42:21.427 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-06-23T18:42:21.442 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/158 2023-06-23T18:42:21.549 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/158 2023-06-23T18:42:21.733 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/158 2023-06-23T18:42:21.947 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/158 2023-06-23T18:42:22.155 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 6/158 2023-06-23T18:42:22.367 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/158 2023-06-23T18:42:22.760 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/158 2023-06-23T18:42:22.967 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librados2-2:18.0.0-4479.g8627af3e.el8.x86_64 8/158 2023-06-23T18:42:23.304 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2023-06-23T18:42:23.391 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:18.0.0-4479.g8627af3e.el8.x86_64 8/158 2023-06-23T18:42:23.492 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-06-23T18:42:23.609 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librbd1-2:18.0.0-4479.g8627af3e.el8.x86_64 9/158 2023-06-23T18:42:23.734 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:18.0.0-4479.g8627af3e.el8.x86_64 9/158 2023-06-23T18:42:23.869 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/158 2023-06-23T18:42:23.909 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs2-2:18.0.0-4479.g8627af3e.el8.x86_64 10/158 2023-06-23T18:42:23.988 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs2-2:18.0.0-4479.g8627af3e.el8.x86_64 10/158 2023-06-23T18:42:24.015 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/158 2023-06-23T18:42:24.120 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/158 2023-06-23T18:42:24.257 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rados-2:18.0.0-4479.g8627af3e.el8.x86_64 11/158 2023-06-23T18:42:24.281 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/158 2023-06-23T18:42:24.339 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/158 2023-06-23T18:42:24.463 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/158 2023-06-23T18:42:24.526 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/158 2023-06-23T18:42:24.583 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/158 2023-06-23T18:42:24.768 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/158 2023-06-23T18:42:24.845 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/158 2023-06-23T18:42:25.015 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 14/158 2023-06-23T18:42:25.056 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 6/158 2023-06-23T18:42:25.298 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/158 2023-06-23T18:42:25.435 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libpq-13.5-1.el8.x86_64 15/158 2023-06-23T18:42:25.720 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 16/158 2023-06-23T18:42:25.725 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/158 2023-06-23T18:42:25.875 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephsqlite-2:18.0.0-4479.g8627af3e.el8.x86_64 17/158 2023-06-23T18:42:25.914 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librados2-2:18.0.0-4479.g8627af3e.el8.x86_64 8/158 2023-06-23T18:42:25.963 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4479.g8627af3e.el8.x86_64 17/158 2023-06-23T18:42:26.125 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libradosstriper1-2:18.0.0-4479.g8627af3e.el8.x86 18/158 2023-06-23T18:42:26.292 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4479.g8627af3e.el8.x86 18/158 2023-06-23T18:42:26.350 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:18.0.0-4479.g8627af3e.el8.x86_64 8/158 2023-06-23T18:42:26.564 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librbd1-2:18.0.0-4479.g8627af3e.el8.x86_64 9/158 2023-06-23T18:42:26.606 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 19/158 2023-06-23T18:42:26.683 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:18.0.0-4479.g8627af3e.el8.x86_64 9/158 2023-06-23T18:42:26.712 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-06-23T18:42:26.726 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 19/158 2023-06-23T18:42:26.889 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs2-2:18.0.0-4479.g8627af3e.el8.x86_64 10/158 2023-06-23T18:42:26.939 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/158 2023-06-23T18:42:26.944 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-06-23T18:42:26.970 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephfs2-2:18.0.0-4479.g8627af3e.el8.x86_64 10/158 2023-06-23T18:42:27.123 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/158 2023-06-23T18:42:27.147 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/158 2023-06-23T18:42:27.248 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rados-2:18.0.0-4479.g8627af3e.el8.x86_64 11/158 2023-06-23T18:42:27.259 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/158 2023-06-23T18:42:27.291 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libquadmath-8.5.0-19.el8.x86_64 22/158 2023-06-23T18:42:27.356 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/158 2023-06-23T18:42:27.403 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libquadmath-8.5.0-19.el8.x86_64 22/158 2023-06-23T18:42:27.472 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/158 2023-06-23T18:42:27.534 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/158 2023-06-23T18:42:27.548 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/158 2023-06-23T18:42:27.621 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/158 2023-06-23T18:42:27.683 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libgfortran-8.5.0-19.el8.x86_64 23/158 2023-06-23T18:42:27.796 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/158 2023-06-23T18:42:27.855 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/158 2023-06-23T18:42:28.024 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 14/158 2023-06-23T18:42:28.098 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/158 2023-06-23T18:42:28.267 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libgfortran-8.5.0-19.el8.x86_64 23/158 2023-06-23T18:42:28.330 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 6/158 2023-06-23T18:42:28.443 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libpq-13.5-1.el8.x86_64 15/158 2023-06-23T18:42:28.458 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/158 2023-06-23T18:42:28.501 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/158 2023-06-23T18:42:28.785 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 16/158 2023-06-23T18:42:28.945 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/158 2023-06-23T18:42:29.064 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/158 2023-06-23T18:42:29.192 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : librados2-2:18.0.0-4479.g8627af3e.el8.x86_64 8/158 2023-06-23T18:42:29.197 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephsqlite-2:18.0.0-4479.g8627af3e.el8.x86_64 17/158 2023-06-23T18:42:29.233 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/158 2023-06-23T18:42:29.288 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4479.g8627af3e.el8.x86_64 17/158 2023-06-23T18:42:29.489 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libradosstriper1-2:18.0.0-4479.g8627af3e.el8.x86 18/158 2023-06-23T18:42:29.617 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librados2-2:18.0.0-4479.g8627af3e.el8.x86_64 8/158 2023-06-23T18:42:29.667 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4479.g8627af3e.el8.x86 18/158 2023-06-23T18:42:29.800 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : librbd1-2:18.0.0-4479.g8627af3e.el8.x86_64 9/158 2023-06-23T18:42:29.926 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 19/158 2023-06-23T18:42:29.948 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librbd1-2:18.0.0-4479.g8627af3e.el8.x86_64 9/158 2023-06-23T18:42:29.961 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/158 2023-06-23T18:42:30.052 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 19/158 2023-06-23T18:42:30.150 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libcephfs2-2:18.0.0-4479.g8627af3e.el8.x86_64 10/158 2023-06-23T18:42:30.259 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libcephfs2-2:18.0.0-4479.g8627af3e.el8.x86_64 10/158 2023-06-23T18:42:30.304 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/158 2023-06-23T18:42:30.335 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/158 2023-06-23T18:42:30.445 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/158 2023-06-23T18:42:30.478 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-rados-2:18.0.0-4479.g8627af3e.el8.x86_64 11/158 2023-06-23T18:42:30.597 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/158 2023-06-23T18:42:30.630 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libquadmath-8.5.0-19.el8.x86_64 22/158 2023-06-23T18:42:30.675 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/158 2023-06-23T18:42:30.761 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/158 2023-06-23T18:42:30.784 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libquadmath-8.5.0-19.el8.x86_64 22/158 2023-06-23T18:42:30.803 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/158 2023-06-23T18:42:30.989 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libgfortran-8.5.0-19.el8.x86_64 23/158 2023-06-23T18:42:31.001 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/158 2023-06-23T18:42:31.003 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/158 2023-06-23T18:42:31.211 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 14/158 2023-06-23T18:42:31.247 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-common-2:18.0.0-4479.g8627af3e.el8. 30/158 2023-06-23T18:42:31.377 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-argparse-2:18.0.0-4479.g8627af3e.el 31/158 2023-06-23T18:42:31.617 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libgfortran-8.5.0-19.el8.x86_64 23/158 2023-06-23T18:42:31.670 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cephfs-2:18.0.0-4479.g8627af3e.el8.x86_6 32/158 2023-06-23T18:42:31.672 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libpq-13.5-1.el8.x86_64 15/158 2023-06-23T18:42:31.805 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/158 2023-06-23T18:42:31.914 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 16/158 2023-06-23T18:42:32.059 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libcephsqlite-2:18.0.0-4479.g8627af3e.el8.x86_64 17/158 2023-06-23T18:42:32.182 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4479.g8627af3e.el8.x86_64 17/158 2023-06-23T18:42:32.358 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libradosstriper1-2:18.0.0-4479.g8627af3e.el8.x86 18/158 2023-06-23T18:42:32.442 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/158 2023-06-23T18:42:32.601 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4479.g8627af3e.el8.x86 18/158 2023-06-23T18:42:32.605 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/158 2023-06-23T18:42:32.671 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/158 2023-06-23T18:42:32.825 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 19/158 2023-06-23T18:42:32.977 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 19/158 2023-06-23T18:42:32.992 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/158 2023-06-23T18:42:33.232 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/158 2023-06-23T18:42:33.254 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/158 2023-06-23T18:42:33.336 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/158 2023-06-23T18:42:33.388 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/158 2023-06-23T18:42:33.466 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/158 2023-06-23T18:42:33.508 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libquadmath-8.5.0-19.el8.x86_64 22/158 2023-06-23T18:42:33.643 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libquadmath-8.5.0-19.el8.x86_64 22/158 2023-06-23T18:42:33.714 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/158 2023-06-23T18:42:33.800 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libgfortran-8.5.0-19.el8.x86_64 23/158 2023-06-23T18:42:33.979 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/158 2023-06-23T18:42:34.177 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/158 2023-06-23T18:42:34.407 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/158 2023-06-23T18:42:34.475 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libgfortran-8.5.0-19.el8.x86_64 23/158 2023-06-23T18:42:34.629 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-common-2:18.0.0-4479.g8627af3e.el8. 30/158 2023-06-23T18:42:34.666 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/158 2023-06-23T18:42:34.768 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-argparse-2:18.0.0-4479.g8627af3e.el 31/158 2023-06-23T18:42:34.997 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cephfs-2:18.0.0-4479.g8627af3e.el8.x86_6 32/158 2023-06-23T18:42:35.220 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/158 2023-06-23T18:42:35.364 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/158 2023-06-23T18:42:35.511 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/158 2023-06-23T18:42:35.556 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/158 2023-06-23T18:42:35.733 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/158 2023-06-23T18:42:35.992 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/158 2023-06-23T18:42:36.001 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/158 2023-06-23T18:42:36.171 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rbd-2:18.0.0-4479.g8627af3e.el8.x86_64 40/158 2023-06-23T18:42:36.363 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/158 2023-06-23T18:42:36.380 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librados-devel-2:18.0.0-4479.g8627af3e.el8.x86_6 41/158 2023-06-23T18:42:36.410 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/158 2023-06-23T18:42:36.557 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/158 2023-06-23T18:42:36.665 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/158 2023-06-23T18:42:36.768 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/158 2023-06-23T18:42:36.770 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/158 2023-06-23T18:42:36.863 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/158 2023-06-23T18:42:36.965 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/158 2023-06-23T18:42:36.967 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/158 2023-06-23T18:42:37.053 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/158 2023-06-23T18:42:37.140 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/158 2023-06-23T18:42:37.232 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/158 2023-06-23T18:42:37.297 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/158 2023-06-23T18:42:37.338 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/158 2023-06-23T18:42:37.475 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/158 2023-06-23T18:42:37.557 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-ceph-common-2:18.0.0-4479.g8627af3e.el8. 30/158 2023-06-23T18:42:37.657 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/158 2023-06-23T18:42:37.688 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-ceph-argparse-2:18.0.0-4479.g8627af3e.el 31/158 2023-06-23T18:42:37.935 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cephfs-2:18.0.0-4479.g8627af3e.el8.x86_6 32/158 2023-06-23T18:42:38.268 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/158 2023-06-23T18:42:38.707 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/158 2023-06-23T18:42:38.723 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/158 2023-06-23T18:42:38.728 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/158 2023-06-23T18:42:38.927 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/158 2023-06-23T18:42:38.995 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/158 2023-06-23T18:42:39.024 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/158 2023-06-23T18:42:39.185 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/158 2023-06-23T18:42:39.208 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/158 2023-06-23T18:42:39.365 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/158 2023-06-23T18:42:39.447 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/158 2023-06-23T18:42:39.450 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/158 2023-06-23T18:42:39.611 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rbd-2:18.0.0-4479.g8627af3e.el8.x86_64 40/158 2023-06-23T18:42:39.633 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/158 2023-06-23T18:42:39.687 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/158 2023-06-23T18:42:39.792 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/158 2023-06-23T18:42:39.821 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librados-devel-2:18.0.0-4479.g8627af3e.el8.x86_6 41/158 2023-06-23T18:42:39.891 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/158 2023-06-23T18:42:39.991 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/158 2023-06-23T18:42:39.995 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/158 2023-06-23T18:42:40.187 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/158 2023-06-23T18:42:40.194 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/158 2023-06-23T18:42:40.412 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/158 2023-06-23T18:42:40.428 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/158 2023-06-23T18:42:40.498 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/158 2023-06-23T18:42:40.601 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/158 2023-06-23T18:42:40.704 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/158 2023-06-23T18:42:40.776 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/158 2023-06-23T18:42:40.813 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/158 2023-06-23T18:42:40.933 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/158 2023-06-23T18:42:40.995 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/158 2023-06-23T18:42:41.112 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/158 2023-06-23T18:42:41.212 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/158 2023-06-23T18:42:41.382 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/158 2023-06-23T18:42:41.567 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/158 2023-06-23T18:42:41.590 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/158 2023-06-23T18:42:41.792 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/158 2023-06-23T18:42:41.855 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/158 2023-06-23T18:42:41.871 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/158 2023-06-23T18:42:41.985 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/158 2023-06-23T18:42:42.074 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/158 2023-06-23T18:42:42.093 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/158 2023-06-23T18:42:42.288 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/158 2023-06-23T18:42:42.319 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/158 2023-06-23T18:42:42.321 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/158 2023-06-23T18:42:42.499 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/158 2023-06-23T18:42:42.561 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/158 2023-06-23T18:42:42.646 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/158 2023-06-23T18:42:42.688 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/158 2023-06-23T18:42:42.709 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/158 2023-06-23T18:42:42.882 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/158 2023-06-23T18:42:42.882 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-rbd-2:18.0.0-4479.g8627af3e.el8.x86_64 40/158 2023-06-23T18:42:42.892 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/158 2023-06-23T18:42:43.060 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : librados-devel-2:18.0.0-4479.g8627af3e.el8.x86_6 41/158 2023-06-23T18:42:43.086 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/158 2023-06-23T18:42:43.106 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/158 2023-06-23T18:42:43.228 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/158 2023-06-23T18:42:43.313 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/158 2023-06-23T18:42:43.401 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/158 2023-06-23T18:42:43.486 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/158 2023-06-23T18:42:43.623 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/158 2023-06-23T18:42:43.683 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/158 2023-06-23T18:42:43.720 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/158 2023-06-23T18:42:43.828 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/158 2023-06-23T18:42:43.890 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/158 2023-06-23T18:42:43.906 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/158 2023-06-23T18:42:43.987 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/158 2023-06-23T18:42:44.043 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/158 2023-06-23T18:42:44.105 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librgw2-2:18.0.0-4479.g8627af3e.el8.x86_64 70/158 2023-06-23T18:42:44.128 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/158 2023-06-23T18:42:44.178 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librgw2-2:18.0.0-4479.g8627af3e.el8.x86_64 70/158 2023-06-23T18:42:44.211 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/158 2023-06-23T18:42:44.307 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/158 2023-06-23T18:42:44.376 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rgw-2:18.0.0-4479.g8627af3e.el8.x86_64 71/158 2023-06-23T18:42:44.422 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/158 2023-06-23T18:42:44.597 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/158 2023-06-23T18:42:44.658 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/158 2023-06-23T18:42:44.843 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/158 2023-06-23T18:42:44.900 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/158 2023-06-23T18:42:45.045 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/158 2023-06-23T18:42:45.083 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/158 2023-06-23T18:42:45.174 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/158 2023-06-23T18:42:45.203 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/158 2023-06-23T18:42:45.285 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/158 2023-06-23T18:42:45.308 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/158 2023-06-23T18:42:45.398 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/158 2023-06-23T18:42:45.507 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/158 2023-06-23T18:42:45.639 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/158 2023-06-23T18:42:45.650 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/158 2023-06-23T18:42:45.751 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/158 2023-06-23T18:42:45.856 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/158 2023-06-23T18:42:45.888 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/158 2023-06-23T18:42:46.012 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/158 2023-06-23T18:42:46.018 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/158 2023-06-23T18:42:46.064 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/158 2023-06-23T18:42:46.169 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/158 2023-06-23T18:42:46.355 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/158 2023-06-23T18:42:46.539 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/158 2023-06-23T18:42:46.762 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/158 2023-06-23T18:42:46.910 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/158 2023-06-23T18:42:46.960 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/158 2023-06-23T18:42:47.088 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/158 2023-06-23T18:42:47.113 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/158 2023-06-23T18:42:47.136 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librgw2-2:18.0.0-4479.g8627af3e.el8.x86_64 70/158 2023-06-23T18:42:47.209 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librgw2-2:18.0.0-4479.g8627af3e.el8.x86_64 70/158 2023-06-23T18:42:47.288 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/158 2023-06-23T18:42:47.431 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/158 2023-06-23T18:42:47.453 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rgw-2:18.0.0-4479.g8627af3e.el8.x86_64 71/158 2023-06-23T18:42:47.472 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/158 2023-06-23T18:42:47.638 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/158 2023-06-23T18:42:47.668 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/158 2023-06-23T18:42:47.677 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/158 2023-06-23T18:42:47.845 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/158 2023-06-23T18:42:47.903 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/158 2023-06-23T18:42:48.070 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/158 2023-06-23T18:42:48.094 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/158 2023-06-23T18:42:48.144 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/158 2023-06-23T18:42:48.300 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/158 2023-06-23T18:42:48.347 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/158 2023-06-23T18:42:48.381 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/158 2023-06-23T18:42:48.507 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/158 2023-06-23T18:42:48.568 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/158 2023-06-23T18:42:48.624 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/158 2023-06-23T18:42:48.722 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/158 2023-06-23T18:42:48.895 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/158 2023-06-23T18:42:48.904 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/158 2023-06-23T18:42:48.969 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/158 2023-06-23T18:42:49.199 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/158 2023-06-23T18:42:49.213 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/158 2023-06-23T18:42:49.395 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/158 2023-06-23T18:42:49.443 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/158 2023-06-23T18:42:49.615 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/158 2023-06-23T18:42:49.776 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/158 2023-06-23T18:42:50.103 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/158 2023-06-23T18:42:50.144 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/158 2023-06-23T18:42:50.219 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/158 2023-06-23T18:42:50.384 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/158 2023-06-23T18:42:50.405 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : librgw2-2:18.0.0-4479.g8627af3e.el8.x86_64 70/158 2023-06-23T18:42:50.499 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librgw2-2:18.0.0-4479.g8627af3e.el8.x86_64 70/158 2023-06-23T18:42:50.525 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/158 2023-06-23T18:42:50.529 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/158 2023-06-23T18:42:50.717 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-rgw-2:18.0.0-4479.g8627af3e.el8.x86_64 71/158 2023-06-23T18:42:50.719 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/158 2023-06-23T18:42:50.753 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/158 2023-06-23T18:42:50.942 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/158 2023-06-23T18:42:50.947 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/158 2023-06-23T18:42:50.981 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/158 2023-06-23T18:42:51.223 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/158 2023-06-23T18:42:51.272 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/158 2023-06-23T18:42:51.343 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/158 2023-06-23T18:42:51.414 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/158 2023-06-23T18:42:51.505 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/158 2023-06-23T18:42:51.605 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/158 2023-06-23T18:42:51.645 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/158 2023-06-23T18:42:51.707 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/158 2023-06-23T18:42:51.744 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/158 2023-06-23T18:42:51.795 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/158 2023-06-23T18:42:51.958 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/158 2023-06-23T18:42:51.980 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/158 2023-06-23T18:42:52.118 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/158 2023-06-23T18:42:52.130 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/158 2023-06-23T18:42:52.272 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/158 2023-06-23T18:42:52.366 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/158 2023-06-23T18:42:52.467 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/158 2023-06-23T18:42:52.655 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/158 2023-06-23T18:42:52.830 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/158 2023-06-23T18:42:53.170 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/158 2023-06-23T18:42:53.415 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/158 2023-06-23T18:42:53.526 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/158 2023-06-23T18:42:53.646 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/158 2023-06-23T18:42:53.734 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/158 2023-06-23T18:42:53.947 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/158 2023-06-23T18:42:54.019 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/158 2023-06-23T18:42:54.214 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/158 2023-06-23T18:42:54.215 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/158 2023-06-23T18:42:54.422 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/158 2023-06-23T18:42:54.465 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/158 2023-06-23T18:42:54.630 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/158 2023-06-23T18:42:54.734 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/158 2023-06-23T18:42:54.767 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/158 2023-06-23T18:42:54.776 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 100/158 2023-06-23T18:42:54.992 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/158 2023-06-23T18:42:54.996 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 100/158 2023-06-23T18:42:55.021 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/158 2023-06-23T18:42:55.144 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/158 2023-06-23T18:42:55.193 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/158 2023-06-23T18:42:55.379 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/158 2023-06-23T18:42:55.573 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 100/158 2023-06-23T18:42:55.689 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/158 2023-06-23T18:42:55.898 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-base-2:18.0.0-4479.g8627af3e.el8.x86_64 101/158 2023-06-23T18:42:55.919 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/158 2023-06-23T18:42:55.971 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-base-2:18.0.0-4479.g8627af3e.el8.x86_64 101/158 2023-06-23T18:42:56.078 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/158 2023-06-23T18:42:56.121 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-selinux-2:18.0.0-4479.g8627af3e.el8.x86_64 102/158 2023-06-23T18:42:56.263 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/158 2023-06-23T18:42:56.591 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/158 2023-06-23T18:42:56.809 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/158 2023-06-23T18:42:56.954 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/158 2023-06-23T18:42:57.251 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/158 2023-06-23T18:42:57.692 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/158 2023-06-23T18:42:57.891 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 100/158 2023-06-23T18:42:57.906 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/158 2023-06-23T18:42:58.102 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/158 2023-06-23T18:42:58.161 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 100/158 2023-06-23T18:42:58.270 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/158 2023-06-23T18:42:58.394 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/158 2023-06-23T18:42:58.565 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/158 2023-06-23T18:42:58.705 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/158 2023-06-23T18:42:58.778 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 100/158 2023-06-23T18:42:59.094 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-base-2:18.0.0-4479.g8627af3e.el8.x86_64 101/158 2023-06-23T18:42:59.165 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-base-2:18.0.0-4479.g8627af3e.el8.x86_64 101/158 2023-06-23T18:42:59.352 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-selinux-2:18.0.0-4479.g8627af3e.el8.x86_64 102/158 2023-06-23T18:43:01.623 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 100/158 2023-06-23T18:43:01.879 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 100/158 2023-06-23T18:43:02.553 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 100/158 2023-06-23T18:43:03.308 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-base-2:18.0.0-4479.g8627af3e.el8.x86_64 101/158 2023-06-23T18:43:03.439 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-base-2:18.0.0-4479.g8627af3e.el8.x86_64 101/158 2023-06-23T18:43:03.602 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-selinux-2:18.0.0-4479.g8627af3e.el8.x86_64 102/158 2023-06-23T18:43:14.986 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4479.g8627af3e.el8.x86_64 102/158 2023-06-23T18:43:14.986 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /sys 2023-06-23T18:43:14.986 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /proc 2023-06-23T18:43:14.986 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /dev 2023-06-23T18:43:14.986 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /run 2023-06-23T18:43:14.987 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /mnt 2023-06-23T18:43:14.987 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /var/tmp 2023-06-23T18:43:14.987 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /home 2023-06-23T18:43:14.987 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /tmp 2023-06-23T18:43:14.987 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /dev 2023-06-23T18:43:14.987 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:15.368 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-volume-2:18.0.0-4479.g8627af3e.el8.noarch 103/158 2023-06-23T18:43:16.930 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-volume-2:18.0.0-4479.g8627af3e.el8.noarch 103/158 2023-06-23T18:43:17.161 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-osd-2:18.0.0-4479.g8627af3e.el8.x86_64 104/158 2023-06-23T18:43:17.379 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-osd-2:18.0.0-4479.g8627af3e.el8.x86_64 104/158 2023-06-23T18:43:17.559 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mds-2:18.0.0-4479.g8627af3e.el8.x86_64 105/158 2023-06-23T18:43:18.014 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mds-2:18.0.0-4479.g8627af3e.el8.x86_64 105/158 2023-06-23T18:43:18.209 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mon-2:18.0.0-4479.g8627af3e.el8.x86_64 106/158 2023-06-23T18:43:18.233 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mon-2:18.0.0-4479.g8627af3e.el8.x86_64 106/158 2023-06-23T18:43:18.432 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/158 2023-06-23T18:43:18.628 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/158 2023-06-23T18:43:18.817 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/158 2023-06-23T18:43:18.896 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/158 2023-06-23T18:43:19.100 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4479.g8627af3e.el8.x86_64 102/158 2023-06-23T18:43:19.100 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /sys 2023-06-23T18:43:19.100 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /proc 2023-06-23T18:43:19.101 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /dev 2023-06-23T18:43:19.101 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /run 2023-06-23T18:43:19.101 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /mnt 2023-06-23T18:43:19.101 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /var/tmp 2023-06-23T18:43:19.101 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /home 2023-06-23T18:43:19.101 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /tmp 2023-06-23T18:43:19.101 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /dev 2023-06-23T18:43:19.102 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:19.169 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : jq-1.6-7.el8.x86_64 110/158 2023-06-23T18:43:19.376 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : automake-1.16.1-7.el8.noarch 111/158 2023-06-23T18:43:19.491 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-volume-2:18.0.0-4479.g8627af3e.el8.noarch 103/158 2023-06-23T18:43:19.955 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:18.0.0-4479.g8627af3e.el8.noarch 112/158 2023-06-23T18:43:20.121 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephadm-2:18.0.0-4479.g8627af3e.el8.noarch 112/158 2023-06-23T18:43:20.273 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4479.g8627af3e.e 113/158 2023-06-23T18:43:20.456 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4479.g8627af3e. 114/158 2023-06-23T18:43:20.692 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4479.g8627af3e.el8.noa 115/158 2023-06-23T18:43:20.904 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4479.g8627af3e.el8.noa 115/158 2023-06-23T18:43:21.144 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4479.g8627af3e.el8.n 116/158 2023-06-23T18:43:21.155 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-volume-2:18.0.0-4479.g8627af3e.el8.noarch 103/158 2023-06-23T18:43:21.383 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-osd-2:18.0.0-4479.g8627af3e.el8.x86_64 104/158 2023-06-23T18:43:21.615 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-osd-2:18.0.0-4479.g8627af3e.el8.x86_64 104/158 2023-06-23T18:43:21.941 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mds-2:18.0.0-4479.g8627af3e.el8.x86_64 105/158 2023-06-23T18:43:22.106 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4479.g8627af3e.el8.n 116/158 2023-06-23T18:43:22.283 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4479.g862 117/158 2023-06-23T18:43:22.376 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4479.g862 117/158 2023-06-23T18:43:22.427 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mds-2:18.0.0-4479.g8627af3e.el8.x86_64 105/158 2023-06-23T18:43:22.708 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mon-2:18.0.0-4479.g8627af3e.el8.x86_64 106/158 2023-06-23T18:43:22.733 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mon-2:18.0.0-4479.g8627af3e.el8.x86_64 106/158 2023-06-23T18:43:22.754 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4479.g8627af3e.el 118/158 2023-06-23T18:43:22.948 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/158 2023-06-23T18:43:23.010 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-2:18.0.0-4479.g8627af3e.el8.x86_64 119/158 2023-06-23T18:43:23.046 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4479.g8627af3e.el8.x86_64 119/158 2023-06-23T18:43:23.128 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/158 2023-06-23T18:43:23.241 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-rook-2:18.0.0-4479.g8627af3e.el8.noarch 120/158 2023-06-23T18:43:23.249 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/158 2023-06-23T18:43:23.253 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4479.g8627af3e.el8.noarch 120/158 2023-06-23T18:43:23.352 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/158 2023-06-23T18:43:23.427 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-2:18.0.0-4479.g8627af3e.el8.x86_64 121/158 2023-06-23T18:43:23.622 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : jq-1.6-7.el8.x86_64 110/158 2023-06-23T18:43:23.624 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/158 2023-06-23T18:43:23.983 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : automake-1.16.1-7.el8.noarch 111/158 2023-06-23T18:43:24.298 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4479.g8627af3e.el8.x86_64 102/158 2023-06-23T18:43:24.298 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /sys 2023-06-23T18:43:24.299 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /proc 2023-06-23T18:43:24.299 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /dev 2023-06-23T18:43:24.299 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /run 2023-06-23T18:43:24.299 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /mnt 2023-06-23T18:43:24.299 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /var/tmp 2023-06-23T18:43:24.299 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /home 2023-06-23T18:43:24.299 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /tmp 2023-06-23T18:43:24.300 INFO:teuthology.orchestra.run.smithi158.stdout:skipping the directory /dev 2023-06-23T18:43:24.300 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:24.536 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephadm-2:18.0.0-4479.g8627af3e.el8.noarch 112/158 2023-06-23T18:43:24.669 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephadm-2:18.0.0-4479.g8627af3e.el8.noarch 112/158 2023-06-23T18:43:24.759 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-volume-2:18.0.0-4479.g8627af3e.el8.noarch 103/158 2023-06-23T18:43:24.781 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4479.g8627af3e.e 113/158 2023-06-23T18:43:24.994 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4479.g8627af3e. 114/158 2023-06-23T18:43:25.173 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4479.g8627af3e.el8.noa 115/158 2023-06-23T18:43:25.407 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4479.g8627af3e.el8.noa 115/158 2023-06-23T18:43:25.656 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4479.g8627af3e.el8.n 116/158 2023-06-23T18:43:26.482 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-volume-2:18.0.0-4479.g8627af3e.el8.noarch 103/158 2023-06-23T18:43:26.684 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4479.g8627af3e.el8.n 116/158 2023-06-23T18:43:26.729 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-osd-2:18.0.0-4479.g8627af3e.el8.x86_64 104/158 2023-06-23T18:43:26.882 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4479.g862 117/158 2023-06-23T18:43:26.982 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4479.g862 117/158 2023-06-23T18:43:26.997 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-osd-2:18.0.0-4479.g8627af3e.el8.x86_64 104/158 2023-06-23T18:43:27.175 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mds-2:18.0.0-4479.g8627af3e.el8.x86_64 105/158 2023-06-23T18:43:27.402 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4479.g8627af3e.el 118/158 2023-06-23T18:43:27.649 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-2:18.0.0-4479.g8627af3e.el8.x86_64 119/158 2023-06-23T18:43:27.686 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4479.g8627af3e.el8.x86_64 119/158 2023-06-23T18:43:27.700 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mds-2:18.0.0-4479.g8627af3e.el8.x86_64 105/158 2023-06-23T18:43:27.848 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-rook-2:18.0.0-4479.g8627af3e.el8.noarch 120/158 2023-06-23T18:43:27.860 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4479.g8627af3e.el8.noarch 120/158 2023-06-23T18:43:27.891 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mon-2:18.0.0-4479.g8627af3e.el8.x86_64 106/158 2023-06-23T18:43:27.940 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mon-2:18.0.0-4479.g8627af3e.el8.x86_64 106/158 2023-06-23T18:43:28.071 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-2:18.0.0-4479.g8627af3e.el8.x86_64 121/158 2023-06-23T18:43:28.113 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/158 2023-06-23T18:43:28.141 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/158 2023-06-23T18:43:28.215 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/158 2023-06-23T18:43:28.363 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/158 2023-06-23T18:43:28.524 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/158 2023-06-23T18:43:28.620 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/158 2023-06-23T18:43:28.911 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : jq-1.6-7.el8.x86_64 110/158 2023-06-23T18:43:29.141 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : automake-1.16.1-7.el8.noarch 111/158 2023-06-23T18:43:29.570 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-test-2:18.0.0-4479.g8627af3e.el8.x86_64 123/158 2023-06-23T18:43:29.793 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-radosgw-2:18.0.0-4479.g8627af3e.el8.x86_64 124/158 2023-06-23T18:43:29.800 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: cephadm-2:18.0.0-4479.g8627af3e.el8.noarch 112/158 2023-06-23T18:43:29.828 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4479.g8627af3e.el8.x86_64 124/158 2023-06-23T18:43:29.973 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : cephadm-2:18.0.0-4479.g8627af3e.el8.noarch 112/158 2023-06-23T18:43:30.007 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4479.g8627a 125/158 2023-06-23T18:43:30.049 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4479.g8627a 125/158 2023-06-23T18:43:30.098 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4479.g8627af3e.e 113/158 2023-06-23T18:43:30.295 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4479.g8627af3e. 114/158 2023-06-23T18:43:30.300 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephfs-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 126/158 2023-06-23T18:43:30.507 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4479.g8627af3e.el8.noa 115/158 2023-06-23T18:43:30.647 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 126/158 2023-06-23T18:43:30.765 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4479.g8627af3e.el8.noa 115/158 2023-06-23T18:43:30.840 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 127/158 2023-06-23T18:43:30.986 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4479.g8627af3e.el8.n 116/158 2023-06-23T18:43:31.042 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 127/158 2023-06-23T18:43:31.388 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/158 2023-06-23T18:43:32.095 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4479.g8627af3e.el8.n 116/158 2023-06-23T18:43:32.246 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 129/158 2023-06-23T18:43:32.307 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4479.g862 117/158 2023-06-23T18:43:32.438 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4479.g862 117/158 2023-06-23T18:43:32.536 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/158 2023-06-23T18:43:32.729 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/158 2023-06-23T18:43:32.835 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4479.g8627af3e.el 118/158 2023-06-23T18:43:32.951 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/158 2023-06-23T18:43:33.008 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/158 2023-06-23T18:43:33.028 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-2:18.0.0-4479.g8627af3e.el8.x86_64 119/158 2023-06-23T18:43:33.092 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4479.g8627af3e.el8.x86_64 119/158 2023-06-23T18:43:33.153 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/158 2023-06-23T18:43:33.281 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-mgr-rook-2:18.0.0-4479.g8627af3e.el8.noarch 120/158 2023-06-23T18:43:33.308 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4479.g8627af3e.el8.noarch 120/158 2023-06-23T18:43:33.308 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs-devel-2:18.0.0-4479.g8627af3e.el8.x86_ 134/158 2023-06-23T18:43:33.507 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-2:18.0.0-4479.g8627af3e.el8.x86_64 121/158 2023-06-23T18:43:33.656 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/158 2023-06-23T18:43:34.328 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-23T18:43:34.540 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-23T18:43:34.557 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-23T18:43:34.568 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-test-2:18.0.0-4479.g8627af3e.el8.x86_64 123/158 2023-06-23T18:43:34.773 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-radosgw-2:18.0.0-4479.g8627af3e.el8.x86_64 124/158 2023-06-23T18:43:34.790 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephfs-top-2:18.0.0-4479.g8627af3e.el8.noarch 136/158 2023-06-23T18:43:34.808 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4479.g8627af3e.el8.x86_64 124/158 2023-06-23T18:43:35.006 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4479.g8627a 125/158 2023-06-23T18:43:35.039 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 137/158 2023-06-23T18:43:35.050 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4479.g8627a 125/158 2023-06-23T18:43:35.242 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 126/158 2023-06-23T18:43:35.348 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-nbd-2:18.0.0-4479.g8627af3e.el8.x86_64 138/158 2023-06-23T18:43:35.609 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 126/158 2023-06-23T18:43:35.658 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 139/158 2023-06-23T18:43:35.814 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 127/158 2023-06-23T18:43:35.848 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-7.el 140/158 2023-06-23T18:43:35.860 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-7.el 140/158 2023-06-23T18:43:36.036 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 127/158 2023-06-23T18:43:36.049 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 141/158 2023-06-23T18:43:36.281 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flex-2.6.1-9.el8.x86_64 142/158 2023-06-23T18:43:36.355 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 142/158 2023-06-23T18:43:36.358 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/158 2023-06-23T18:43:36.631 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : bison-3.0.4-10.el8.x86_64 143/158 2023-06-23T18:43:36.643 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 143/158 2023-06-23T18:43:36.841 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 144/158 2023-06-23T18:43:37.053 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 145/158 2023-06-23T18:43:37.054 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 146/158 2023-06-23T18:43:37.340 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 129/158 2023-06-23T18:43:37.342 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 146/158 2023-06-23T18:43:37.342 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 147/158 2023-06-23T18:43:37.541 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 147/158 2023-06-23T18:43:37.546 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 148/158 2023-06-23T18:43:37.652 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/158 2023-06-23T18:43:37.693 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 148/158 2023-06-23T18:43:37.693 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 149/158 2023-06-23T18:43:37.828 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/158 2023-06-23T18:43:37.920 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 149/158 2023-06-23T18:43:38.042 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/158 2023-06-23T18:43:38.133 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 150/158 2023-06-23T18:43:38.193 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/158 2023-06-23T18:43:38.282 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 151/158 2023-06-23T18:43:38.382 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs-devel-2:18.0.0-4479.g8627af3e.el8.x86_ 134/158 2023-06-23T18:43:38.549 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 152/158 2023-06-23T18:43:38.550 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 153/158 2023-06-23T18:43:38.614 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/158 2023-06-23T18:43:38.800 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 153/158 2023-06-23T18:43:38.800 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 154/158 2023-06-23T18:43:39.017 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 154/158 2023-06-23T18:43:39.017 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 155/158 2023-06-23T18:43:39.241 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 155/158 2023-06-23T18:43:39.242 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 156/158 2023-06-23T18:43:39.382 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-23T18:43:39.483 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 156/158 2023-06-23T18:43:39.483 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 157/158 2023-06-23T18:43:39.664 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-23T18:43:39.682 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-23T18:43:39.692 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 157/158 2023-06-23T18:43:39.880 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 158/158 2023-06-23T18:43:39.889 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-top-2:18.0.0-4479.g8627af3e.el8.noarch 136/158 2023-06-23T18:43:40.072 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 137/158 2023-06-23T18:43:40.145 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-test-2:18.0.0-4479.g8627af3e.el8.x86_64 123/158 2023-06-23T18:43:40.351 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-radosgw-2:18.0.0-4479.g8627af3e.el8.x86_64 124/158 2023-06-23T18:43:40.385 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-nbd-2:18.0.0-4479.g8627af3e.el8.x86_64 138/158 2023-06-23T18:43:40.412 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4479.g8627af3e.el8.x86_64 124/158 2023-06-23T18:43:40.436 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 158/158 2023-06-23T18:43:40.436 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-2:18.0.0-4479.g8627af3e.el8.x86_64 1/158 2023-06-23T18:43:40.436 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-base-2:18.0.0-4479.g8627af3e.el8.x86_64 2/158 2023-06-23T18:43:40.437 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 3/158 2023-06-23T18:43:40.437 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 4/158 2023-06-23T18:43:40.437 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4479.g8627a 5/158 2023-06-23T18:43:40.437 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mds-2:18.0.0-4479.g8627af3e.el8.x86_64 6/158 2023-06-23T18:43:40.437 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-2:18.0.0-4479.g8627af3e.el8.x86_64 7/158 2023-06-23T18:43:40.437 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mon-2:18.0.0-4479.g8627af3e.el8.x86_64 8/158 2023-06-23T18:43:40.437 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-osd-2:18.0.0-4479.g8627af3e.el8.x86_64 9/158 2023-06-23T18:43:40.438 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-radosgw-2:18.0.0-4479.g8627af3e.el8.x86_64 10/158 2023-06-23T18:43:40.438 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-selinux-2:18.0.0-4479.g8627af3e.el8.x86_64 11/158 2023-06-23T18:43:40.438 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-test-2:18.0.0-4479.g8627af3e.el8.x86_64 12/158 2023-06-23T18:43:40.438 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephfs-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 13/158 2023-06-23T18:43:40.438 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs-devel-2:18.0.0-4479.g8627af3e.el8.x86_ 14/158 2023-06-23T18:43:40.438 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs2-2:18.0.0-4479.g8627af3e.el8.x86_64 15/158 2023-06-23T18:43:40.438 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephsqlite-2:18.0.0-4479.g8627af3e.el8.x86_64 16/158 2023-06-23T18:43:40.439 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados-devel-2:18.0.0-4479.g8627af3e.el8.x86_6 17/158 2023-06-23T18:43:40.439 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libradosstriper1-2:18.0.0-4479.g8627af3e.el8.x86 18/158 2023-06-23T18:43:40.439 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librgw2-2:18.0.0-4479.g8627af3e.el8.x86_64 19/158 2023-06-23T18:43:40.439 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4479.g8627af3e.el 20/158 2023-06-23T18:43:40.439 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-common-2:18.0.0-4479.g8627af3e.el8. 21/158 2023-06-23T18:43:40.439 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cephfs-2:18.0.0-4479.g8627af3e.el8.x86_6 22/158 2023-06-23T18:43:40.439 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rados-2:18.0.0-4479.g8627af3e.el8.x86_64 23/158 2023-06-23T18:43:40.439 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rbd-2:18.0.0-4479.g8627af3e.el8.x86_64 24/158 2023-06-23T18:43:40.440 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rgw-2:18.0.0-4479.g8627af3e.el8.x86_64 25/158 2023-06-23T18:43:40.440 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 26/158 2023-06-23T18:43:40.440 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 27/158 2023-06-23T18:43:40.440 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-nbd-2:18.0.0-4479.g8627af3e.el8.x86_64 28/158 2023-06-23T18:43:40.448 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4479.g8627af3e. 29/158 2023-06-23T18:43:40.448 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4479.g8627af3e.el8.noa 30/158 2023-06-23T18:43:40.448 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4479.g8627af3e.el8.n 31/158 2023-06-23T18:43:40.449 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4479.g862 32/158 2023-06-23T18:43:40.449 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4479.g8627af3e.el 33/158 2023-06-23T18:43:40.449 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4479.g8627af3e.el8.noarch 34/158 2023-06-23T18:43:40.449 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4479.g8627af3e.e 35/158 2023-06-23T18:43:40.449 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-volume-2:18.0.0-4479.g8627af3e.el8.noarch 36/158 2023-06-23T18:43:40.449 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephadm-2:18.0.0-4479.g8627af3e.el8.noarch 37/158 2023-06-23T18:43:40.450 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephfs-top-2:18.0.0-4479.g8627af3e.el8.noarch 38/158 2023-06-23T18:43:40.450 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/158 2023-06-23T18:43:40.450 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/158 2023-06-23T18:43:40.450 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/158 2023-06-23T18:43:40.450 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : jq-1.6-7.el8.x86_64 42/158 2023-06-23T18:43:40.450 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/158 2023-06-23T18:43:40.450 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/158 2023-06-23T18:43:40.450 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/158 2023-06-23T18:43:40.451 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/158 2023-06-23T18:43:40.451 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/158 2023-06-23T18:43:40.451 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/158 2023-06-23T18:43:40.451 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/158 2023-06-23T18:43:40.451 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/158 2023-06-23T18:43:40.451 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/158 2023-06-23T18:43:40.451 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/158 2023-06-23T18:43:40.451 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/158 2023-06-23T18:43:40.452 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/158 2023-06-23T18:43:40.452 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/158 2023-06-23T18:43:40.452 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/158 2023-06-23T18:43:40.452 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/158 2023-06-23T18:43:40.452 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/158 2023-06-23T18:43:40.452 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/158 2023-06-23T18:43:40.452 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/158 2023-06-23T18:43:40.453 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/158 2023-06-23T18:43:40.453 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/158 2023-06-23T18:43:40.453 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/158 2023-06-23T18:43:40.453 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/158 2023-06-23T18:43:40.453 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/158 2023-06-23T18:43:40.453 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/158 2023-06-23T18:43:40.453 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/158 2023-06-23T18:43:40.453 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/158 2023-06-23T18:43:40.454 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/158 2023-06-23T18:43:40.454 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/158 2023-06-23T18:43:40.454 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/158 2023-06-23T18:43:40.454 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/158 2023-06-23T18:43:40.454 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/158 2023-06-23T18:43:40.454 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/158 2023-06-23T18:43:40.454 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/158 2023-06-23T18:43:40.454 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/158 2023-06-23T18:43:40.455 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libgfortran-8.5.0-19.el8.x86_64 77/158 2023-06-23T18:43:40.455 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libquadmath-8.5.0-19.el8.x86_64 78/158 2023-06-23T18:43:40.455 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 79/158 2023-06-23T18:43:40.455 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/158 2023-06-23T18:43:40.455 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/158 2023-06-23T18:43:40.455 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/158 2023-06-23T18:43:40.455 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/158 2023-06-23T18:43:40.456 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/158 2023-06-23T18:43:40.456 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/158 2023-06-23T18:43:40.456 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/158 2023-06-23T18:43:40.456 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/158 2023-06-23T18:43:40.456 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/158 2023-06-23T18:43:40.456 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/158 2023-06-23T18:43:40.456 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/158 2023-06-23T18:43:40.457 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/158 2023-06-23T18:43:40.457 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/158 2023-06-23T18:43:40.457 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/158 2023-06-23T18:43:40.457 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/158 2023-06-23T18:43:40.457 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/158 2023-06-23T18:43:40.457 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/158 2023-06-23T18:43:40.457 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/158 2023-06-23T18:43:40.458 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/158 2023-06-23T18:43:40.458 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/158 2023-06-23T18:43:40.458 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/158 2023-06-23T18:43:40.458 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/158 2023-06-23T18:43:40.458 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/158 2023-06-23T18:43:40.458 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/158 2023-06-23T18:43:40.458 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/158 2023-06-23T18:43:40.458 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/158 2023-06-23T18:43:40.459 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/158 2023-06-23T18:43:40.459 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/158 2023-06-23T18:43:40.459 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/158 2023-06-23T18:43:40.459 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/158 2023-06-23T18:43:40.459 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/158 2023-06-23T18:43:40.459 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/158 2023-06-23T18:43:40.459 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/158 2023-06-23T18:43:40.459 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/158 2023-06-23T18:43:40.460 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/158 2023-06-23T18:43:40.460 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/158 2023-06-23T18:43:40.460 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/158 2023-06-23T18:43:40.460 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/158 2023-06-23T18:43:40.460 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/158 2023-06-23T18:43:40.460 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/158 2023-06-23T18:43:40.460 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/158 2023-06-23T18:43:40.461 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/158 2023-06-23T18:43:40.461 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/158 2023-06-23T18:43:40.461 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/158 2023-06-23T18:43:40.461 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/158 2023-06-23T18:43:40.461 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/158 2023-06-23T18:43:40.461 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/158 2023-06-23T18:43:40.461 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/158 2023-06-23T18:43:40.461 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/158 2023-06-23T18:43:40.462 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:18.0.0-4479.g8627af3e.el8.x86_64 129/158 2023-06-23T18:43:40.462 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/158 2023-06-23T18:43:40.462 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:18.0.0-4479.g8627af3e.el8.x86_64 131/158 2023-06-23T18:43:40.462 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/158 2023-06-23T18:43:40.462 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-7.el 133/158 2023-06-23T18:43:40.462 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/158 2023-06-23T18:43:40.462 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/158 2023-06-23T18:43:40.462 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/158 2023-06-23T18:43:40.463 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/158 2023-06-23T18:43:40.463 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/158 2023-06-23T18:43:40.463 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/158 2023-06-23T18:43:40.463 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/158 2023-06-23T18:43:40.463 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/158 2023-06-23T18:43:40.463 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/158 2023-06-23T18:43:40.463 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/158 2023-06-23T18:43:40.463 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/158 2023-06-23T18:43:40.464 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/158 2023-06-23T18:43:40.464 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/158 2023-06-23T18:43:40.464 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/158 2023-06-23T18:43:40.464 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/158 2023-06-23T18:43:40.464 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/158 2023-06-23T18:43:40.464 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/158 2023-06-23T18:43:40.464 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/158 2023-06-23T18:43:40.465 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/158 2023-06-23T18:43:40.465 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/158 2023-06-23T18:43:40.465 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/158 2023-06-23T18:43:40.465 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/158 2023-06-23T18:43:40.465 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/158 2023-06-23T18:43:40.465 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 157/158 2023-06-23T18:43:40.580 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4479.g8627a 125/158 2023-06-23T18:43:40.650 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4479.g8627a 125/158 2023-06-23T18:43:40.674 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 139/158 2023-06-23T18:43:40.821 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-7.el 140/158 2023-06-23T18:43:40.835 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-7.el 140/158 2023-06-23T18:43:40.851 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : cephfs-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 126/158 2023-06-23T18:43:41.070 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 141/158 2023-06-23T18:43:41.261 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 126/158 2023-06-23T18:43:41.322 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flex-2.6.1-9.el8.x86_64 142/158 2023-06-23T18:43:41.403 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 142/158 2023-06-23T18:43:41.494 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : rbd-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 127/158 2023-06-23T18:43:41.613 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : bison-3.0.4-10.el8.x86_64 143/158 2023-06-23T18:43:41.626 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 143/158 2023-06-23T18:43:41.789 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 127/158 2023-06-23T18:43:41.815 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 144/158 2023-06-23T18:43:41.976 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 145/158 2023-06-23T18:43:41.976 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 146/158 2023-06-23T18:43:42.127 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/158 2023-06-23T18:43:42.250 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 146/158 2023-06-23T18:43:42.250 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 147/158 2023-06-23T18:43:42.491 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 147/158 2023-06-23T18:43:42.497 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 148/158 2023-06-23T18:43:42.600 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 148/158 2023-06-23T18:43:42.600 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 149/158 2023-06-23T18:43:42.634 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 158/158 2023-06-23T18:43:42.634 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:42.635 INFO:teuthology.orchestra.run.smithi089.stdout:Upgraded: 2023-06-23T18:43:42.635 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-initscripts-updown-1:1.40.16-7.el8.noarch 2023-06-23T18:43:42.635 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-06-23T18:43:42.635 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-06-23T18:43:42.635 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-06-23T18:43:42.635 INFO:teuthology.orchestra.run.smithi089.stdout: iproute-6.2.0-2.el8.x86_64 2023-06-23T18:43:42.635 INFO:teuthology.orchestra.run.smithi089.stdout: libblkid-2.32.1-42.el8.x86_64 2023-06-23T18:43:42.635 INFO:teuthology.orchestra.run.smithi089.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-06-23T18:43:42.636 INFO:teuthology.orchestra.run.smithi089.stdout: libmount-2.32.1-42.el8.x86_64 2023-06-23T18:43:42.636 INFO:teuthology.orchestra.run.smithi089.stdout: librados2-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.636 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.636 INFO:teuthology.orchestra.run.smithi089.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-06-23T18:43:42.636 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid-2.32.1-42.el8.x86_64 2023-06-23T18:43:42.636 INFO:teuthology.orchestra.run.smithi089.stdout: util-linux-2.32.1-42.el8.x86_64 2023-06-23T18:43:42.636 INFO:teuthology.orchestra.run.smithi089.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-06-23T18:43:42.637 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-06-23T18:43:42.637 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-06-23T18:43:42.637 INFO:teuthology.orchestra.run.smithi089.stdout: automake-1.16.1-7.el8.noarch 2023-06-23T18:43:42.637 INFO:teuthology.orchestra.run.smithi089.stdout: bison-3.0.4-10.el8.x86_64 2023-06-23T18:43:42.637 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.637 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.637 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.638 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.638 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:42.638 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.638 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.638 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.638 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:42.638 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:42.638 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:42.639 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:42.639 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:42.639 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.639 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.639 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:42.639 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.639 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.639 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.640 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:42.640 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:42.640 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.640 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-top-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:42.640 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-06-23T18:43:42.640 INFO:teuthology.orchestra.run.smithi089.stdout: flex-2.6.1-9.el8.x86_64 2023-06-23T18:43:42.640 INFO:teuthology.orchestra.run.smithi089.stdout: fuse-2.9.7-17.el8.x86_64 2023-06-23T18:43:42.640 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-06-23T18:43:42.641 INFO:teuthology.orchestra.run.smithi089.stdout: jq-1.6-7.el8.x86_64 2023-06-23T18:43:42.641 INFO:teuthology.orchestra.run.smithi089.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-06-23T18:43:42.641 INFO:teuthology.orchestra.run.smithi089.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-06-23T18:43:42.641 INFO:teuthology.orchestra.run.smithi089.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-06-23T18:43:42.641 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.641 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.641 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.642 INFO:teuthology.orchestra.run.smithi089.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-06-23T18:43:42.642 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran-8.5.0-19.el8.x86_64 2023-06-23T18:43:42.642 INFO:teuthology.orchestra.run.smithi089.stdout: liboath-2.6.2-3.el8.x86_64 2023-06-23T18:43:42.642 INFO:teuthology.orchestra.run.smithi089.stdout: libpq-13.5-1.el8.x86_64 2023-06-23T18:43:42.642 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath-8.5.0-19.el8.x86_64 2023-06-23T18:43:42.642 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-06-23T18:43:42.642 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.642 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.643 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-06-23T18:43:42.643 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.643 INFO:teuthology.orchestra.run.smithi089.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-06-23T18:43:42.643 INFO:teuthology.orchestra.run.smithi089.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-06-23T18:43:42.643 INFO:teuthology.orchestra.run.smithi089.stdout: libtool-2.4.6-25.el8.x86_64 2023-06-23T18:43:42.643 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind-1.3.1-3.el8.x86_64 2023-06-23T18:43:42.643 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-06-23T18:43:42.643 INFO:teuthology.orchestra.run.smithi089.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-06-23T18:43:42.644 INFO:teuthology.orchestra.run.smithi089.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-06-23T18:43:42.644 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-06-23T18:43:42.644 INFO:teuthology.orchestra.run.smithi089.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-06-23T18:43:42.644 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-0.3.15-4.el8.x86_64 2023-06-23T18:43:42.644 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-06-23T18:43:42.644 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-06-23T18:43:42.644 INFO:teuthology.orchestra.run.smithi089.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-06-23T18:43:42.645 INFO:teuthology.orchestra.run.smithi089.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-06-23T18:43:42.645 INFO:teuthology.orchestra.run.smithi089.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-06-23T18:43:42.645 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-23T18:43:42.645 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-23T18:43:42.645 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-23T18:43:42.645 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-06-23T18:43:42.645 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel-2.5.1-7.el8.noarch 2023-06-23T18:43:42.645 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-06-23T18:43:42.646 INFO:teuthology.orchestra.run.smithi089.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-06-23T18:43:42.646 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-06-23T18:43:42.646 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.646 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.646 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.646 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-06-23T18:43:42.646 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-06-23T18:43:42.646 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-06-23T18:43:42.647 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-06-23T18:43:42.647 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-06-23T18:43:42.647 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-06-23T18:43:42.647 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-6.2-6.el8.noarch 2023-06-23T18:43:42.647 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-06-23T18:43:42.647 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-06-23T18:43:42.647 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-06-23T18:43:42.647 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-06-23T18:43:42.648 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-06-23T18:43:42.648 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-06-23T18:43:42.648 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-06-23T18:43:42.648 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako-1.0.6-14.el8.noarch 2023-06-23T18:43:42.648 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-06-23T18:43:42.648 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-06-23T18:43:42.648 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-06-23T18:43:42.649 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-06-23T18:43:42.649 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-06-23T18:43:42.649 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-06-23T18:43:42.649 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-06-23T18:43:42.649 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend-2.6-1.el8.noarch 2023-06-23T18:43:42.649 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-06-23T18:43:42.649 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-06-23T18:43:42.649 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-06-23T18:43:42.650 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-06-23T18:43:42.650 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser-2.14-14.el8.noarch 2023-06-23T18:43:42.650 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz-2017.2-9.el8.noarch 2023-06-23T18:43:42.650 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.650 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.650 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-06-23T18:43:42.650 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-06-23T18:43:42.650 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.651 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes-2.4.1-12.el8.noarch 2023-06-23T18:43:42.651 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa-4.8-1.el8.noarch 2023-06-23T18:43:42.651 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-06-23T18:43:42.651 INFO:teuthology.orchestra.run.smithi089.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-06-23T18:43:42.651 INFO:teuthology.orchestra.run.smithi089.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-06-23T18:43:42.651 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-06-23T18:43:42.651 INFO:teuthology.orchestra.run.smithi089.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-06-23T18:43:42.652 INFO:teuthology.orchestra.run.smithi089.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-06-23T18:43:42.652 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-06-23T18:43:42.652 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-06-23T18:43:42.652 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-06-23T18:43:42.652 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-06-23T18:43:42.652 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-06-23T18:43:42.652 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.652 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.653 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:42.653 INFO:teuthology.orchestra.run.smithi089.stdout: socat-1.7.4.1-1.el8.x86_64 2023-06-23T18:43:42.653 INFO:teuthology.orchestra.run.smithi089.stdout: thrift-0.13.0-2.el8.x86_64 2023-06-23T18:43:42.653 INFO:teuthology.orchestra.run.smithi089.stdout: uuid-1.6.2-43.el8.x86_64 2023-06-23T18:43:42.653 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-06-23T18:43:42.653 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-06-23T18:43:42.654 INFO:teuthology.orchestra.run.smithi089.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-06-23T18:43:42.654 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:42.654 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-06-23T18:43:42.846 DEBUG:teuthology.parallel:result is None 2023-06-23T18:43:42.862 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 149/158 2023-06-23T18:43:43.032 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 150/158 2023-06-23T18:43:43.210 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 151/158 2023-06-23T18:43:43.378 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ceph-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 129/158 2023-06-23T18:43:43.423 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 152/158 2023-06-23T18:43:43.423 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 153/158 2023-06-23T18:43:43.666 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 153/158 2023-06-23T18:43:43.666 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 154/158 2023-06-23T18:43:43.694 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/158 2023-06-23T18:43:43.858 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 154/158 2023-06-23T18:43:43.858 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 155/158 2023-06-23T18:43:43.878 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/158 2023-06-23T18:43:44.069 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/158 2023-06-23T18:43:44.074 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 155/158 2023-06-23T18:43:44.074 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 156/158 2023-06-23T18:43:44.226 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/158 2023-06-23T18:43:44.307 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 156/158 2023-06-23T18:43:44.308 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 157/158 2023-06-23T18:43:44.413 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libcephfs-devel-2:18.0.0-4479.g8627af3e.el8.x86_ 134/158 2023-06-23T18:43:44.499 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 157/158 2023-06-23T18:43:44.697 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 158/158 2023-06-23T18:43:45.280 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 158/158 2023-06-23T18:43:45.281 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-2:18.0.0-4479.g8627af3e.el8.x86_64 1/158 2023-06-23T18:43:45.281 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-base-2:18.0.0-4479.g8627af3e.el8.x86_64 2/158 2023-06-23T18:43:45.281 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 3/158 2023-06-23T18:43:45.282 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 4/158 2023-06-23T18:43:45.282 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4479.g8627a 5/158 2023-06-23T18:43:45.282 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mds-2:18.0.0-4479.g8627af3e.el8.x86_64 6/158 2023-06-23T18:43:45.282 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-2:18.0.0-4479.g8627af3e.el8.x86_64 7/158 2023-06-23T18:43:45.283 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mon-2:18.0.0-4479.g8627af3e.el8.x86_64 8/158 2023-06-23T18:43:45.283 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-osd-2:18.0.0-4479.g8627af3e.el8.x86_64 9/158 2023-06-23T18:43:45.283 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-radosgw-2:18.0.0-4479.g8627af3e.el8.x86_64 10/158 2023-06-23T18:43:45.283 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-selinux-2:18.0.0-4479.g8627af3e.el8.x86_64 11/158 2023-06-23T18:43:45.283 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-test-2:18.0.0-4479.g8627af3e.el8.x86_64 12/158 2023-06-23T18:43:45.284 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 13/158 2023-06-23T18:43:45.284 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs-devel-2:18.0.0-4479.g8627af3e.el8.x86_ 14/158 2023-06-23T18:43:45.284 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs2-2:18.0.0-4479.g8627af3e.el8.x86_64 15/158 2023-06-23T18:43:45.284 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephsqlite-2:18.0.0-4479.g8627af3e.el8.x86_64 16/158 2023-06-23T18:43:45.284 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados-devel-2:18.0.0-4479.g8627af3e.el8.x86_6 17/158 2023-06-23T18:43:45.284 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libradosstriper1-2:18.0.0-4479.g8627af3e.el8.x86 18/158 2023-06-23T18:43:45.284 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librgw2-2:18.0.0-4479.g8627af3e.el8.x86_64 19/158 2023-06-23T18:43:45.285 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4479.g8627af3e.el 20/158 2023-06-23T18:43:45.285 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-common-2:18.0.0-4479.g8627af3e.el8. 21/158 2023-06-23T18:43:45.285 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cephfs-2:18.0.0-4479.g8627af3e.el8.x86_6 22/158 2023-06-23T18:43:45.285 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rados-2:18.0.0-4479.g8627af3e.el8.x86_64 23/158 2023-06-23T18:43:45.285 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rbd-2:18.0.0-4479.g8627af3e.el8.x86_64 24/158 2023-06-23T18:43:45.285 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rgw-2:18.0.0-4479.g8627af3e.el8.x86_64 25/158 2023-06-23T18:43:45.285 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 26/158 2023-06-23T18:43:45.285 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 27/158 2023-06-23T18:43:45.286 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-nbd-2:18.0.0-4479.g8627af3e.el8.x86_64 28/158 2023-06-23T18:43:45.295 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4479.g8627af3e. 29/158 2023-06-23T18:43:45.296 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4479.g8627af3e.el8.noa 30/158 2023-06-23T18:43:45.296 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4479.g8627af3e.el8.n 31/158 2023-06-23T18:43:45.296 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4479.g862 32/158 2023-06-23T18:43:45.296 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4479.g8627af3e.el 33/158 2023-06-23T18:43:45.296 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4479.g8627af3e.el8.noarch 34/158 2023-06-23T18:43:45.297 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4479.g8627af3e.e 35/158 2023-06-23T18:43:45.297 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-volume-2:18.0.0-4479.g8627af3e.el8.noarch 36/158 2023-06-23T18:43:45.297 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephadm-2:18.0.0-4479.g8627af3e.el8.noarch 37/158 2023-06-23T18:43:45.297 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-top-2:18.0.0-4479.g8627af3e.el8.noarch 38/158 2023-06-23T18:43:45.297 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/158 2023-06-23T18:43:45.297 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/158 2023-06-23T18:43:45.297 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/158 2023-06-23T18:43:45.297 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : jq-1.6-7.el8.x86_64 42/158 2023-06-23T18:43:45.298 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/158 2023-06-23T18:43:45.298 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/158 2023-06-23T18:43:45.298 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/158 2023-06-23T18:43:45.298 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/158 2023-06-23T18:43:45.298 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/158 2023-06-23T18:43:45.298 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/158 2023-06-23T18:43:45.298 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/158 2023-06-23T18:43:45.299 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/158 2023-06-23T18:43:45.299 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/158 2023-06-23T18:43:45.299 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/158 2023-06-23T18:43:45.299 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/158 2023-06-23T18:43:45.299 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/158 2023-06-23T18:43:45.299 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/158 2023-06-23T18:43:45.299 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/158 2023-06-23T18:43:45.300 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/158 2023-06-23T18:43:45.300 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/158 2023-06-23T18:43:45.300 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/158 2023-06-23T18:43:45.300 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/158 2023-06-23T18:43:45.300 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/158 2023-06-23T18:43:45.300 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/158 2023-06-23T18:43:45.301 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/158 2023-06-23T18:43:45.301 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/158 2023-06-23T18:43:45.301 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/158 2023-06-23T18:43:45.301 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/158 2023-06-23T18:43:45.301 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/158 2023-06-23T18:43:45.301 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/158 2023-06-23T18:43:45.301 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/158 2023-06-23T18:43:45.301 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/158 2023-06-23T18:43:45.302 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/158 2023-06-23T18:43:45.302 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/158 2023-06-23T18:43:45.302 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/158 2023-06-23T18:43:45.302 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/158 2023-06-23T18:43:45.302 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/158 2023-06-23T18:43:45.302 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/158 2023-06-23T18:43:45.302 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libgfortran-8.5.0-19.el8.x86_64 77/158 2023-06-23T18:43:45.303 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libquadmath-8.5.0-19.el8.x86_64 78/158 2023-06-23T18:43:45.303 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 79/158 2023-06-23T18:43:45.303 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/158 2023-06-23T18:43:45.303 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/158 2023-06-23T18:43:45.303 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/158 2023-06-23T18:43:45.303 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/158 2023-06-23T18:43:45.304 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/158 2023-06-23T18:43:45.304 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/158 2023-06-23T18:43:45.304 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/158 2023-06-23T18:43:45.304 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/158 2023-06-23T18:43:45.304 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/158 2023-06-23T18:43:45.305 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/158 2023-06-23T18:43:45.305 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/158 2023-06-23T18:43:45.305 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/158 2023-06-23T18:43:45.305 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/158 2023-06-23T18:43:45.305 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/158 2023-06-23T18:43:45.305 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/158 2023-06-23T18:43:45.305 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/158 2023-06-23T18:43:45.305 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/158 2023-06-23T18:43:45.306 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/158 2023-06-23T18:43:45.306 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/158 2023-06-23T18:43:45.306 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/158 2023-06-23T18:43:45.306 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/158 2023-06-23T18:43:45.306 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/158 2023-06-23T18:43:45.306 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/158 2023-06-23T18:43:45.306 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/158 2023-06-23T18:43:45.307 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/158 2023-06-23T18:43:45.307 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/158 2023-06-23T18:43:45.307 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/158 2023-06-23T18:43:45.307 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/158 2023-06-23T18:43:45.307 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/158 2023-06-23T18:43:45.307 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/158 2023-06-23T18:43:45.307 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/158 2023-06-23T18:43:45.307 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/158 2023-06-23T18:43:45.308 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/158 2023-06-23T18:43:45.308 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/158 2023-06-23T18:43:45.308 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/158 2023-06-23T18:43:45.308 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/158 2023-06-23T18:43:45.308 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/158 2023-06-23T18:43:45.308 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/158 2023-06-23T18:43:45.308 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/158 2023-06-23T18:43:45.308 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/158 2023-06-23T18:43:45.309 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/158 2023-06-23T18:43:45.309 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/158 2023-06-23T18:43:45.309 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/158 2023-06-23T18:43:45.309 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/158 2023-06-23T18:43:45.309 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/158 2023-06-23T18:43:45.309 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/158 2023-06-23T18:43:45.309 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/158 2023-06-23T18:43:45.310 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/158 2023-06-23T18:43:45.310 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/158 2023-06-23T18:43:45.310 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:18.0.0-4479.g8627af3e.el8.x86_64 129/158 2023-06-23T18:43:45.310 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/158 2023-06-23T18:43:45.310 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:18.0.0-4479.g8627af3e.el8.x86_64 131/158 2023-06-23T18:43:45.310 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/158 2023-06-23T18:43:45.310 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-7.el 133/158 2023-06-23T18:43:45.310 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/158 2023-06-23T18:43:45.311 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/158 2023-06-23T18:43:45.311 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/158 2023-06-23T18:43:45.311 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/158 2023-06-23T18:43:45.311 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/158 2023-06-23T18:43:45.311 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/158 2023-06-23T18:43:45.311 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/158 2023-06-23T18:43:45.311 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/158 2023-06-23T18:43:45.311 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/158 2023-06-23T18:43:45.312 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/158 2023-06-23T18:43:45.312 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/158 2023-06-23T18:43:45.312 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/158 2023-06-23T18:43:45.312 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/158 2023-06-23T18:43:45.312 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/158 2023-06-23T18:43:45.312 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/158 2023-06-23T18:43:45.312 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/158 2023-06-23T18:43:45.313 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/158 2023-06-23T18:43:45.313 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/158 2023-06-23T18:43:45.313 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/158 2023-06-23T18:43:45.313 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/158 2023-06-23T18:43:45.313 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/158 2023-06-23T18:43:45.313 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/158 2023-06-23T18:43:45.314 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/158 2023-06-23T18:43:45.314 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 157/158 2023-06-23T18:43:45.649 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-23T18:43:45.914 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-23T18:43:45.949 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-23T18:43:46.173 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : cephfs-top-2:18.0.0-4479.g8627af3e.el8.noarch 136/158 2023-06-23T18:43:46.372 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : rbd-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 137/158 2023-06-23T18:43:46.710 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : rbd-nbd-2:18.0.0-4479.g8627af3e.el8.x86_64 138/158 2023-06-23T18:43:46.940 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 139/158 2023-06-23T18:43:47.120 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-7.el 140/158 2023-06-23T18:43:47.148 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-7.el 140/158 2023-06-23T18:43:47.346 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 141/158 2023-06-23T18:43:47.528 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 158/158 2023-06-23T18:43:47.528 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:47.528 INFO:teuthology.orchestra.run.smithi052.stdout:Upgraded: 2023-06-23T18:43:47.529 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-initscripts-updown-1:1.40.16-7.el8.noarch 2023-06-23T18:43:47.529 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-06-23T18:43:47.529 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-06-23T18:43:47.529 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-06-23T18:43:47.529 INFO:teuthology.orchestra.run.smithi052.stdout: iproute-6.2.0-2.el8.x86_64 2023-06-23T18:43:47.529 INFO:teuthology.orchestra.run.smithi052.stdout: libblkid-2.32.1-42.el8.x86_64 2023-06-23T18:43:47.529 INFO:teuthology.orchestra.run.smithi052.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-06-23T18:43:47.530 INFO:teuthology.orchestra.run.smithi052.stdout: libmount-2.32.1-42.el8.x86_64 2023-06-23T18:43:47.530 INFO:teuthology.orchestra.run.smithi052.stdout: librados2-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.530 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.530 INFO:teuthology.orchestra.run.smithi052.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-06-23T18:43:47.530 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-2.32.1-42.el8.x86_64 2023-06-23T18:43:47.530 INFO:teuthology.orchestra.run.smithi052.stdout: util-linux-2.32.1-42.el8.x86_64 2023-06-23T18:43:47.530 INFO:teuthology.orchestra.run.smithi052.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-06-23T18:43:47.530 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-06-23T18:43:47.531 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2023-06-23T18:43:47.531 INFO:teuthology.orchestra.run.smithi052.stdout: automake-1.16.1-7.el8.noarch 2023-06-23T18:43:47.531 INFO:teuthology.orchestra.run.smithi052.stdout: bison-3.0.4-10.el8.x86_64 2023-06-23T18:43:47.531 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.531 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.531 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.531 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.532 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:47.532 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.532 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.532 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.532 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:47.532 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:47.532 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:47.532 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:47.533 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:47.533 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.533 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.533 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:47.533 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.533 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.533 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.534 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:47.534 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:47.534 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.534 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-top-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:47.534 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-06-23T18:43:47.534 INFO:teuthology.orchestra.run.smithi052.stdout: flex-2.6.1-9.el8.x86_64 2023-06-23T18:43:47.534 INFO:teuthology.orchestra.run.smithi052.stdout: fuse-2.9.7-17.el8.x86_64 2023-06-23T18:43:47.534 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-06-23T18:43:47.535 INFO:teuthology.orchestra.run.smithi052.stdout: jq-1.6-7.el8.x86_64 2023-06-23T18:43:47.535 INFO:teuthology.orchestra.run.smithi052.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-06-23T18:43:47.535 INFO:teuthology.orchestra.run.smithi052.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-06-23T18:43:47.535 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-06-23T18:43:47.535 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.535 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.535 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.535 INFO:teuthology.orchestra.run.smithi052.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-06-23T18:43:47.536 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran-8.5.0-19.el8.x86_64 2023-06-23T18:43:47.536 INFO:teuthology.orchestra.run.smithi052.stdout: liboath-2.6.2-3.el8.x86_64 2023-06-23T18:43:47.536 INFO:teuthology.orchestra.run.smithi052.stdout: libpq-13.5-1.el8.x86_64 2023-06-23T18:43:47.536 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath-8.5.0-19.el8.x86_64 2023-06-23T18:43:47.536 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-06-23T18:43:47.536 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.536 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.537 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-06-23T18:43:47.537 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.537 INFO:teuthology.orchestra.run.smithi052.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-06-23T18:43:47.537 INFO:teuthology.orchestra.run.smithi052.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-06-23T18:43:47.537 INFO:teuthology.orchestra.run.smithi052.stdout: libtool-2.4.6-25.el8.x86_64 2023-06-23T18:43:47.537 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind-1.3.1-3.el8.x86_64 2023-06-23T18:43:47.537 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-06-23T18:43:47.537 INFO:teuthology.orchestra.run.smithi052.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-06-23T18:43:47.538 INFO:teuthology.orchestra.run.smithi052.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-06-23T18:43:47.538 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-06-23T18:43:47.538 INFO:teuthology.orchestra.run.smithi052.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-06-23T18:43:47.538 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-0.3.15-4.el8.x86_64 2023-06-23T18:43:47.538 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-06-23T18:43:47.538 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-06-23T18:43:47.538 INFO:teuthology.orchestra.run.smithi052.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-06-23T18:43:47.538 INFO:teuthology.orchestra.run.smithi052.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-06-23T18:43:47.539 INFO:teuthology.orchestra.run.smithi052.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-06-23T18:43:47.539 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-23T18:43:47.539 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-23T18:43:47.539 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-23T18:43:47.539 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-06-23T18:43:47.539 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel-2.5.1-7.el8.noarch 2023-06-23T18:43:47.539 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-06-23T18:43:47.539 INFO:teuthology.orchestra.run.smithi052.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-06-23T18:43:47.540 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-06-23T18:43:47.540 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.540 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.540 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.540 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-06-23T18:43:47.540 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-06-23T18:43:47.540 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-06-23T18:43:47.541 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-06-23T18:43:47.541 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-06-23T18:43:47.541 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-06-23T18:43:47.541 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-6.2-6.el8.noarch 2023-06-23T18:43:47.541 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-06-23T18:43:47.541 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-06-23T18:43:47.541 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-06-23T18:43:47.541 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-06-23T18:43:47.542 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-06-23T18:43:47.542 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-06-23T18:43:47.542 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-06-23T18:43:47.542 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako-1.0.6-14.el8.noarch 2023-06-23T18:43:47.542 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-06-23T18:43:47.542 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-06-23T18:43:47.542 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-06-23T18:43:47.543 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-06-23T18:43:47.543 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-06-23T18:43:47.543 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-06-23T18:43:47.543 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-06-23T18:43:47.543 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend-2.6-1.el8.noarch 2023-06-23T18:43:47.543 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-06-23T18:43:47.543 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-06-23T18:43:47.543 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-06-23T18:43:47.544 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-06-23T18:43:47.544 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser-2.14-14.el8.noarch 2023-06-23T18:43:47.544 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz-2017.2-9.el8.noarch 2023-06-23T18:43:47.544 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.544 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.544 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-06-23T18:43:47.544 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-06-23T18:43:47.544 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.545 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes-2.4.1-12.el8.noarch 2023-06-23T18:43:47.545 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa-4.8-1.el8.noarch 2023-06-23T18:43:47.545 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-06-23T18:43:47.545 INFO:teuthology.orchestra.run.smithi052.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-06-23T18:43:47.545 INFO:teuthology.orchestra.run.smithi052.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-06-23T18:43:47.545 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-06-23T18:43:47.545 INFO:teuthology.orchestra.run.smithi052.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-06-23T18:43:47.545 INFO:teuthology.orchestra.run.smithi052.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-06-23T18:43:47.546 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-06-23T18:43:47.546 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-06-23T18:43:47.546 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-06-23T18:43:47.546 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-06-23T18:43:47.546 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-06-23T18:43:47.546 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.546 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.546 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:47.547 INFO:teuthology.orchestra.run.smithi052.stdout: socat-1.7.4.1-1.el8.x86_64 2023-06-23T18:43:47.547 INFO:teuthology.orchestra.run.smithi052.stdout: thrift-0.13.0-2.el8.x86_64 2023-06-23T18:43:47.547 INFO:teuthology.orchestra.run.smithi052.stdout: uuid-1.6.2-43.el8.x86_64 2023-06-23T18:43:47.547 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-06-23T18:43:47.547 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-06-23T18:43:47.548 INFO:teuthology.orchestra.run.smithi052.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-06-23T18:43:47.548 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:47.548 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2023-06-23T18:43:47.554 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : flex-2.6.1-9.el8.x86_64 142/158 2023-06-23T18:43:47.663 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 142/158 2023-06-23T18:43:47.747 DEBUG:teuthology.parallel:result is None 2023-06-23T18:43:47.912 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : bison-3.0.4-10.el8.x86_64 143/158 2023-06-23T18:43:47.937 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 143/158 2023-06-23T18:43:48.139 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 144/158 2023-06-23T18:43:48.329 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 145/158 2023-06-23T18:43:48.330 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 146/158 2023-06-23T18:43:48.616 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 146/158 2023-06-23T18:43:48.616 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 147/158 2023-06-23T18:43:48.906 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 147/158 2023-06-23T18:43:48.921 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 148/158 2023-06-23T18:43:49.051 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 148/158 2023-06-23T18:43:49.052 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 149/158 2023-06-23T18:43:49.293 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 149/158 2023-06-23T18:43:49.480 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 150/158 2023-06-23T18:43:49.631 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 151/158 2023-06-23T18:43:49.847 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 152/158 2023-06-23T18:43:49.848 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 153/158 2023-06-23T18:43:50.065 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 153/158 2023-06-23T18:43:50.065 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 154/158 2023-06-23T18:43:50.290 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 154/158 2023-06-23T18:43:50.290 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 155/158 2023-06-23T18:43:50.498 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 155/158 2023-06-23T18:43:50.499 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 156/158 2023-06-23T18:43:50.715 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 156/158 2023-06-23T18:43:50.715 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 157/158 2023-06-23T18:43:50.914 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 157/158 2023-06-23T18:43:51.096 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 158/158 2023-06-23T18:43:51.302 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 158/158 2023-06-23T18:43:51.303 INFO:teuthology.orchestra.run.smithi158.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-06-23T18:43:51.303 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:52.014 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-2:18.0.0-4479.g8627af3e.el8.x86_64 1/158 2023-06-23T18:43:52.014 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-base-2:18.0.0-4479.g8627af3e.el8.x86_64 2/158 2023-06-23T18:43:52.014 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 3/158 2023-06-23T18:43:52.014 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 4/158 2023-06-23T18:43:52.014 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4479.g8627a 5/158 2023-06-23T18:43:52.015 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mds-2:18.0.0-4479.g8627af3e.el8.x86_64 6/158 2023-06-23T18:43:52.015 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-2:18.0.0-4479.g8627af3e.el8.x86_64 7/158 2023-06-23T18:43:52.015 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mon-2:18.0.0-4479.g8627af3e.el8.x86_64 8/158 2023-06-23T18:43:52.015 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-osd-2:18.0.0-4479.g8627af3e.el8.x86_64 9/158 2023-06-23T18:43:52.015 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-radosgw-2:18.0.0-4479.g8627af3e.el8.x86_64 10/158 2023-06-23T18:43:52.015 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-selinux-2:18.0.0-4479.g8627af3e.el8.x86_64 11/158 2023-06-23T18:43:52.016 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-test-2:18.0.0-4479.g8627af3e.el8.x86_64 12/158 2023-06-23T18:43:52.016 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : cephfs-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 13/158 2023-06-23T18:43:52.016 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libcephfs-devel-2:18.0.0-4479.g8627af3e.el8.x86_ 14/158 2023-06-23T18:43:52.016 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libcephfs2-2:18.0.0-4479.g8627af3e.el8.x86_64 15/158 2023-06-23T18:43:52.016 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libcephsqlite-2:18.0.0-4479.g8627af3e.el8.x86_64 16/158 2023-06-23T18:43:52.017 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librados-devel-2:18.0.0-4479.g8627af3e.el8.x86_6 17/158 2023-06-23T18:43:52.017 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libradosstriper1-2:18.0.0-4479.g8627af3e.el8.x86 18/158 2023-06-23T18:43:52.018 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librgw2-2:18.0.0-4479.g8627af3e.el8.x86_64 19/158 2023-06-23T18:43:52.018 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4479.g8627af3e.el 20/158 2023-06-23T18:43:52.018 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-ceph-common-2:18.0.0-4479.g8627af3e.el8. 21/158 2023-06-23T18:43:52.018 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cephfs-2:18.0.0-4479.g8627af3e.el8.x86_6 22/158 2023-06-23T18:43:52.018 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rados-2:18.0.0-4479.g8627af3e.el8.x86_64 23/158 2023-06-23T18:43:52.018 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rbd-2:18.0.0-4479.g8627af3e.el8.x86_64 24/158 2023-06-23T18:43:52.018 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rgw-2:18.0.0-4479.g8627af3e.el8.x86_64 25/158 2023-06-23T18:43:52.019 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : rbd-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 26/158 2023-06-23T18:43:52.019 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : rbd-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 27/158 2023-06-23T18:43:52.031 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : rbd-nbd-2:18.0.0-4479.g8627af3e.el8.x86_64 28/158 2023-06-23T18:43:52.031 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4479.g8627af3e. 29/158 2023-06-23T18:43:52.032 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4479.g8627af3e.el8.noa 30/158 2023-06-23T18:43:52.032 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4479.g8627af3e.el8.n 31/158 2023-06-23T18:43:52.032 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4479.g862 32/158 2023-06-23T18:43:52.032 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4479.g8627af3e.el 33/158 2023-06-23T18:43:52.032 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4479.g8627af3e.el8.noarch 34/158 2023-06-23T18:43:52.032 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4479.g8627af3e.e 35/158 2023-06-23T18:43:52.032 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ceph-volume-2:18.0.0-4479.g8627af3e.el8.noarch 36/158 2023-06-23T18:43:52.033 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : cephadm-2:18.0.0-4479.g8627af3e.el8.noarch 37/158 2023-06-23T18:43:52.033 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : cephfs-top-2:18.0.0-4479.g8627af3e.el8.noarch 38/158 2023-06-23T18:43:52.033 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/158 2023-06-23T18:43:52.033 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/158 2023-06-23T18:43:52.033 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/158 2023-06-23T18:43:52.033 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : jq-1.6-7.el8.x86_64 42/158 2023-06-23T18:43:52.034 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/158 2023-06-23T18:43:52.034 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/158 2023-06-23T18:43:52.034 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/158 2023-06-23T18:43:52.034 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/158 2023-06-23T18:43:52.034 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/158 2023-06-23T18:43:52.034 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/158 2023-06-23T18:43:52.034 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/158 2023-06-23T18:43:52.034 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/158 2023-06-23T18:43:52.035 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/158 2023-06-23T18:43:52.035 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/158 2023-06-23T18:43:52.035 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/158 2023-06-23T18:43:52.035 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/158 2023-06-23T18:43:52.035 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/158 2023-06-23T18:43:52.035 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/158 2023-06-23T18:43:52.036 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/158 2023-06-23T18:43:52.036 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/158 2023-06-23T18:43:52.036 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/158 2023-06-23T18:43:52.036 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/158 2023-06-23T18:43:52.036 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/158 2023-06-23T18:43:52.037 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/158 2023-06-23T18:43:52.037 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/158 2023-06-23T18:43:52.037 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/158 2023-06-23T18:43:52.037 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/158 2023-06-23T18:43:52.037 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/158 2023-06-23T18:43:52.038 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/158 2023-06-23T18:43:52.038 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/158 2023-06-23T18:43:52.038 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/158 2023-06-23T18:43:52.038 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/158 2023-06-23T18:43:52.038 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/158 2023-06-23T18:43:52.038 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/158 2023-06-23T18:43:52.038 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/158 2023-06-23T18:43:52.039 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/158 2023-06-23T18:43:52.039 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/158 2023-06-23T18:43:52.039 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/158 2023-06-23T18:43:52.039 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libgfortran-8.5.0-19.el8.x86_64 77/158 2023-06-23T18:43:52.039 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libquadmath-8.5.0-19.el8.x86_64 78/158 2023-06-23T18:43:52.039 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 79/158 2023-06-23T18:43:52.040 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/158 2023-06-23T18:43:52.040 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/158 2023-06-23T18:43:52.040 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/158 2023-06-23T18:43:52.040 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/158 2023-06-23T18:43:52.040 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/158 2023-06-23T18:43:52.040 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/158 2023-06-23T18:43:52.040 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/158 2023-06-23T18:43:52.041 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/158 2023-06-23T18:43:52.041 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/158 2023-06-23T18:43:52.041 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/158 2023-06-23T18:43:52.041 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/158 2023-06-23T18:43:52.041 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/158 2023-06-23T18:43:52.041 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/158 2023-06-23T18:43:52.042 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/158 2023-06-23T18:43:52.042 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/158 2023-06-23T18:43:52.042 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/158 2023-06-23T18:43:52.042 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/158 2023-06-23T18:43:52.042 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/158 2023-06-23T18:43:52.042 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/158 2023-06-23T18:43:52.042 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/158 2023-06-23T18:43:52.043 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/158 2023-06-23T18:43:52.043 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/158 2023-06-23T18:43:52.043 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/158 2023-06-23T18:43:52.043 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/158 2023-06-23T18:43:52.043 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/158 2023-06-23T18:43:52.043 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/158 2023-06-23T18:43:52.043 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/158 2023-06-23T18:43:52.044 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/158 2023-06-23T18:43:52.044 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/158 2023-06-23T18:43:52.044 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/158 2023-06-23T18:43:52.044 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/158 2023-06-23T18:43:52.044 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/158 2023-06-23T18:43:52.044 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/158 2023-06-23T18:43:52.044 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/158 2023-06-23T18:43:52.045 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/158 2023-06-23T18:43:52.045 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/158 2023-06-23T18:43:52.045 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/158 2023-06-23T18:43:52.045 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/158 2023-06-23T18:43:52.045 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/158 2023-06-23T18:43:52.045 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/158 2023-06-23T18:43:52.046 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/158 2023-06-23T18:43:52.046 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/158 2023-06-23T18:43:52.046 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/158 2023-06-23T18:43:52.046 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/158 2023-06-23T18:43:52.046 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/158 2023-06-23T18:43:52.046 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/158 2023-06-23T18:43:52.046 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/158 2023-06-23T18:43:52.047 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/158 2023-06-23T18:43:52.047 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/158 2023-06-23T18:43:52.047 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librados2-2:18.0.0-4479.g8627af3e.el8.x86_64 129/158 2023-06-23T18:43:52.047 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/158 2023-06-23T18:43:52.047 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librbd1-2:18.0.0-4479.g8627af3e.el8.x86_64 131/158 2023-06-23T18:43:52.047 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/158 2023-06-23T18:43:52.047 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-7.el 133/158 2023-06-23T18:43:52.048 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/158 2023-06-23T18:43:52.048 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/158 2023-06-23T18:43:52.048 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/158 2023-06-23T18:43:52.048 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/158 2023-06-23T18:43:52.048 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/158 2023-06-23T18:43:52.048 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/158 2023-06-23T18:43:52.048 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/158 2023-06-23T18:43:52.049 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/158 2023-06-23T18:43:52.049 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/158 2023-06-23T18:43:52.049 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/158 2023-06-23T18:43:52.049 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/158 2023-06-23T18:43:52.049 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/158 2023-06-23T18:43:52.049 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/158 2023-06-23T18:43:52.049 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/158 2023-06-23T18:43:52.050 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/158 2023-06-23T18:43:52.050 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/158 2023-06-23T18:43:52.050 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/158 2023-06-23T18:43:52.050 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/158 2023-06-23T18:43:52.050 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/158 2023-06-23T18:43:52.050 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/158 2023-06-23T18:43:52.050 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/158 2023-06-23T18:43:52.051 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/158 2023-06-23T18:43:52.051 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/158 2023-06-23T18:43:52.051 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 157/158 2023-06-23T18:43:54.165 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 158/158 2023-06-23T18:43:54.165 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:54.165 INFO:teuthology.orchestra.run.smithi158.stdout:Upgraded: 2023-06-23T18:43:54.166 INFO:teuthology.orchestra.run.smithi158.stdout: NetworkManager-initscripts-updown-1:1.40.16-7.el8.noarch 2023-06-23T18:43:54.166 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-06-23T18:43:54.166 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-06-23T18:43:54.166 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-06-23T18:43:54.166 INFO:teuthology.orchestra.run.smithi158.stdout: iproute-6.2.0-2.el8.x86_64 2023-06-23T18:43:54.166 INFO:teuthology.orchestra.run.smithi158.stdout: libblkid-2.32.1-42.el8.x86_64 2023-06-23T18:43:54.166 INFO:teuthology.orchestra.run.smithi158.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-06-23T18:43:54.167 INFO:teuthology.orchestra.run.smithi158.stdout: libmount-2.32.1-42.el8.x86_64 2023-06-23T18:43:54.167 INFO:teuthology.orchestra.run.smithi158.stdout: librados2-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.167 INFO:teuthology.orchestra.run.smithi158.stdout: librbd1-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.167 INFO:teuthology.orchestra.run.smithi158.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-06-23T18:43:54.167 INFO:teuthology.orchestra.run.smithi158.stdout: libuuid-2.32.1-42.el8.x86_64 2023-06-23T18:43:54.167 INFO:teuthology.orchestra.run.smithi158.stdout: util-linux-2.32.1-42.el8.x86_64 2023-06-23T18:43:54.167 INFO:teuthology.orchestra.run.smithi158.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-06-23T18:43:54.168 INFO:teuthology.orchestra.run.smithi158.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-06-23T18:43:54.168 INFO:teuthology.orchestra.run.smithi158.stdout:Installed: 2023-06-23T18:43:54.168 INFO:teuthology.orchestra.run.smithi158.stdout: automake-1.16.1-7.el8.noarch 2023-06-23T18:43:54.168 INFO:teuthology.orchestra.run.smithi158.stdout: bison-3.0.4-10.el8.x86_64 2023-06-23T18:43:54.168 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.168 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-base-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.168 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.168 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.169 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-grafana-dashboards-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:54.169 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-immutable-object-cache-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.169 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mds-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.169 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.169 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-cephadm-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:54.169 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-dashboard-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:54.169 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:54.170 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-modules-core-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:54.170 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mgr-rook-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:54.170 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-mon-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.170 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-osd-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.170 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-prometheus-alerts-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:54.170 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-radosgw-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.170 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-selinux-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.170 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-test-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.171 INFO:teuthology.orchestra.run.smithi158.stdout: ceph-volume-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:54.171 INFO:teuthology.orchestra.run.smithi158.stdout: cephadm-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:54.171 INFO:teuthology.orchestra.run.smithi158.stdout: cephfs-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.171 INFO:teuthology.orchestra.run.smithi158.stdout: cephfs-top-2:18.0.0-4479.g8627af3e.el8.noarch 2023-06-23T18:43:54.171 INFO:teuthology.orchestra.run.smithi158.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-06-23T18:43:54.171 INFO:teuthology.orchestra.run.smithi158.stdout: flex-2.6.1-9.el8.x86_64 2023-06-23T18:43:54.171 INFO:teuthology.orchestra.run.smithi158.stdout: fuse-2.9.7-17.el8.x86_64 2023-06-23T18:43:54.171 INFO:teuthology.orchestra.run.smithi158.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-06-23T18:43:54.172 INFO:teuthology.orchestra.run.smithi158.stdout: jq-1.6-7.el8.x86_64 2023-06-23T18:43:54.172 INFO:teuthology.orchestra.run.smithi158.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-06-23T18:43:54.172 INFO:teuthology.orchestra.run.smithi158.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-06-23T18:43:54.172 INFO:teuthology.orchestra.run.smithi158.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-06-23T18:43:54.172 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs-devel-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.172 INFO:teuthology.orchestra.run.smithi158.stdout: libcephfs2-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.172 INFO:teuthology.orchestra.run.smithi158.stdout: libcephsqlite-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.173 INFO:teuthology.orchestra.run.smithi158.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-06-23T18:43:54.173 INFO:teuthology.orchestra.run.smithi158.stdout: libgfortran-8.5.0-19.el8.x86_64 2023-06-23T18:43:54.173 INFO:teuthology.orchestra.run.smithi158.stdout: liboath-2.6.2-3.el8.x86_64 2023-06-23T18:43:54.173 INFO:teuthology.orchestra.run.smithi158.stdout: libpq-13.5-1.el8.x86_64 2023-06-23T18:43:54.173 INFO:teuthology.orchestra.run.smithi158.stdout: libquadmath-8.5.0-19.el8.x86_64 2023-06-23T18:43:54.173 INFO:teuthology.orchestra.run.smithi158.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-06-23T18:43:54.173 INFO:teuthology.orchestra.run.smithi158.stdout: librados-devel-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.174 INFO:teuthology.orchestra.run.smithi158.stdout: libradosstriper1-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.174 INFO:teuthology.orchestra.run.smithi158.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-06-23T18:43:54.174 INFO:teuthology.orchestra.run.smithi158.stdout: librgw2-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.174 INFO:teuthology.orchestra.run.smithi158.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-06-23T18:43:54.174 INFO:teuthology.orchestra.run.smithi158.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-06-23T18:43:54.174 INFO:teuthology.orchestra.run.smithi158.stdout: libtool-2.4.6-25.el8.x86_64 2023-06-23T18:43:54.174 INFO:teuthology.orchestra.run.smithi158.stdout: libunwind-1.3.1-3.el8.x86_64 2023-06-23T18:43:54.174 INFO:teuthology.orchestra.run.smithi158.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-06-23T18:43:54.175 INFO:teuthology.orchestra.run.smithi158.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-06-23T18:43:54.175 INFO:teuthology.orchestra.run.smithi158.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-06-23T18:43:54.175 INFO:teuthology.orchestra.run.smithi158.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-06-23T18:43:54.175 INFO:teuthology.orchestra.run.smithi158.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-06-23T18:43:54.175 INFO:teuthology.orchestra.run.smithi158.stdout: openblas-0.3.15-4.el8.x86_64 2023-06-23T18:43:54.175 INFO:teuthology.orchestra.run.smithi158.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-06-23T18:43:54.175 INFO:teuthology.orchestra.run.smithi158.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-06-23T18:43:54.175 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-06-23T18:43:54.176 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-06-23T18:43:54.176 INFO:teuthology.orchestra.run.smithi158.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-06-23T18:43:54.176 INFO:teuthology.orchestra.run.smithi158.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-23T18:43:54.176 INFO:teuthology.orchestra.run.smithi158.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-23T18:43:54.176 INFO:teuthology.orchestra.run.smithi158.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-23T18:43:54.176 INFO:teuthology.orchestra.run.smithi158.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-06-23T18:43:54.176 INFO:teuthology.orchestra.run.smithi158.stdout: python3-babel-2.5.1-7.el8.noarch 2023-06-23T18:43:54.177 INFO:teuthology.orchestra.run.smithi158.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-06-23T18:43:54.177 INFO:teuthology.orchestra.run.smithi158.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-06-23T18:43:54.177 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-06-23T18:43:54.177 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-argparse-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.177 INFO:teuthology.orchestra.run.smithi158.stdout: python3-ceph-common-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.177 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cephfs-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.177 INFO:teuthology.orchestra.run.smithi158.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-06-23T18:43:54.177 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-06-23T18:43:54.178 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-06-23T18:43:54.178 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-06-23T18:43:54.178 INFO:teuthology.orchestra.run.smithi158.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-06-23T18:43:54.178 INFO:teuthology.orchestra.run.smithi158.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-06-23T18:43:54.178 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco-6.2-6.el8.noarch 2023-06-23T18:43:54.178 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-06-23T18:43:54.178 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-06-23T18:43:54.178 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-06-23T18:43:54.179 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-06-23T18:43:54.179 INFO:teuthology.orchestra.run.smithi158.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-06-23T18:43:54.179 INFO:teuthology.orchestra.run.smithi158.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-06-23T18:43:54.179 INFO:teuthology.orchestra.run.smithi158.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-06-23T18:43:54.179 INFO:teuthology.orchestra.run.smithi158.stdout: python3-mako-1.0.6-14.el8.noarch 2023-06-23T18:43:54.179 INFO:teuthology.orchestra.run.smithi158.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-06-23T18:43:54.179 INFO:teuthology.orchestra.run.smithi158.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-06-23T18:43:54.180 INFO:teuthology.orchestra.run.smithi158.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-06-23T18:43:54.180 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-06-23T18:43:54.180 INFO:teuthology.orchestra.run.smithi158.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-06-23T18:43:54.180 INFO:teuthology.orchestra.run.smithi158.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-06-23T18:43:54.180 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-06-23T18:43:54.180 INFO:teuthology.orchestra.run.smithi158.stdout: python3-portend-2.6-1.el8.noarch 2023-06-23T18:43:54.180 INFO:teuthology.orchestra.run.smithi158.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-06-23T18:43:54.180 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-06-23T18:43:54.181 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-06-23T18:43:54.181 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-06-23T18:43:54.181 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pycparser-2.14-14.el8.noarch 2023-06-23T18:43:54.181 INFO:teuthology.orchestra.run.smithi158.stdout: python3-pytz-2017.2-9.el8.noarch 2023-06-23T18:43:54.181 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rados-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.181 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rbd-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.181 INFO:teuthology.orchestra.run.smithi158.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-06-23T18:43:54.182 INFO:teuthology.orchestra.run.smithi158.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-06-23T18:43:54.182 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rgw-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.182 INFO:teuthology.orchestra.run.smithi158.stdout: python3-routes-2.4.1-12.el8.noarch 2023-06-23T18:43:54.182 INFO:teuthology.orchestra.run.smithi158.stdout: python3-rsa-4.8-1.el8.noarch 2023-06-23T18:43:54.182 INFO:teuthology.orchestra.run.smithi158.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-06-23T18:43:54.182 INFO:teuthology.orchestra.run.smithi158.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-06-23T18:43:54.182 INFO:teuthology.orchestra.run.smithi158.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-06-23T18:43:54.182 INFO:teuthology.orchestra.run.smithi158.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-06-23T18:43:54.183 INFO:teuthology.orchestra.run.smithi158.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-06-23T18:43:54.183 INFO:teuthology.orchestra.run.smithi158.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-06-23T18:43:54.183 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-06-23T18:43:54.183 INFO:teuthology.orchestra.run.smithi158.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-06-23T18:43:54.183 INFO:teuthology.orchestra.run.smithi158.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-06-23T18:43:54.183 INFO:teuthology.orchestra.run.smithi158.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-06-23T18:43:54.183 INFO:teuthology.orchestra.run.smithi158.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-06-23T18:43:54.183 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-fuse-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.184 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-mirror-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.184 INFO:teuthology.orchestra.run.smithi158.stdout: rbd-nbd-2:18.0.0-4479.g8627af3e.el8.x86_64 2023-06-23T18:43:54.184 INFO:teuthology.orchestra.run.smithi158.stdout: socat-1.7.4.1-1.el8.x86_64 2023-06-23T18:43:54.184 INFO:teuthology.orchestra.run.smithi158.stdout: thrift-0.13.0-2.el8.x86_64 2023-06-23T18:43:54.184 INFO:teuthology.orchestra.run.smithi158.stdout: uuid-1.6.2-43.el8.x86_64 2023-06-23T18:43:54.184 INFO:teuthology.orchestra.run.smithi158.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-06-23T18:43:54.184 INFO:teuthology.orchestra.run.smithi158.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-06-23T18:43:54.185 INFO:teuthology.orchestra.run.smithi158.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-06-23T18:43:54.185 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:54.185 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-06-23T18:43:54.499 DEBUG:teuthology.parallel:result is None 2023-06-23T18:43:54.500 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8627af3e0adcb765a3c249fcc209cba9f4873e1b 2023-06-23T18:43:54.714 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-06-23T18:43:54.744 INFO:teuthology.orchestra.run.smithi052.stdout:18.0.0-4479.g8627af3e.el8 2023-06-23T18:43:54.745 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4479.g8627af3e.el8 2023-06-23T18:43:54.746 INFO:teuthology.task.install:The correct ceph version 18.0.0-4479.g8627af3e is installed. 2023-06-23T18:43:54.746 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8627af3e0adcb765a3c249fcc209cba9f4873e1b 2023-06-23T18:43:54.965 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-06-23T18:43:54.994 INFO:teuthology.orchestra.run.smithi089.stdout:18.0.0-4479.g8627af3e.el8 2023-06-23T18:43:54.995 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4479.g8627af3e.el8 2023-06-23T18:43:54.995 INFO:teuthology.task.install:The correct ceph version 18.0.0-4479.g8627af3e is installed. 2023-06-23T18:43:54.995 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=8627af3e0adcb765a3c249fcc209cba9f4873e1b 2023-06-23T18:43:55.219 DEBUG:teuthology.orchestra.run.smithi158:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-06-23T18:43:55.275 INFO:teuthology.orchestra.run.smithi158.stdout:18.0.0-4479.g8627af3e.el8 2023-06-23T18:43:55.276 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4479.g8627af3e.el8 2023-06-23T18:43:55.276 INFO:teuthology.task.install:The correct ceph version 18.0.0-4479.g8627af3e is installed. 2023-06-23T18:43:55.277 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-06-23T18:43:55.277 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-06-23T18:43:55.277 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-23T18:43:55.316 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-23T18:43:55.316 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-23T18:43:55.353 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-06-23T18:43:55.354 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-23T18:43:55.428 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-06-23T18:43:55.428 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-06-23T18:43:55.429 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/daemon-helper 2023-06-23T18:43:55.463 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-23T18:43:55.534 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-23T18:43:55.535 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2023-06-23T18:43:55.568 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-23T18:43:55.639 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-06-23T18:43:55.639 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/daemon-helper 2023-06-23T18:43:55.708 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-23T18:43:55.820 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-06-23T18:43:55.820 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-06-23T18:43:55.821 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-23T18:43:55.854 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-23T18:43:55.927 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-23T18:43:55.927 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-23T18:43:55.960 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-23T18:43:56.030 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-06-23T18:43:56.031 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-23T18:43:56.100 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-23T18:43:56.211 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-06-23T18:43:56.212 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-06-23T18:43:56.212 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/stdin-killer 2023-06-23T18:43:56.246 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-23T18:43:56.319 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-23T18:43:56.319 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/stdin-killer 2023-06-23T18:43:56.352 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-23T18:43:56.422 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-06-23T18:43:56.423 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/usr/bin/stdin-killer 2023-06-23T18:43:56.494 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-23T18:43:56.565 INFO:teuthology.run_tasks:Running task ceph... 2023-06-23T18:43:56.648 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-06-23T18:43:56.649 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 777 /var/log/ceph 2023-06-23T18:43:56.651 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /var/log/ceph 2023-06-23T18:43:56.653 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 777 /var/log/ceph 2023-06-23T18:43:56.724 INFO:tasks.ceph:Disabling ceph logrotate... 2023-06-23T18:43:56.724 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-23T18:43:56.726 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-23T18:43:56.728 DEBUG:teuthology.orchestra.run.smithi158:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-23T18:43:56.799 INFO:tasks.ceph:Creating extra log directories... 2023-06-23T18:43:56.800 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-23T18:43:56.802 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-23T18:43:56.804 DEBUG:teuthology.orchestra.run.smithi158:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-23T18:43:56.886 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-06-23T18:43:56.887 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-06-23T18:43:56.887 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-06-23T18:43:56.888 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-06-23T18:43:56.888 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-23T18:43:56.909 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-23T18:43:57.034 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-06-23T18:43:57.065 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-23T18:43:57.066 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-23T18:43:57.087 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-23T18:43:57.210 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-06-23T18:43:57.240 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-06-23T18:43:57.240 DEBUG:teuthology.orchestra.run.smithi158:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-23T18:43:57.286 DEBUG:teuthology.orchestra.run.smithi158:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-23T18:43:57.517 DEBUG:teuthology.orchestra.run.smithi158:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-06-23T18:43:57.593 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-06-23T18:43:57.593 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-06-23T18:43:57.594 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi/7313889', 'branch': 'wip-rishabh-improvements-authmon', 'description': 'fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-common}}', 'email': None, 'first_in_suite': False, 'job_id': '7313889', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-06-23_17:37:30-fs-wip-rishabh-improvements-authmon-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-improvements-authmon'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-improvements-authmon', 'sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0']], 'sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-improvements-authmon', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_8627af3e0adcb765a3c249fcc209cba9f4873e1b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi052.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCuwSVvet/dbvZOV5d0NpDrTRFboc5LwnPEoXiPNA5k91N/9W78nJ6HXsjZeAc9bXmLyuLH7bTNa/T3Sqr9pHTluLB886V3mpI6JEywzy0vMXQekwXn/LyY5GrJ+jrLZVzqGLai9Mz4aVHMi3AZo2661Pe89FqnGcY0i+pxkzx5v0pmJ2VZ9ail0fj12zCDznkDB4mbHIHzpoFlMNtGViPaBFG2gOOSi5tKMTjh2Oz/4CXWeK20ttsceSX58nI/pkPhyO0SRfdcCGXwfBM5OH/n2AWuViAqcHJG0zqs+qbbJEwZXyJ1DxC0PIuZccbXnJECrP9EubcETErNssB+pDqofIWj+TSrepfuKLEJo4Z1Zzvu4WdSz0l3Tei6Z76G6bsW1qql9vgILWrB+0GDM63BeW0DJX9X1l5NvAVmv5r3CBKVMmwoecvUImahWZ5dRx2Zl1rJDM3IBSlIPhxGBc6boWxcp5LaCLY4gM52EC46qmAELgVHUtUR0VDA9+vVBI0=', 'smithi089.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjKCEYWhtdLD2qdUqrj8js1imvc+GW6NVfisx6/kIkWEMjUf59lSml+jl9MdPMhtf5XmqgPfOYRx2laiBkaOV+xHvTbzNZgdX1BVUxLNqDFSe7aNKRYTRWcYe3KHj3zKhlPsL4pxN5ztiljM22RWia377wSduh4c4sk2FPA92yv9aN6VjC6aE0mboGsN2Yimly1Fl47ho7kifTHdVeHhb9ZaNnFUXtIwYBea0beTEUObp9VM2Li24sZVvGCQJVh4Ix+Fx+T7YJeuyqPx7+7B0KiNTocYai9Npr/JHQk2giT7zKY8QAbf4RCk+buhxQ6YkUEv03/0+CmqVdPmlurr1ge9SGFH1mOYfVRzQv/VGKt7CP6vJ/ODfR3DUrMoN65jUti6mhKcc22pG+nfaUqgN+ah3zFIVs+X5aGCsiHAsuFQoUPNiNhHqigj0vek/6snO7N+wZ12lXrZ8XjlVwGHALNN6NMOyo1oZrwc935VkU5lVZ/mml8GRsQdBG+Evdr8E=', 'smithi158.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDgbIgfNflO9OCLmCEDDhWNzxtFO641eukcJJZeS5y23pppLgizMZOvlptAn7IwMonISde9y8LkcPtkdES8RTALz3iA6RKlN/lmH2msnf8/Em1JUQBe8D9P1toBc60bfUkGNjL95vV51y2Qixj/0n30+D32iEbQr2uvpCIhuTTo6sblJyT/Y2oxUJFMYzyWU/wJjtgcJ/sEeDbZOu2hSsOplmsgNrTwS0s3suf1C7wUNeoFEqjelZPWrPx6ZMmI3+/oXj9DLH665jCjziej/CzYdWySC2OclPhNg+714chHSJNOtUKDq7vkjDakLIKVc5YbskgsVKNce9AXrpPRVKa8QSg6jLoJtV/TPdg5jAxvQ0C1KU3J9d51YBbp88sAN2p4vQeRqjvARU3VDl+iCBqNhyagfZ8OMutDc2DD5J/M13RQv0RKEWDkT/xpTGYhLwXoJZ1BIyzxTgMlvLBqByKqXYZeDcgmoqJJblqCbNtoesEaxW07vTo/uHXAlWO6yls='}, 'task': None, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8627af3e0adcb765a3c249fcc209cba9f4873e1b'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_fscrypt']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end', 'if not is_kupstream() then reject() end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '076bbebc42a14f7d568aaa78eabb0038327bcb23', 'timestamp': '2023-06-23_17:37:30', 'tube': 'smithi', 'user': 'rishabh', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-06-23T18:43:57.595 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-23T18:43:57.598 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-23T18:43:57.601 DEBUG:teuthology.orchestra.run.smithi158:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-23T18:43:57.646 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/run/ceph 2023-06-23T18:43:57.661 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/run/ceph 2023-06-23T18:43:57.664 DEBUG:teuthology.orchestra.run.smithi158:> sudo install -d -m0777 -- /var/run/ceph 2023-06-23T18:43:57.736 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-06-23T18:43:57.736 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/scratch_devs of=/dev/stdout 2023-06-23T18:43:57.757 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-23T18:43:57.758 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_1 2023-06-23T18:43:57.818 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-23T18:43:57.819 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T18:43:57.819 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 385156 Links: 1 2023-06-23T18:43:57.819 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T18:43:57.819 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2023-06-23T18:43:57.819 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2023-06-23 18:43:44.906361581 +0000 2023-06-23T18:43:57.819 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2023-06-23 18:38:41.622035383 +0000 2023-06-23T18:43:57.820 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2023-06-23 18:38:41.622035383 +0000 2023-06-23T18:43:57.820 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2023-06-23T18:43:57.820 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-23T18:43:57.889 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2023-06-23T18:43:57.889 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2023-06-23T18:43:57.889 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.00011062 s, 4.6 MB/s 2023-06-23T18:43:57.890 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-23T18:43:57.952 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_2 2023-06-23T18:43:58.013 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-23T18:43:58.013 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T18:43:58.013 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 371534 Links: 1 2023-06-23T18:43:58.013 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T18:43:58.014 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2023-06-23T18:43:58.014 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2023-06-23 18:43:44.907361568 +0000 2023-06-23T18:43:58.014 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2023-06-23 18:38:42.151028103 +0000 2023-06-23T18:43:58.014 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2023-06-23 18:38:42.151028103 +0000 2023-06-23T18:43:58.014 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2023-06-23T18:43:58.014 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-23T18:43:58.081 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2023-06-23T18:43:58.082 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2023-06-23T18:43:58.082 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 8.7612e-05 s, 5.8 MB/s 2023-06-23T18:43:58.083 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-23T18:43:58.143 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_3 2023-06-23T18:43:58.203 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-23T18:43:58.204 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T18:43:58.204 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 385733 Links: 1 2023-06-23T18:43:58.204 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T18:43:58.204 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2023-06-23T18:43:58.204 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2023-06-23 18:43:44.907361568 +0000 2023-06-23T18:43:58.205 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2023-06-23 18:38:42.678020850 +0000 2023-06-23T18:43:58.205 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2023-06-23 18:38:42.678020850 +0000 2023-06-23T18:43:58.205 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2023-06-23T18:43:58.205 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-23T18:43:58.272 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2023-06-23T18:43:58.272 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2023-06-23T18:43:58.273 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 9.4483e-05 s, 5.4 MB/s 2023-06-23T18:43:58.274 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-23T18:43:58.335 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_4 2023-06-23T18:43:58.395 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-23T18:43:58.395 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T18:43:58.395 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 6h/6d Inode: 387501 Links: 1 2023-06-23T18:43:58.395 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T18:43:58.395 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2023-06-23T18:43:58.395 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2023-06-23 18:43:44.907361568 +0000 2023-06-23T18:43:58.396 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2023-06-23 18:38:43.208013556 +0000 2023-06-23T18:43:58.396 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2023-06-23 18:38:43.208013556 +0000 2023-06-23T18:43:58.396 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: - 2023-06-23T18:43:58.396 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-23T18:43:58.462 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2023-06-23T18:43:58.462 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2023-06-23T18:43:58.462 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.00010327 s, 5.0 MB/s 2023-06-23T18:43:58.463 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-23T18:43:58.523 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-23T18:43:58.523 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-23T18:43:58.524 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/scratch_devs of=/dev/stdout 2023-06-23T18:43:58.550 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-23T18:43:58.551 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_1 2023-06-23T18:43:58.612 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-23T18:43:58.613 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T18:43:58.613 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 388107 Links: 1 2023-06-23T18:43:58.613 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T18:43:58.613 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-06-23T18:43:58.613 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-06-23 18:43:40.103988391 +0000 2023-06-23T18:43:58.613 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-06-23 18:38:30.088673292 +0000 2023-06-23T18:43:58.613 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-06-23 18:38:30.088673292 +0000 2023-06-23T18:43:58.614 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2023-06-23T18:43:58.614 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-23T18:43:58.684 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-06-23T18:43:58.685 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-06-23T18:43:58.685 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.00024687 s, 2.1 MB/s 2023-06-23T18:43:58.685 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-23T18:43:58.748 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_2 2023-06-23T18:43:58.807 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-23T18:43:58.807 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T18:43:58.807 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 380612 Links: 1 2023-06-23T18:43:58.808 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T18:43:58.808 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-06-23T18:43:58.808 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-06-23 18:43:40.103988391 +0000 2023-06-23T18:43:58.808 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-06-23 18:38:30.619661148 +0000 2023-06-23T18:43:58.808 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-06-23 18:38:30.619661148 +0000 2023-06-23T18:43:58.808 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2023-06-23T18:43:58.809 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-23T18:43:58.876 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-06-23T18:43:58.876 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-06-23T18:43:58.876 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000226597 s, 2.3 MB/s 2023-06-23T18:43:58.877 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-23T18:43:58.937 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_3 2023-06-23T18:43:58.997 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-23T18:43:58.997 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T18:43:58.997 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 389165 Links: 1 2023-06-23T18:43:58.997 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T18:43:58.997 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-06-23T18:43:58.997 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-06-23 18:43:40.103988391 +0000 2023-06-23T18:43:58.998 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-06-23 18:38:31.141649210 +0000 2023-06-23T18:43:58.998 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-06-23 18:38:31.141649210 +0000 2023-06-23T18:43:58.998 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2023-06-23T18:43:58.998 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-23T18:43:59.063 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-06-23T18:43:59.064 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-06-23T18:43:59.064 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000223109 s, 2.3 MB/s 2023-06-23T18:43:59.065 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-23T18:43:59.124 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_4 2023-06-23T18:43:59.183 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-23T18:43:59.183 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T18:43:59.183 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 389305 Links: 1 2023-06-23T18:43:59.183 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T18:43:59.184 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-06-23T18:43:59.184 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-06-23 18:43:40.103988391 +0000 2023-06-23T18:43:59.184 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-06-23 18:38:31.662637295 +0000 2023-06-23T18:43:59.184 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-06-23 18:38:31.662637295 +0000 2023-06-23T18:43:59.184 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2023-06-23T18:43:59.185 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-23T18:43:59.248 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-06-23T18:43:59.249 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-06-23T18:43:59.249 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000212129 s, 2.4 MB/s 2023-06-23T18:43:59.250 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-23T18:43:59.308 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-23T18:43:59.308 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi052.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-23T18:43:59.309 INFO:tasks.ceph:Generating config... 2023-06-23T18:43:59.310 INFO:tasks.ceph:[client] client mount timeout = 600 2023-06-23T18:43:59.310 INFO:tasks.ceph:[client] debug client = 20 2023-06-23T18:43:59.311 INFO:tasks.ceph:[client] debug ms = 1 2023-06-23T18:43:59.311 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-06-23T18:43:59.312 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-06-23T18:43:59.312 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-06-23T18:43:59.312 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-06-23T18:43:59.312 INFO:tasks.ceph:[mds] debug mds = 20 2023-06-23T18:43:59.312 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-06-23T18:43:59.313 INFO:tasks.ceph:[mds] debug ms = 1 2023-06-23T18:43:59.313 INFO:tasks.ceph:[mds] mds debug frag = True 2023-06-23T18:43:59.313 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-06-23T18:43:59.313 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-06-23T18:43:59.313 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-06-23T18:43:59.314 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-06-23T18:43:59.314 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-06-23T18:43:59.314 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-06-23T18:43:59.315 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-06-23T18:43:59.315 INFO:tasks.ceph:[mgr] debug ms = 1 2023-06-23T18:43:59.316 INFO:tasks.ceph:[mon] debug mon = 20 2023-06-23T18:43:59.316 INFO:tasks.ceph:[mon] debug ms = 1 2023-06-23T18:43:59.317 INFO:tasks.ceph:[mon] debug paxos = 20 2023-06-23T18:43:59.317 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-06-23T18:43:59.318 INFO:tasks.ceph:[osd] bdev async discard = True 2023-06-23T18:43:59.318 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-06-23T18:43:59.318 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-06-23T18:43:59.319 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-06-23T18:43:59.319 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-06-23T18:43:59.320 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-06-23T18:43:59.320 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-06-23T18:43:59.321 INFO:tasks.ceph:[osd] debug ms = 1 2023-06-23T18:43:59.321 INFO:tasks.ceph:[osd] debug osd = 20 2023-06-23T18:43:59.321 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-06-23T18:43:59.322 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-06-23T18:43:59.322 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-06-23T18:43:59.323 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-06-23T18:43:59.323 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-06-23T18:43:59.324 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-06-23T18:43:59.324 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-06-23T18:43:59.325 INFO:tasks.ceph:Setting up mon.a... 2023-06-23T18:43:59.325 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-06-23T18:43:59.387 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.keyring 2023-06-23T18:43:59.390 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-06-23T18:43:59.442 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-23T18:43:59.471 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.52'), ('mon.b', '172.21.15.89'), ('mon.c', '[v2:172.21.15.89:3301,v1:172.21.15.89:6790]')] 2023-06-23T18:43:59.472 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.52,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]', 'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-06-23T18:43:59.473 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-06-23T18:43:59.473 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-06-23T18:43:59.530 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.52 --add b 172.21.15.89 --addv c '[v2:172.21.15.89:3301,v1:172.21.15.89:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:43:59.621 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:43:59.621 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: generated fsid cd0d1792-8aa8-49a7-9e5c-ba51edbbb077 2023-06-23T18:43:59.622 INFO:teuthology.orchestra.run.smithi052.stdout:setting min_mon_release = pacific 2023-06-23T18:43:59.622 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 0 2023-06-23T18:43:59.622 INFO:teuthology.orchestra.run.smithi052.stdout:fsid cd0d1792-8aa8-49a7-9e5c-ba51edbbb077 2023-06-23T18:43:59.622 INFO:teuthology.orchestra.run.smithi052.stdout:last_changed 2023-06-23T18:43:59.617637+0000 2023-06-23T18:43:59.622 INFO:teuthology.orchestra.run.smithi052.stdout:created 2023-06-23T18:43:59.617637+0000 2023-06-23T18:43:59.622 INFO:teuthology.orchestra.run.smithi052.stdout:min_mon_release 16 (pacific) 2023-06-23T18:43:59.623 INFO:teuthology.orchestra.run.smithi052.stdout:election_strategy: 1 2023-06-23T18:43:59.623 INFO:teuthology.orchestra.run.smithi052.stdout:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2023-06-23T18:43:59.623 INFO:teuthology.orchestra.run.smithi052.stdout:1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.b 2023-06-23T18:43:59.623 INFO:teuthology.orchestra.run.smithi052.stdout:2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2023-06-23T18:43:59.623 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-06-23T18:43:59.624 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-06-23T18:43:59.642 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID cd0d1792-8aa8-49a7-9e5c-ba51edbbb077... 2023-06-23T18:43:59.643 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-23T18:43:59.684 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-23T18:43:59.687 DEBUG:teuthology.orchestra.run.smithi158:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-23T18:43:59.728 INFO:teuthology.orchestra.run.smithi052.stdout:[global] 2023-06-23T18:43:59.729 INFO:teuthology.orchestra.run.smithi052.stdout: chdir = "" 2023-06-23T18:43:59.729 INFO:teuthology.orchestra.run.smithi052.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-23T18:43:59.729 INFO:teuthology.orchestra.run.smithi052.stdout: auth supported = cephx 2023-06-23T18:43:59.729 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.729 INFO:teuthology.orchestra.run.smithi052.stdout: filestore xattr use omap = true 2023-06-23T18:43:59.729 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.730 INFO:teuthology.orchestra.run.smithi052.stdout: mon clock drift allowed = 1.000 2023-06-23T18:43:59.730 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.730 INFO:teuthology.orchestra.run.smithi052.stdout: osd crush chooseleaf type = 0 2023-06-23T18:43:59.730 INFO:teuthology.orchestra.run.smithi052.stdout: auth debug = true 2023-06-23T18:43:59.730 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.730 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on old message = true 2023-06-23T18:43:59.730 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on bug = true 2023-06-23T18:43:59.730 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.731 INFO:teuthology.orchestra.run.smithi052.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-23T18:43:59.731 INFO:teuthology.orchestra.run.smithi052.stdout: mon pg warn max object skew = 0 2023-06-23T18:43:59.731 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.731 INFO:teuthology.orchestra.run.smithi052.stdout: # disable pg_autoscaler by default for new pools 2023-06-23T18:43:59.731 INFO:teuthology.orchestra.run.smithi052.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-23T18:43:59.731 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.732 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default size = 2 2023-06-23T18:43:59.732 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.732 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow primary affinity = true 2023-06-23T18:43:59.732 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow pg remap = true 2023-06-23T18:43:59.732 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on legacy crush tunables = false 2023-06-23T18:43:59.732 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on crush straw calc version zero = false 2023-06-23T18:43:59.733 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on no sortbitwise = false 2023-06-23T18:43:59.733 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on osd down out interval zero = false 2023-06-23T18:43:59.733 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on too few osds = false 2023-06-23T18:43:59.733 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-23T18:43:59.733 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-23T18:43:59.733 INFO:teuthology.orchestra.run.smithi052.stdout: mon_allow_pool_size_one = true 2023-06-23T18:43:59.733 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.734 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-23T18:43:59.734 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.734 INFO:teuthology.orchestra.run.smithi052.stdout: osd default data pool replay window = 5 2023-06-23T18:43:59.734 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.734 INFO:teuthology.orchestra.run.smithi052.stdout: mon allow pool delete = true 2023-06-23T18:43:59.734 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.734 INFO:teuthology.orchestra.run.smithi052.stdout: mon cluster log file level = debug 2023-06-23T18:43:59.734 INFO:teuthology.orchestra.run.smithi052.stdout: debug asserts on shutdown = true 2023-06-23T18:43:59.735 INFO:teuthology.orchestra.run.smithi052.stdout: mon health detail to clog = false 2023-06-23T18:43:59.735 INFO:teuthology.orchestra.run.smithi052.stdout: mon host = "172.21.15.52,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2023-06-23T18:43:59.735 INFO:teuthology.orchestra.run.smithi052.stdout: mon pg warn min per osd = 0 2023-06-23T18:43:59.735 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on skipped message = False 2023-06-23T18:43:59.735 INFO:teuthology.orchestra.run.smithi052.stdout: fsid = cd0d1792-8aa8-49a7-9e5c-ba51edbbb077 2023-06-23T18:43:59.735 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.735 INFO:teuthology.orchestra.run.smithi052.stdout:[osd] 2023-06-23T18:43:59.736 INFO:teuthology.orchestra.run.smithi052.stdout: osd journal size = 100 2023-06-23T18:43:59.736 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.736 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub load threshold = 5.0 2023-06-23T18:43:59.736 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub max interval = 600 2023-06-23T18:43:59.736 INFO:teuthology.orchestra.run.smithi052.stdout: osd mclock profile = high_recovery_ops 2023-06-23T18:43:59.736 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.736 INFO:teuthology.orchestra.run.smithi052.stdout: osd recover clone overlap = true 2023-06-23T18:43:59.737 INFO:teuthology.orchestra.run.smithi052.stdout: osd recovery max chunk = 1048576 2023-06-23T18:43:59.737 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.737 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug shutdown = true 2023-06-23T18:43:59.737 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug op order = true 2023-06-23T18:43:59.738 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug verify stray on activate = true 2023-06-23T18:43:59.738 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.738 INFO:teuthology.orchestra.run.smithi052.stdout: osd open classes on start = true 2023-06-23T18:43:59.738 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug pg log writeout = true 2023-06-23T18:43:59.738 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.738 INFO:teuthology.orchestra.run.smithi052.stdout: osd deep scrub update digest min age = 30 2023-06-23T18:43:59.739 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.739 INFO:teuthology.orchestra.run.smithi052.stdout: osd map max advance = 10 2023-06-23T18:43:59.739 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.739 INFO:teuthology.orchestra.run.smithi052.stdout: journal zero on create = true 2023-06-23T18:43:59.739 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.739 INFO:teuthology.orchestra.run.smithi052.stdout: filestore ondisk finisher threads = 3 2023-06-23T18:43:59.739 INFO:teuthology.orchestra.run.smithi052.stdout: filestore apply finisher threads = 3 2023-06-23T18:43:59.740 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.740 INFO:teuthology.orchestra.run.smithi052.stdout: bdev debug aio = true 2023-06-23T18:43:59.740 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug misdirected ops = true 2023-06-23T18:43:59.740 INFO:teuthology.orchestra.run.smithi052.stdout: bdev async discard = True 2023-06-23T18:43:59.740 INFO:teuthology.orchestra.run.smithi052.stdout: bdev enable discard = True 2023-06-23T18:43:59.740 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore allocator = bitmap 2023-06-23T18:43:59.740 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore block size = 96636764160 2023-06-23T18:43:59.741 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore fsck on mount = True 2023-06-23T18:43:59.741 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluefs = 1/20 2023-06-23T18:43:59.741 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluestore = 1/20 2023-06-23T18:43:59.741 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2023-06-23T18:43:59.741 INFO:teuthology.orchestra.run.smithi052.stdout: debug osd = 20 2023-06-23T18:43:59.741 INFO:teuthology.orchestra.run.smithi052.stdout: debug rocksdb = 4/10 2023-06-23T18:43:59.742 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd backfillfull_ratio = 0.85 2023-06-23T18:43:59.742 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd full ratio = 0.9 2023-06-23T18:43:59.742 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd nearfull ratio = 0.8 2023-06-23T18:43:59.742 INFO:teuthology.orchestra.run.smithi052.stdout: osd failsafe full ratio = 0.95 2023-06-23T18:43:59.742 INFO:teuthology.orchestra.run.smithi052.stdout: osd objectstore = bluestore 2023-06-23T18:43:59.742 INFO:teuthology.orchestra.run.smithi052.stdout: osd op complaint time = 180 2023-06-23T18:43:59.743 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.743 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr] 2023-06-23T18:43:59.743 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2023-06-23T18:43:59.743 INFO:teuthology.orchestra.run.smithi052.stdout: debug mgr = 20 2023-06-23T18:43:59.743 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2023-06-23T18:43:59.743 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2023-06-23T18:43:59.743 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2023-06-23T18:43:59.744 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2023-06-23T18:43:59.744 INFO:teuthology.orchestra.run.smithi052.stdout: mgr/telemetry/nag = false 2023-06-23T18:43:59.744 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.744 INFO:teuthology.orchestra.run.smithi052.stdout:[mon] 2023-06-23T18:43:59.744 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2023-06-23T18:43:59.745 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2023-06-23T18:43:59.745 INFO:teuthology.orchestra.run.smithi052.stdout: debug paxos = 20 2023-06-23T18:43:59.745 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2023-06-23T18:43:59.745 INFO:teuthology.orchestra.run.smithi052.stdout: mon data avail warn = 5 2023-06-23T18:43:59.745 INFO:teuthology.orchestra.run.smithi052.stdout: mon mgr mkfs grace = 240 2023-06-23T18:43:59.745 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2023-06-23T18:43:59.746 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd reporter subtree level = osd 2023-06-23T18:43:59.746 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd prime pg temp = true 2023-06-23T18:43:59.746 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2023-06-23T18:43:59.746 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.746 INFO:teuthology.orchestra.run.smithi052.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-23T18:43:59.746 INFO:teuthology.orchestra.run.smithi052.stdout: auth mon ticket ttl = 660 # 11m 2023-06-23T18:43:59.746 INFO:teuthology.orchestra.run.smithi052.stdout: auth service ticket ttl = 240 # 4m 2023-06-23T18:43:59.747 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.747 INFO:teuthology.orchestra.run.smithi052.stdout: # don't complain about insecure global_id in the test suite 2023-06-23T18:43:59.747 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-23T18:43:59.747 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-23T18:43:59.747 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.747 INFO:teuthology.orchestra.run.smithi052.stdout: # 1m isn't quite enough 2023-06-23T18:43:59.747 INFO:teuthology.orchestra.run.smithi052.stdout: mon_down_mkfs_grace = 2m 2023-06-23T18:43:59.747 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.748 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_filestore_osds = false 2023-06-23T18:43:59.748 INFO:teuthology.orchestra.run.smithi052.stdout: mon op complaint time = 120 2023-06-23T18:43:59.748 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:43:59.748 INFO:teuthology.orchestra.run.smithi052.stdout:[client] 2023-06-23T18:43:59.748 INFO:teuthology.orchestra.run.smithi052.stdout: rgw cache enabled = true 2023-06-23T18:43:59.748 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable ops log = true 2023-06-23T18:43:59.749 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable usage log = true 2023-06-23T18:43:59.749 INFO:teuthology.orchestra.run.smithi052.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-23T18:43:59.749 INFO:teuthology.orchestra.run.smithi052.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-23T18:43:59.749 INFO:teuthology.orchestra.run.smithi052.stdout: client mount timeout = 600 2023-06-23T18:43:59.749 INFO:teuthology.orchestra.run.smithi052.stdout: debug client = 20 2023-06-23T18:43:59.749 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2023-06-23T18:43:59.750 INFO:teuthology.orchestra.run.smithi052.stdout: rados mon op timeout = 900 2023-06-23T18:43:59.750 INFO:teuthology.orchestra.run.smithi052.stdout: rados osd op timeout = 900 2023-06-23T18:43:59.750 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.a] 2023-06-23T18:43:59.750 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.b] 2023-06-23T18:43:59.750 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.c] 2023-06-23T18:43:59.750 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a] 2023-06-23T18:43:59.750 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.c] 2023-06-23T18:43:59.751 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.b] 2023-06-23T18:43:59.751 INFO:teuthology.orchestra.run.smithi052.stdout:[mds] 2023-06-23T18:43:59.751 INFO:teuthology.orchestra.run.smithi052.stdout: debug mds = 20 2023-06-23T18:43:59.751 INFO:teuthology.orchestra.run.smithi052.stdout: debug mds balancer = 20 2023-06-23T18:43:59.751 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2023-06-23T18:43:59.751 INFO:teuthology.orchestra.run.smithi052.stdout: mds debug frag = True 2023-06-23T18:43:59.751 INFO:teuthology.orchestra.run.smithi052.stdout: mds debug scatterstat = True 2023-06-23T18:43:59.752 INFO:teuthology.orchestra.run.smithi052.stdout: mds op complaint time = 180 2023-06-23T18:43:59.752 INFO:teuthology.orchestra.run.smithi052.stdout: mds verify scatter = True 2023-06-23T18:43:59.752 INFO:teuthology.orchestra.run.smithi052.stdout: osd op complaint time = 180 2023-06-23T18:43:59.752 INFO:teuthology.orchestra.run.smithi052.stdout: rados mon op timeout = 900 2023-06-23T18:43:59.752 INFO:teuthology.orchestra.run.smithi052.stdout: rados osd op timeout = 900 2023-06-23T18:43:59.754 INFO:teuthology.orchestra.run.smithi089.stdout:[global] 2023-06-23T18:43:59.754 INFO:teuthology.orchestra.run.smithi089.stdout: chdir = "" 2023-06-23T18:43:59.754 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-23T18:43:59.754 INFO:teuthology.orchestra.run.smithi089.stdout: auth supported = cephx 2023-06-23T18:43:59.754 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.754 INFO:teuthology.orchestra.run.smithi089.stdout: filestore xattr use omap = true 2023-06-23T18:43:59.755 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.755 INFO:teuthology.orchestra.run.smithi089.stdout: mon clock drift allowed = 1.000 2023-06-23T18:43:59.755 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.755 INFO:teuthology.orchestra.run.smithi089.stdout: osd crush chooseleaf type = 0 2023-06-23T18:43:59.755 INFO:teuthology.orchestra.run.smithi089.stdout: auth debug = true 2023-06-23T18:43:59.755 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.755 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on old message = true 2023-06-23T18:43:59.756 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on bug = true 2023-06-23T18:43:59.756 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.756 INFO:teuthology.orchestra.run.smithi089.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-23T18:43:59.756 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn max object skew = 0 2023-06-23T18:43:59.756 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.756 INFO:teuthology.orchestra.run.smithi089.stdout: # disable pg_autoscaler by default for new pools 2023-06-23T18:43:59.756 INFO:teuthology.orchestra.run.smithi089.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-23T18:43:59.757 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.757 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default size = 2 2023-06-23T18:43:59.757 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.757 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow primary affinity = true 2023-06-23T18:43:59.757 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow pg remap = true 2023-06-23T18:43:59.757 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on legacy crush tunables = false 2023-06-23T18:43:59.757 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on crush straw calc version zero = false 2023-06-23T18:43:59.758 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on no sortbitwise = false 2023-06-23T18:43:59.758 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on osd down out interval zero = false 2023-06-23T18:43:59.758 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on too few osds = false 2023-06-23T18:43:59.758 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-23T18:43:59.758 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-23T18:43:59.758 INFO:teuthology.orchestra.run.smithi089.stdout: mon_allow_pool_size_one = true 2023-06-23T18:43:59.758 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.759 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-23T18:43:59.759 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.759 INFO:teuthology.orchestra.run.smithi089.stdout: osd default data pool replay window = 5 2023-06-23T18:43:59.759 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.759 INFO:teuthology.orchestra.run.smithi089.stdout: mon allow pool delete = true 2023-06-23T18:43:59.759 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.759 INFO:teuthology.orchestra.run.smithi089.stdout: mon cluster log file level = debug 2023-06-23T18:43:59.760 INFO:teuthology.orchestra.run.smithi089.stdout: debug asserts on shutdown = true 2023-06-23T18:43:59.760 INFO:teuthology.orchestra.run.smithi089.stdout: mon health detail to clog = false 2023-06-23T18:43:59.760 INFO:teuthology.orchestra.run.smithi089.stdout: mon host = "172.21.15.52,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2023-06-23T18:43:59.760 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn min per osd = 0 2023-06-23T18:43:59.760 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on skipped message = False 2023-06-23T18:43:59.760 INFO:teuthology.orchestra.run.smithi089.stdout: fsid = cd0d1792-8aa8-49a7-9e5c-ba51edbbb077 2023-06-23T18:43:59.761 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.761 INFO:teuthology.orchestra.run.smithi089.stdout:[osd] 2023-06-23T18:43:59.761 INFO:teuthology.orchestra.run.smithi089.stdout: osd journal size = 100 2023-06-23T18:43:59.761 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.761 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub load threshold = 5.0 2023-06-23T18:43:59.761 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub max interval = 600 2023-06-23T18:43:59.761 INFO:teuthology.orchestra.run.smithi089.stdout: osd mclock profile = high_recovery_ops 2023-06-23T18:43:59.761 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.762 INFO:teuthology.orchestra.run.smithi089.stdout: osd recover clone overlap = true 2023-06-23T18:43:59.762 INFO:teuthology.orchestra.run.smithi089.stdout: osd recovery max chunk = 1048576 2023-06-23T18:43:59.762 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.762 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug shutdown = true 2023-06-23T18:43:59.762 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug op order = true 2023-06-23T18:43:59.762 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug verify stray on activate = true 2023-06-23T18:43:59.762 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.763 INFO:teuthology.orchestra.run.smithi089.stdout: osd open classes on start = true 2023-06-23T18:43:59.763 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug pg log writeout = true 2023-06-23T18:43:59.763 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.763 INFO:teuthology.orchestra.run.smithi089.stdout: osd deep scrub update digest min age = 30 2023-06-23T18:43:59.763 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.763 INFO:teuthology.orchestra.run.smithi089.stdout: osd map max advance = 10 2023-06-23T18:43:59.764 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.764 INFO:teuthology.orchestra.run.smithi089.stdout: journal zero on create = true 2023-06-23T18:43:59.764 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.764 INFO:teuthology.orchestra.run.smithi089.stdout: filestore ondisk finisher threads = 3 2023-06-23T18:43:59.764 INFO:teuthology.orchestra.run.smithi089.stdout: filestore apply finisher threads = 3 2023-06-23T18:43:59.764 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.765 INFO:teuthology.orchestra.run.smithi089.stdout: bdev debug aio = true 2023-06-23T18:43:59.765 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug misdirected ops = true 2023-06-23T18:43:59.765 INFO:teuthology.orchestra.run.smithi089.stdout: bdev async discard = True 2023-06-23T18:43:59.765 INFO:teuthology.orchestra.run.smithi089.stdout: bdev enable discard = True 2023-06-23T18:43:59.765 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore allocator = bitmap 2023-06-23T18:43:59.765 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore block size = 96636764160 2023-06-23T18:43:59.765 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore fsck on mount = True 2023-06-23T18:43:59.766 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluefs = 1/20 2023-06-23T18:43:59.766 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluestore = 1/20 2023-06-23T18:43:59.766 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-06-23T18:43:59.766 INFO:teuthology.orchestra.run.smithi089.stdout: debug osd = 20 2023-06-23T18:43:59.766 INFO:teuthology.orchestra.run.smithi089.stdout: debug rocksdb = 4/10 2023-06-23T18:43:59.766 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd backfillfull_ratio = 0.85 2023-06-23T18:43:59.766 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd full ratio = 0.9 2023-06-23T18:43:59.767 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd nearfull ratio = 0.8 2023-06-23T18:43:59.767 INFO:teuthology.orchestra.run.smithi089.stdout: osd failsafe full ratio = 0.95 2023-06-23T18:43:59.767 INFO:teuthology.orchestra.run.smithi089.stdout: osd objectstore = bluestore 2023-06-23T18:43:59.767 INFO:teuthology.orchestra.run.smithi089.stdout: osd op complaint time = 180 2023-06-23T18:43:59.767 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.767 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr] 2023-06-23T18:43:59.767 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-06-23T18:43:59.767 INFO:teuthology.orchestra.run.smithi089.stdout: debug mgr = 20 2023-06-23T18:43:59.768 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2023-06-23T18:43:59.768 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2023-06-23T18:43:59.768 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2023-06-23T18:43:59.768 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2023-06-23T18:43:59.768 INFO:teuthology.orchestra.run.smithi089.stdout: mgr/telemetry/nag = false 2023-06-23T18:43:59.768 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.769 INFO:teuthology.orchestra.run.smithi089.stdout:[mon] 2023-06-23T18:43:59.769 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-06-23T18:43:59.769 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2023-06-23T18:43:59.769 INFO:teuthology.orchestra.run.smithi089.stdout: debug paxos = 20 2023-06-23T18:43:59.769 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2023-06-23T18:43:59.770 INFO:teuthology.orchestra.run.smithi089.stdout: mon data avail warn = 5 2023-06-23T18:43:59.770 INFO:teuthology.orchestra.run.smithi089.stdout: mon mgr mkfs grace = 240 2023-06-23T18:43:59.770 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2023-06-23T18:43:59.770 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd reporter subtree level = osd 2023-06-23T18:43:59.770 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd prime pg temp = true 2023-06-23T18:43:59.770 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2023-06-23T18:43:59.770 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.771 INFO:teuthology.orchestra.run.smithi089.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-23T18:43:59.771 INFO:teuthology.orchestra.run.smithi089.stdout: auth mon ticket ttl = 660 # 11m 2023-06-23T18:43:59.771 INFO:teuthology.orchestra.run.smithi089.stdout: auth service ticket ttl = 240 # 4m 2023-06-23T18:43:59.771 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.771 INFO:teuthology.orchestra.run.smithi089.stdout: # don't complain about insecure global_id in the test suite 2023-06-23T18:43:59.771 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-23T18:43:59.771 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-23T18:43:59.771 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.772 INFO:teuthology.orchestra.run.smithi089.stdout: # 1m isn't quite enough 2023-06-23T18:43:59.772 INFO:teuthology.orchestra.run.smithi089.stdout: mon_down_mkfs_grace = 2m 2023-06-23T18:43:59.772 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.772 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_filestore_osds = false 2023-06-23T18:43:59.772 INFO:teuthology.orchestra.run.smithi089.stdout: mon op complaint time = 120 2023-06-23T18:43:59.772 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-23T18:43:59.773 INFO:teuthology.orchestra.run.smithi089.stdout:[client] 2023-06-23T18:43:59.773 INFO:teuthology.orchestra.run.smithi089.stdout: rgw cache enabled = true 2023-06-23T18:43:59.773 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable ops log = true 2023-06-23T18:43:59.773 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable usage log = true 2023-06-23T18:43:59.773 INFO:teuthology.orchestra.run.smithi089.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-23T18:43:59.773 INFO:teuthology.orchestra.run.smithi089.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-23T18:43:59.773 INFO:teuthology.orchestra.run.smithi089.stdout: client mount timeout = 600 2023-06-23T18:43:59.774 INFO:teuthology.orchestra.run.smithi089.stdout: debug client = 20 2023-06-23T18:43:59.774 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-06-23T18:43:59.774 INFO:teuthology.orchestra.run.smithi089.stdout: rados mon op timeout = 900 2023-06-23T18:43:59.774 INFO:teuthology.orchestra.run.smithi089.stdout: rados osd op timeout = 900 2023-06-23T18:43:59.774 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.a] 2023-06-23T18:43:59.774 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.b] 2023-06-23T18:43:59.775 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.c] 2023-06-23T18:43:59.775 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2023-06-23T18:43:59.775 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.c] 2023-06-23T18:43:59.775 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2023-06-23T18:43:59.775 INFO:teuthology.orchestra.run.smithi089.stdout:[mds] 2023-06-23T18:43:59.775 INFO:teuthology.orchestra.run.smithi089.stdout: debug mds = 20 2023-06-23T18:43:59.775 INFO:teuthology.orchestra.run.smithi089.stdout: debug mds balancer = 20 2023-06-23T18:43:59.776 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-06-23T18:43:59.776 INFO:teuthology.orchestra.run.smithi089.stdout: mds debug frag = True 2023-06-23T18:43:59.776 INFO:teuthology.orchestra.run.smithi089.stdout: mds debug scatterstat = True 2023-06-23T18:43:59.776 INFO:teuthology.orchestra.run.smithi089.stdout: mds op complaint time = 180 2023-06-23T18:43:59.776 INFO:teuthology.orchestra.run.smithi089.stdout: mds verify scatter = True 2023-06-23T18:43:59.776 INFO:teuthology.orchestra.run.smithi089.stdout: osd op complaint time = 180 2023-06-23T18:43:59.776 INFO:teuthology.orchestra.run.smithi089.stdout: rados mon op timeout = 900 2023-06-23T18:43:59.777 INFO:teuthology.orchestra.run.smithi089.stdout: rados osd op timeout = 900 2023-06-23T18:43:59.807 INFO:teuthology.orchestra.run.smithi158.stdout:[global] 2023-06-23T18:43:59.808 INFO:teuthology.orchestra.run.smithi158.stdout: chdir = "" 2023-06-23T18:43:59.808 INFO:teuthology.orchestra.run.smithi158.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-23T18:43:59.808 INFO:teuthology.orchestra.run.smithi158.stdout: auth supported = cephx 2023-06-23T18:43:59.809 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.809 INFO:teuthology.orchestra.run.smithi158.stdout: filestore xattr use omap = true 2023-06-23T18:43:59.809 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.809 INFO:teuthology.orchestra.run.smithi158.stdout: mon clock drift allowed = 1.000 2023-06-23T18:43:59.810 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.810 INFO:teuthology.orchestra.run.smithi158.stdout: osd crush chooseleaf type = 0 2023-06-23T18:43:59.810 INFO:teuthology.orchestra.run.smithi158.stdout: auth debug = true 2023-06-23T18:43:59.811 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.811 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on old message = true 2023-06-23T18:43:59.811 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on bug = true 2023-06-23T18:43:59.811 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.812 INFO:teuthology.orchestra.run.smithi158.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-23T18:43:59.812 INFO:teuthology.orchestra.run.smithi158.stdout: mon pg warn max object skew = 0 2023-06-23T18:43:59.812 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.813 INFO:teuthology.orchestra.run.smithi158.stdout: # disable pg_autoscaler by default for new pools 2023-06-23T18:43:59.813 INFO:teuthology.orchestra.run.smithi158.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-23T18:43:59.813 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.813 INFO:teuthology.orchestra.run.smithi158.stdout: osd pool default size = 2 2023-06-23T18:43:59.813 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.814 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd allow primary affinity = true 2023-06-23T18:43:59.814 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd allow pg remap = true 2023-06-23T18:43:59.814 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on legacy crush tunables = false 2023-06-23T18:43:59.814 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on crush straw calc version zero = false 2023-06-23T18:43:59.814 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on no sortbitwise = false 2023-06-23T18:43:59.814 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on osd down out interval zero = false 2023-06-23T18:43:59.814 INFO:teuthology.orchestra.run.smithi158.stdout: mon warn on too few osds = false 2023-06-23T18:43:59.815 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-23T18:43:59.815 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-23T18:43:59.815 INFO:teuthology.orchestra.run.smithi158.stdout: mon_allow_pool_size_one = true 2023-06-23T18:43:59.815 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.815 INFO:teuthology.orchestra.run.smithi158.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-23T18:43:59.815 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.815 INFO:teuthology.orchestra.run.smithi158.stdout: osd default data pool replay window = 5 2023-06-23T18:43:59.816 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.816 INFO:teuthology.orchestra.run.smithi158.stdout: mon allow pool delete = true 2023-06-23T18:43:59.816 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.816 INFO:teuthology.orchestra.run.smithi158.stdout: mon cluster log file level = debug 2023-06-23T18:43:59.816 INFO:teuthology.orchestra.run.smithi158.stdout: debug asserts on shutdown = true 2023-06-23T18:43:59.816 INFO:teuthology.orchestra.run.smithi158.stdout: mon health detail to clog = false 2023-06-23T18:43:59.816 INFO:teuthology.orchestra.run.smithi158.stdout: mon host = "172.21.15.52,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2023-06-23T18:43:59.817 INFO:teuthology.orchestra.run.smithi158.stdout: mon pg warn min per osd = 0 2023-06-23T18:43:59.817 INFO:teuthology.orchestra.run.smithi158.stdout: ms die on skipped message = False 2023-06-23T18:43:59.817 INFO:teuthology.orchestra.run.smithi158.stdout: fsid = cd0d1792-8aa8-49a7-9e5c-ba51edbbb077 2023-06-23T18:43:59.817 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.817 INFO:teuthology.orchestra.run.smithi158.stdout:[osd] 2023-06-23T18:43:59.817 INFO:teuthology.orchestra.run.smithi158.stdout: osd journal size = 100 2023-06-23T18:43:59.817 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.818 INFO:teuthology.orchestra.run.smithi158.stdout: osd scrub load threshold = 5.0 2023-06-23T18:43:59.818 INFO:teuthology.orchestra.run.smithi158.stdout: osd scrub max interval = 600 2023-06-23T18:43:59.818 INFO:teuthology.orchestra.run.smithi158.stdout: osd mclock profile = high_recovery_ops 2023-06-23T18:43:59.818 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.818 INFO:teuthology.orchestra.run.smithi158.stdout: osd recover clone overlap = true 2023-06-23T18:43:59.818 INFO:teuthology.orchestra.run.smithi158.stdout: osd recovery max chunk = 1048576 2023-06-23T18:43:59.818 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.819 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug shutdown = true 2023-06-23T18:43:59.819 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug op order = true 2023-06-23T18:43:59.819 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug verify stray on activate = true 2023-06-23T18:43:59.819 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.819 INFO:teuthology.orchestra.run.smithi158.stdout: osd open classes on start = true 2023-06-23T18:43:59.819 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug pg log writeout = true 2023-06-23T18:43:59.819 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.820 INFO:teuthology.orchestra.run.smithi158.stdout: osd deep scrub update digest min age = 30 2023-06-23T18:43:59.820 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.820 INFO:teuthology.orchestra.run.smithi158.stdout: osd map max advance = 10 2023-06-23T18:43:59.820 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.820 INFO:teuthology.orchestra.run.smithi158.stdout: journal zero on create = true 2023-06-23T18:43:59.820 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.820 INFO:teuthology.orchestra.run.smithi158.stdout: filestore ondisk finisher threads = 3 2023-06-23T18:43:59.821 INFO:teuthology.orchestra.run.smithi158.stdout: filestore apply finisher threads = 3 2023-06-23T18:43:59.821 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.821 INFO:teuthology.orchestra.run.smithi158.stdout: bdev debug aio = true 2023-06-23T18:43:59.821 INFO:teuthology.orchestra.run.smithi158.stdout: osd debug misdirected ops = true 2023-06-23T18:43:59.821 INFO:teuthology.orchestra.run.smithi158.stdout: bdev async discard = True 2023-06-23T18:43:59.821 INFO:teuthology.orchestra.run.smithi158.stdout: bdev enable discard = True 2023-06-23T18:43:59.821 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore allocator = bitmap 2023-06-23T18:43:59.822 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore block size = 96636764160 2023-06-23T18:43:59.822 INFO:teuthology.orchestra.run.smithi158.stdout: bluestore fsck on mount = True 2023-06-23T18:43:59.822 INFO:teuthology.orchestra.run.smithi158.stdout: debug bluefs = 1/20 2023-06-23T18:43:59.822 INFO:teuthology.orchestra.run.smithi158.stdout: debug bluestore = 1/20 2023-06-23T18:43:59.822 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-06-23T18:43:59.822 INFO:teuthology.orchestra.run.smithi158.stdout: debug osd = 20 2023-06-23T18:43:59.822 INFO:teuthology.orchestra.run.smithi158.stdout: debug rocksdb = 4/10 2023-06-23T18:43:59.823 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd backfillfull_ratio = 0.85 2023-06-23T18:43:59.823 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd full ratio = 0.9 2023-06-23T18:43:59.823 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd nearfull ratio = 0.8 2023-06-23T18:43:59.823 INFO:teuthology.orchestra.run.smithi158.stdout: osd failsafe full ratio = 0.95 2023-06-23T18:43:59.823 INFO:teuthology.orchestra.run.smithi158.stdout: osd objectstore = bluestore 2023-06-23T18:43:59.823 INFO:teuthology.orchestra.run.smithi158.stdout: osd op complaint time = 180 2023-06-23T18:43:59.823 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.824 INFO:teuthology.orchestra.run.smithi158.stdout:[mgr] 2023-06-23T18:43:59.824 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-06-23T18:43:59.824 INFO:teuthology.orchestra.run.smithi158.stdout: debug mgr = 20 2023-06-23T18:43:59.824 INFO:teuthology.orchestra.run.smithi158.stdout: debug mon = 20 2023-06-23T18:43:59.824 INFO:teuthology.orchestra.run.smithi158.stdout: debug auth = 20 2023-06-23T18:43:59.824 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min pgs per osd = 4 2023-06-23T18:43:59.824 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min bytes per osd = 10 2023-06-23T18:43:59.825 INFO:teuthology.orchestra.run.smithi158.stdout: mgr/telemetry/nag = false 2023-06-23T18:43:59.825 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.825 INFO:teuthology.orchestra.run.smithi158.stdout:[mon] 2023-06-23T18:43:59.825 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-06-23T18:43:59.825 INFO:teuthology.orchestra.run.smithi158.stdout: debug mon = 20 2023-06-23T18:43:59.825 INFO:teuthology.orchestra.run.smithi158.stdout: debug paxos = 20 2023-06-23T18:43:59.825 INFO:teuthology.orchestra.run.smithi158.stdout: debug auth = 20 2023-06-23T18:43:59.826 INFO:teuthology.orchestra.run.smithi158.stdout: mon data avail warn = 5 2023-06-23T18:43:59.826 INFO:teuthology.orchestra.run.smithi158.stdout: mon mgr mkfs grace = 240 2023-06-23T18:43:59.826 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min pgs per osd = 4 2023-06-23T18:43:59.826 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd reporter subtree level = osd 2023-06-23T18:43:59.826 INFO:teuthology.orchestra.run.smithi158.stdout: mon osd prime pg temp = true 2023-06-23T18:43:59.826 INFO:teuthology.orchestra.run.smithi158.stdout: mon reweight min bytes per osd = 10 2023-06-23T18:43:59.827 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.827 INFO:teuthology.orchestra.run.smithi158.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-23T18:43:59.827 INFO:teuthology.orchestra.run.smithi158.stdout: auth mon ticket ttl = 660 # 11m 2023-06-23T18:43:59.827 INFO:teuthology.orchestra.run.smithi158.stdout: auth service ticket ttl = 240 # 4m 2023-06-23T18:43:59.827 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.827 INFO:teuthology.orchestra.run.smithi158.stdout: # don't complain about insecure global_id in the test suite 2023-06-23T18:43:59.827 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-23T18:43:59.827 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-23T18:43:59.828 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.828 INFO:teuthology.orchestra.run.smithi158.stdout: # 1m isn't quite enough 2023-06-23T18:43:59.828 INFO:teuthology.orchestra.run.smithi158.stdout: mon_down_mkfs_grace = 2m 2023-06-23T18:43:59.828 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.828 INFO:teuthology.orchestra.run.smithi158.stdout: mon_warn_on_filestore_osds = false 2023-06-23T18:43:59.828 INFO:teuthology.orchestra.run.smithi158.stdout: mon op complaint time = 120 2023-06-23T18:43:59.829 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:43:59.829 INFO:teuthology.orchestra.run.smithi158.stdout:[client] 2023-06-23T18:43:59.829 INFO:teuthology.orchestra.run.smithi158.stdout: rgw cache enabled = true 2023-06-23T18:43:59.829 INFO:teuthology.orchestra.run.smithi158.stdout: rgw enable ops log = true 2023-06-23T18:43:59.829 INFO:teuthology.orchestra.run.smithi158.stdout: rgw enable usage log = true 2023-06-23T18:43:59.829 INFO:teuthology.orchestra.run.smithi158.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-23T18:43:59.829 INFO:teuthology.orchestra.run.smithi158.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-23T18:43:59.829 INFO:teuthology.orchestra.run.smithi158.stdout: client mount timeout = 600 2023-06-23T18:43:59.830 INFO:teuthology.orchestra.run.smithi158.stdout: debug client = 20 2023-06-23T18:43:59.830 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-06-23T18:43:59.830 INFO:teuthology.orchestra.run.smithi158.stdout: rados mon op timeout = 900 2023-06-23T18:43:59.830 INFO:teuthology.orchestra.run.smithi158.stdout: rados osd op timeout = 900 2023-06-23T18:43:59.830 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.a] 2023-06-23T18:43:59.830 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.b] 2023-06-23T18:43:59.831 INFO:teuthology.orchestra.run.smithi158.stdout:[mon.c] 2023-06-23T18:43:59.831 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.a] 2023-06-23T18:43:59.831 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.c] 2023-06-23T18:43:59.831 INFO:teuthology.orchestra.run.smithi158.stdout:[mds.b] 2023-06-23T18:43:59.831 INFO:teuthology.orchestra.run.smithi158.stdout:[mds] 2023-06-23T18:43:59.831 INFO:teuthology.orchestra.run.smithi158.stdout: debug mds = 20 2023-06-23T18:43:59.831 INFO:teuthology.orchestra.run.smithi158.stdout: debug mds balancer = 20 2023-06-23T18:43:59.832 INFO:teuthology.orchestra.run.smithi158.stdout: debug ms = 1 2023-06-23T18:43:59.832 INFO:teuthology.orchestra.run.smithi158.stdout: mds debug frag = True 2023-06-23T18:43:59.832 INFO:teuthology.orchestra.run.smithi158.stdout: mds debug scatterstat = True 2023-06-23T18:43:59.832 INFO:teuthology.orchestra.run.smithi158.stdout: mds op complaint time = 180 2023-06-23T18:43:59.832 INFO:teuthology.orchestra.run.smithi158.stdout: mds verify scatter = True 2023-06-23T18:43:59.832 INFO:teuthology.orchestra.run.smithi158.stdout: osd op complaint time = 180 2023-06-23T18:43:59.832 INFO:teuthology.orchestra.run.smithi158.stdout: rados mon op timeout = 900 2023-06-23T18:43:59.833 INFO:teuthology.orchestra.run.smithi158.stdout: rados osd op timeout = 900 2023-06-23T18:43:59.837 INFO:tasks.ceph:Creating admin key on mon.a... 2023-06-23T18:43:59.837 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-06-23T18:43:59.947 INFO:tasks.ceph:Copying monmap to all nodes... 2023-06-23T18:43:59.947 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-06-23T18:43:59.948 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-06-23T18:43:59.966 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-06-23T18:43:59.967 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-06-23T18:44:00.025 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi052.front.sepia.ceph.com 2023-06-23T18:44:00.025 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-06-23T18:44:00.026 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-23T18:44:00.026 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-23T18:44:00.235 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-06-23T18:44:00.236 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:44:00.312 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi089.front.sepia.ceph.com 2023-06-23T18:44:00.313 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-23T18:44:00.313 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-23T18:44:00.313 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-23T18:44:00.357 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-23T18:44:00.357 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:44:00.417 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi158.front.sepia.ceph.com 2023-06-23T18:44:00.417 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-06-23T18:44:00.417 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-23T18:44:00.418 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-23T18:44:00.511 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-06-23T18:44:00.511 DEBUG:teuthology.orchestra.run.smithi158:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:44:00.595 INFO:tasks.ceph:Setting up mon nodes... 2023-06-23T18:44:00.596 INFO:tasks.ceph:Setting up mgr nodes... 2023-06-23T18:44:00.596 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-06-23T18:44:00.661 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-06-23T18:44:00.664 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-06-23T18:44:00.740 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-06-23T18:44:00.743 INFO:tasks.ceph:Setting up mds nodes... 2023-06-23T18:44:00.744 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-06-23T18:44:00.806 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-06-23T18:44:00.808 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-06-23T18:44:00.838 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-06-23T18:44:00.935 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-06-23T18:44:00.938 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-06-23T18:44:00.965 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-06-23T18:44:01.026 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-06-23T18:44:01.028 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-06-23T18:44:01.057 INFO:tasks.ceph_client:Setting up client nodes... 2023-06-23T18:44:01.057 DEBUG:teuthology.orchestra.run.smithi158:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-06-23T18:44:01.166 INFO:teuthology.orchestra.run.smithi158.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-06-23T18:44:01.197 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-06-23T18:44:01.197 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi052.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-23T18:44:01.197 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-06-23T18:44:01.226 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-23T18:44:01.226 INFO:tasks.ceph:role: osd.0 2023-06-23T18:44:01.227 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi052.front.sepia.ceph.com 2023-06-23T18:44:01.227 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-23T18:44:01.337 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T18:44:01.338 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T18:44:01.338 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T18:44:01.338 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-23T18:44:01.338 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T18:44:01.338 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2023-06-23T18:44:01.338 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T18:44:01.338 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T18:44:01.339 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T18:44:01.339 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T18:44:01.359 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2023-06-23T18:44:01.361 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2023-06-23T18:44:01.361 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-06-23T18:44:01.403 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-06-23T18:44:01.476 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-06-23T18:44:01.544 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-23T18:44:01.545 INFO:tasks.ceph:role: osd.1 2023-06-23T18:44:01.545 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi052.front.sepia.ceph.com 2023-06-23T18:44:01.545 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-23T18:44:01.612 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T18:44:01.612 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T18:44:01.613 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T18:44:01.613 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-23T18:44:01.613 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T18:44:01.613 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2023-06-23T18:44:01.613 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T18:44:01.613 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T18:44:01.613 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T18:44:01.613 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T18:44:01.635 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2023-06-23T18:44:01.637 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2023-06-23T18:44:01.637 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-06-23T18:44:01.717 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-06-23T18:44:01.789 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-06-23T18:44:01.857 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-23T18:44:01.857 INFO:tasks.ceph:role: osd.2 2023-06-23T18:44:01.857 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi052.front.sepia.ceph.com 2023-06-23T18:44:01.858 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-23T18:44:01.924 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T18:44:01.924 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T18:44:01.924 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T18:44:01.924 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-23T18:44:01.925 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T18:44:01.925 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2023-06-23T18:44:01.925 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T18:44:01.925 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T18:44:01.925 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T18:44:01.925 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T18:44:01.947 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2023-06-23T18:44:01.948 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2023-06-23T18:44:01.948 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-06-23T18:44:02.029 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-06-23T18:44:02.101 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-06-23T18:44:02.170 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-23T18:44:02.170 INFO:tasks.ceph:role: osd.3 2023-06-23T18:44:02.170 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi052.front.sepia.ceph.com 2023-06-23T18:44:02.171 DEBUG:teuthology.orchestra.run.smithi052:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-23T18:44:02.238 INFO:teuthology.orchestra.run.smithi052.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T18:44:02.238 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T18:44:02.238 INFO:teuthology.orchestra.run.smithi052.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T18:44:02.238 INFO:teuthology.orchestra.run.smithi052.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-23T18:44:02.238 INFO:teuthology.orchestra.run.smithi052.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T18:44:02.238 INFO:teuthology.orchestra.run.smithi052.stdout: = sunit=0 swidth=0 blks 2023-06-23T18:44:02.239 INFO:teuthology.orchestra.run.smithi052.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T18:44:02.239 INFO:teuthology.orchestra.run.smithi052.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T18:44:02.239 INFO:teuthology.orchestra.run.smithi052.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T18:44:02.239 INFO:teuthology.orchestra.run.smithi052.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T18:44:02.260 INFO:teuthology.orchestra.run.smithi052.stdout:Discarding blocks...Done. 2023-06-23T18:44:02.262 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi052.front.sepia.ceph.com -o noatime 2023-06-23T18:44:02.262 DEBUG:teuthology.orchestra.run.smithi052:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-06-23T18:44:02.342 DEBUG:teuthology.orchestra.run.smithi052:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-06-23T18:44:02.413 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:44:02.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:02.497+0000 7fc681c83640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-06-23T18:44:02.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:02.497+0000 7fc681c83640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-06-23T18:44:02.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:02.497+0000 7fc681c83640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-23T18:44:02.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:02.497+0000 7fc681c83640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-23T18:44:02.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:02.497+0000 7fc681c83640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-23T18:44:02.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:02.498+0000 7fc681c83640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-06-23T18:44:05.353 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-06-23T18:44:05.387 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:44:05.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:05.475+0000 7f015faef640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-06-23T18:44:05.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:05.476+0000 7f015faef640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-06-23T18:44:05.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:05.476+0000 7f015faef640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-23T18:44:05.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:05.476+0000 7f015faef640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-23T18:44:05.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:05.476+0000 7f015faef640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-23T18:44:05.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:05.476+0000 7f015faef640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-06-23T18:44:08.328 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-06-23T18:44:08.364 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:44:08.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:08.455+0000 7f30461e1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-06-23T18:44:08.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:08.455+0000 7f30461e1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-06-23T18:44:08.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:08.455+0000 7f30461e1640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-23T18:44:08.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:08.455+0000 7f30461e1640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-23T18:44:08.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:08.455+0000 7f30461e1640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-23T18:44:08.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:08.455+0000 7f30461e1640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-06-23T18:44:11.315 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-06-23T18:44:11.349 DEBUG:teuthology.orchestra.run.smithi052:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:44:11.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:11.438+0000 7f7b38142640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-06-23T18:44:11.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:11.438+0000 7f7b38142640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-06-23T18:44:11.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:11.438+0000 7f7b38142640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-23T18:44:11.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:11.438+0000 7f7b38142640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-23T18:44:11.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:11.438+0000 7f7b38142640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-23T18:44:11.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:11.439+0000 7f7b38142640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-06-23T18:44:14.285 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-06-23T18:44:14.318 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-06-23T18:44:14.353 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-23T18:44:14.354 INFO:tasks.ceph:role: osd.4 2023-06-23T18:44:14.354 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com 2023-06-23T18:44:14.354 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-23T18:44:14.434 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T18:44:14.434 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T18:44:14.434 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T18:44:14.435 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-23T18:44:14.435 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T18:44:14.435 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-06-23T18:44:14.435 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T18:44:14.435 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T18:44:14.435 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T18:44:14.435 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T18:44:14.869 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-06-23T18:44:14.871 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-06-23T18:44:14.871 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-06-23T18:44:15.009 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-06-23T18:44:15.047 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-06-23T18:44:15.117 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-23T18:44:15.118 INFO:tasks.ceph:role: osd.5 2023-06-23T18:44:15.118 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com 2023-06-23T18:44:15.118 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-23T18:44:15.194 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T18:44:15.195 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T18:44:15.195 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T18:44:15.195 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-23T18:44:15.195 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T18:44:15.195 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-06-23T18:44:15.195 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T18:44:15.196 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T18:44:15.196 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T18:44:15.196 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T18:44:15.620 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-06-23T18:44:15.622 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-06-23T18:44:15.622 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-06-23T18:44:15.733 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-06-23T18:44:15.767 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-06-23T18:44:15.835 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-23T18:44:15.836 INFO:tasks.ceph:role: osd.6 2023-06-23T18:44:15.836 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com 2023-06-23T18:44:15.836 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-23T18:44:15.912 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T18:44:15.913 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T18:44:15.913 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T18:44:15.913 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-23T18:44:15.913 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T18:44:15.913 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-06-23T18:44:15.913 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T18:44:15.914 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T18:44:15.914 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T18:44:15.914 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T18:44:16.365 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-06-23T18:44:16.366 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-06-23T18:44:16.367 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-06-23T18:44:16.524 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-06-23T18:44:16.561 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-06-23T18:44:16.630 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-23T18:44:16.630 INFO:tasks.ceph:role: osd.7 2023-06-23T18:44:16.630 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com 2023-06-23T18:44:16.631 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-23T18:44:16.708 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T18:44:16.708 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T18:44:16.708 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T18:44:16.708 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-23T18:44:16.709 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T18:44:16.709 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-06-23T18:44:16.709 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T18:44:16.709 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T18:44:16.709 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T18:44:16.709 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T18:44:17.154 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-06-23T18:44:17.156 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-06-23T18:44:17.156 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-06-23T18:44:17.310 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-06-23T18:44:17.347 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:44:17.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:17.433+0000 7fb4bbb56640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-06-23T18:44:17.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:17.433+0000 7fb4bbb56640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-06-23T18:44:17.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:17.433+0000 7fb4bbb56640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-23T18:44:17.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:17.433+0000 7fb4bbb56640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-23T18:44:17.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:17.433+0000 7fb4bbb56640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-23T18:44:17.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:17.434+0000 7fb4bbb56640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-06-23T18:44:20.287 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-06-23T18:44:20.320 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:44:20.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:20.406+0000 7ff514b3d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-06-23T18:44:20.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:20.406+0000 7ff514b3d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-06-23T18:44:20.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:20.406+0000 7ff514b3d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-23T18:44:20.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:20.406+0000 7ff514b3d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-23T18:44:20.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:20.406+0000 7ff514b3d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-23T18:44:20.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:20.407+0000 7ff514b3d640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-06-23T18:44:23.261 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-06-23T18:44:23.294 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:44:23.386 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:23.381+0000 7f0331a46640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-06-23T18:44:23.386 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:23.381+0000 7f0331a46640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-06-23T18:44:23.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:23.381+0000 7f0331a46640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-23T18:44:23.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:23.381+0000 7f0331a46640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-23T18:44:23.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:23.381+0000 7f0331a46640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-23T18:44:23.387 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:23.382+0000 7f0331a46640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-06-23T18:44:26.237 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-06-23T18:44:26.270 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:44:26.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:26.355+0000 7f3e5c5d5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-06-23T18:44:26.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:26.355+0000 7f3e5c5d5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-06-23T18:44:26.361 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:26.355+0000 7f3e5c5d5640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-23T18:44:26.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:26.355+0000 7f3e5c5d5640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-23T18:44:26.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:26.355+0000 7f3e5c5d5640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-23T18:44:26.362 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:26.356+0000 7f3e5c5d5640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-06-23T18:44:27.598 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:44:27.600 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:44:27.602 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:44:29.217 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-06-23T18:44:29.250 INFO:tasks.ceph:Reading keys from all nodes... 2023-06-23T18:44:29.250 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-06-23T18:44:29.250 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-06-23T18:44:29.285 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-06-23T18:44:29.286 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-06-23T18:44:29.358 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-06-23T18:44:29.359 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-06-23T18:44:29.431 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-06-23T18:44:29.431 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-06-23T18:44:29.502 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-06-23T18:44:29.502 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-06-23T18:44:29.573 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-06-23T18:44:29.573 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-06-23T18:44:29.643 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-06-23T18:44:29.643 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-06-23T18:44:29.712 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-23T18:44:29.713 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-06-23T18:44:29.745 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-23T18:44:29.745 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-06-23T18:44:29.815 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-23T18:44:29.816 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-06-23T18:44:29.884 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-23T18:44:29.884 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-06-23T18:44:29.952 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-23T18:44:29.953 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-06-23T18:44:30.021 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-23T18:44:30.021 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-06-23T18:44:30.088 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-06-23T18:44:30.088 DEBUG:teuthology.orchestra.run.smithi158:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-06-23T18:44:30.138 INFO:tasks.ceph:Adding keys to all mons... 2023-06-23T18:44:30.138 DEBUG:teuthology.orchestra.run.smithi052:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-23T18:44:30.141 DEBUG:teuthology.orchestra.run.smithi089:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-23T18:44:30.167 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.y] 2023-06-23T18:44:30.167 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDw55Vk7IQ3JxAAzfHr63bx3pWejXUKmJC6VQ== 2023-06-23T18:44:30.167 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2023-06-23T18:44:30.167 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDw55VkDiPWLxAAyWF0WbHh1ZGWjqLdPyu0kw== 2023-06-23T18:44:30.168 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.c] 2023-06-23T18:44:30.168 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDw55VkQPaMNxAAWwo0dmNhFSanIW0qXHhufg== 2023-06-23T18:44:30.168 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.0] 2023-06-23T18:44:30.168 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDy55VkjB60HRAAek9wA3mUSGy4lIwOOWo+yw== 2023-06-23T18:44:30.168 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.1] 2023-06-23T18:44:30.168 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQD155VkRXtpHBAA+liUao5Oc2AVnXe6N3wMjw== 2023-06-23T18:44:30.169 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.2] 2023-06-23T18:44:30.169 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQD455VkF4AsGxAA3nuZaaTp7JVdMYaN24iEFA== 2023-06-23T18:44:30.169 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.3] 2023-06-23T18:44:30.169 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQD755VkVYIvGhAAG5SgmCIbV42HY6HZOzKL5w== 2023-06-23T18:44:30.169 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.x] 2023-06-23T18:44:30.169 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDw55Vkx2DuKxAApmEU7ym6eJO69g1gk9tp4g== 2023-06-23T18:44:30.169 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2023-06-23T18:44:30.169 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDx55Vkv/5TARAAFsNqKs7VgeqgphjxMcMy8g== 2023-06-23T18:44:30.170 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.4] 2023-06-23T18:44:30.170 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAB6JVkHT3lGRAAf/G/BfF8v+g/reaTJwpvmw== 2023-06-23T18:44:30.170 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.5] 2023-06-23T18:44:30.170 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAE6JVkUD1IGBAAzjL1Wr/afpTHvpEZfGzOBA== 2023-06-23T18:44:30.170 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.6] 2023-06-23T18:44:30.170 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAH6JVkVkrLFhAA3daVtv5TTUkHGJiUqvUoVw== 2023-06-23T18:44:30.170 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.7] 2023-06-23T18:44:30.170 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAK6JVkzXpLFRAA2EMtuhxTF6dZ3wrdmse+HA== 2023-06-23T18:44:30.171 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2023-06-23T18:44:30.171 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDx55Vkbva3CRAABdlhryMtWjf5jsU2sSwuwg== 2023-06-23T18:44:30.171 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.y] 2023-06-23T18:44:30.171 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDw55Vk7IQ3JxAAzfHr63bx3pWejXUKmJC6VQ== 2023-06-23T18:44:30.172 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a] 2023-06-23T18:44:30.172 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDw55VkDiPWLxAAyWF0WbHh1ZGWjqLdPyu0kw== 2023-06-23T18:44:30.172 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.c] 2023-06-23T18:44:30.172 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDw55VkQPaMNxAAWwo0dmNhFSanIW0qXHhufg== 2023-06-23T18:44:30.172 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.0] 2023-06-23T18:44:30.172 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDy55VkjB60HRAAek9wA3mUSGy4lIwOOWo+yw== 2023-06-23T18:44:30.172 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.1] 2023-06-23T18:44:30.172 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD155VkRXtpHBAA+liUao5Oc2AVnXe6N3wMjw== 2023-06-23T18:44:30.173 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.2] 2023-06-23T18:44:30.173 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD455VkF4AsGxAA3nuZaaTp7JVdMYaN24iEFA== 2023-06-23T18:44:30.173 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.3] 2023-06-23T18:44:30.173 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD755VkVYIvGhAAG5SgmCIbV42HY6HZOzKL5w== 2023-06-23T18:44:30.173 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.x] 2023-06-23T18:44:30.173 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDw55Vkx2DuKxAApmEU7ym6eJO69g1gk9tp4g== 2023-06-23T18:44:30.173 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.b] 2023-06-23T18:44:30.174 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDx55Vkv/5TARAAFsNqKs7VgeqgphjxMcMy8g== 2023-06-23T18:44:30.174 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.4] 2023-06-23T18:44:30.174 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQAB6JVkHT3lGRAAf/G/BfF8v+g/reaTJwpvmw== 2023-06-23T18:44:30.174 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.5] 2023-06-23T18:44:30.174 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQAE6JVkUD1IGBAAzjL1Wr/afpTHvpEZfGzOBA== 2023-06-23T18:44:30.174 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.6] 2023-06-23T18:44:30.174 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQAH6JVkVkrLFhAA3daVtv5TTUkHGJiUqvUoVw== 2023-06-23T18:44:30.174 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.7] 2023-06-23T18:44:30.175 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQAK6JVkzXpLFRAA2EMtuhxTF6dZ3wrdmse+HA== 2023-06-23T18:44:30.175 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2023-06-23T18:44:30.175 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDx55Vkbva3CRAABdlhryMtWjf5jsU2sSwuwg== 2023-06-23T18:44:30.176 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-23T18:44:30.219 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-23T18:44:30.278 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T18:44:30.280 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T18:44:30.339 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T18:44:30.341 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T18:44:30.397 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:44:30.399 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:44:30.453 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:44:30.455 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:44:30.509 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:44:30.511 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:44:30.564 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:44:30.566 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:44:30.620 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-23T18:44:30.622 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-23T18:44:30.675 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T18:44:30.678 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T18:44:30.735 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:44:30.737 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:44:30.791 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:44:30.793 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:44:30.847 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:44:30.849 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:44:30.902 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:44:30.905 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T18:44:30.958 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-23T18:44:30.962 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-23T18:44:31.019 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-06-23T18:44:31.019 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-06-23T18:44:31.047 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-23T18:44:31.147 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-06-23T18:44:31.174 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-06-23T18:44:31.203 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-23T18:44:31.301 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-06-23T18:44:31.327 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-06-23T18:44:31.395 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-23T18:44:31.493 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-06-23T18:44:31.519 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:44:31.521 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-23T18:44:31.576 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-06-23T18:44:31.577 INFO:tasks.ceph.mon.a:Restarting daemon 2023-06-23T18:44:31.577 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-06-23T18:44:31.580 INFO:tasks.ceph.mon.a:Started 2023-06-23T18:44:31.580 INFO:tasks.ceph.mon.b:Restarting daemon 2023-06-23T18:44:31.581 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-06-23T18:44:31.618 INFO:tasks.ceph.mon.b:Started 2023-06-23T18:44:31.618 INFO:tasks.ceph.mon.c:Restarting daemon 2023-06-23T18:44:31.619 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-06-23T18:44:31.620 INFO:tasks.ceph.mon.c:Started 2023-06-23T18:44:31.621 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-06-23T18:44:31.621 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-06-23T18:44:31.621 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-06-23T18:44:31.623 INFO:tasks.ceph.mgr.y:Started 2023-06-23T18:44:31.623 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-06-23T18:44:31.624 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-06-23T18:44:31.625 INFO:tasks.ceph.mgr.x:Started 2023-06-23T18:44:31.626 INFO:tasks.ceph:Setting crush tunables to default 2023-06-23T18:44:31.626 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd crush tunables default 2023-06-23T18:44:31.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.748+0000 7f7851651700 1 Processor -- start 2023-06-23T18:44:31.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.748+0000 7f7851651700 1 -- start start 2023-06-23T18:44:31.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.748+0000 7f7851651700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f784c0b5f40 0x7f784c0b85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:31.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.748+0000 7f7851651700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f784c0b6cf0 0x7f784c06af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:31.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.748+0000 7f7851651700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f784c0b8df0 con 0x7f784c071a70 2023-06-23T18:44:31.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.748+0000 7f7851651700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f784c0b90d0 con 0x7f784c0b6cf0 2023-06-23T18:44:31.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.748+0000 7f7851651700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f784c14b070 con 0x7f784c0b5f40 2023-06-23T18:44:31.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.749+0000 7f784b7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f784c0b6cf0 0x7f784c06af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:31.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.749+0000 7f784b7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f784c0b6cf0 0x7f784c06af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54728/0 (socket says 172.21.15.52:54728) 2023-06-23T18:44:31.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.749+0000 7f784b7fe700 1 -- 172.21.15.52:0/3073748745 learned_addr learned my addr 172.21.15.52:0/3073748745 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:31.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.749+0000 7f784b7fe700 1 -- 172.21.15.52:0/3073748745 >> v2:172.21.15.52:3300/0 conn(0x7f784c0b6cf0 msgr2=0x7f784c06af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-06-23T18:44:31.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.749+0000 7f784b7fe700 1 -- 172.21.15.52:0/3073748745 >> v2:172.21.15.52:3300/0 conn(0x7f784c0b6cf0 msgr2=0x7f784c06af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T18:44:31.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.749+0000 7f784b7fe700 1 --2- 172.21.15.52:0/3073748745 >> v2:172.21.15.52:3300/0 conn(0x7f784c0b6cf0 0x7f784c06af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-23T18:44:31.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.749+0000 7f784b7fe700 1 --2- 172.21.15.52:0/3073748745 >> v2:172.21.15.52:3300/0 conn(0x7f784c0b6cf0 0x7f784c06af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-23T18:44:31.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.749+0000 7f784affd700 1 --2- 172.21.15.52:0/3073748745 >> v2:172.21.15.89:3300/0 conn(0x7f784c0b5f40 0x7f784c0b85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:31.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.749+0000 7f784affd700 1 -- 172.21.15.52:0/3073748745 >> v2:172.21.15.89:3300/0 conn(0x7f784c0b5f40 msgr2=0x7f784c0b85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-23T18:44:31.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.749+0000 7f784affd700 1 -- 172.21.15.52:0/3073748745 >> v2:172.21.15.89:3300/0 conn(0x7f784c0b5f40 msgr2=0x7f784c0b85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T18:44:31.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.749+0000 7f784affd700 1 --2- 172.21.15.52:0/3073748745 >> v2:172.21.15.89:3300/0 conn(0x7f784c0b5f40 0x7f784c0b85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-23T18:44:31.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.749+0000 7f784affd700 1 --2- 172.21.15.52:0/3073748745 >> v2:172.21.15.89:3300/0 conn(0x7f784c0b5f40 0x7f784c0b85d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-23T18:44:31.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.931+0000 7f7849ffb700 1 -- 172.21.15.52:0/3073748745 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 627892066 0 0) 0x7f784c0b8df0 con 0x7f784c071a70 2023-06-23T18:44:31.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.931+0000 7f7849ffb700 1 -- 172.21.15.52:0/3073748745 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78340057c0 con 0x7f784c071a70 2023-06-23T18:44:31.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.931+0000 7f7849ffb700 1 -- 172.21.15.52:0/3073748745 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2205538589 0 0) 0x7f78340057c0 con 0x7f784c071a70 2023-06-23T18:44:31.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.931+0000 7f7849ffb700 1 -- 172.21.15.52:0/3073748745 >> v2:172.21.15.89:3300/0 conn(0x7f784c0b5f40 msgr2=0x7f784c0b85d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T18:44:31.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.931+0000 7f7849ffb700 1 --2- 172.21.15.52:0/3073748745 >> v2:172.21.15.89:3300/0 conn(0x7f784c0b5f40 0x7f784c0b85d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:31.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.931+0000 7f7849ffb700 1 -- 172.21.15.52:0/3073748745 >> v2:172.21.15.52:3300/0 conn(0x7f784c0b6cf0 msgr2=0x7f784c06af00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T18:44:31.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.931+0000 7f7849ffb700 1 --2- 172.21.15.52:0/3073748745 >> v2:172.21.15.52:3300/0 conn(0x7f784c0b6cf0 0x7f784c06af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:31.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.931+0000 7f7849ffb700 1 -- 172.21.15.52:0/3073748745 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784c071270 con 0x7f784c071a70 2023-06-23T18:44:31.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.931+0000 7f7849ffb700 1 -- 172.21.15.52:0/3073748745 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7f7840001670 con 0x7f784c071a70 2023-06-23T18:44:31.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.931+0000 7f7849ffb700 1 -- 172.21.15.52:0/3073748745 >> v1:172.21.15.52:6789/0 conn(0x7f784c071a70 legacy=0x7f784c14a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:31.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.931+0000 7f7849ffb700 1 --2- 172.21.15.52:0/3073748745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7834005c40 0x7f7834006050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:31.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.931+0000 7f7849ffb700 1 --2- 172.21.15.52:0/3073748745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7834006a60 0x7f7834006ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:31.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.931+0000 7f7849ffb700 1 --2- 172.21.15.52:0/3073748745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7834007410 0x7f783400dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:31.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.931+0000 7f7849ffb700 1 -- 172.21.15.52:0/3073748745 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c0b90d0 con 0x7f7834006a60 2023-06-23T18:44:31.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.931+0000 7f7849ffb700 1 -- 172.21.15.52:0/3073748745 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c14b070 con 0x7f7834005c40 2023-06-23T18:44:31.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.931+0000 7f7849ffb700 1 -- 172.21.15.52:0/3073748745 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f783400e3a0 con 0x7f7834007410 2023-06-23T18:44:31.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.932+0000 7f784a7fc700 1 --2- 172.21.15.52:0/3073748745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7834006a60 0x7f7834006ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:31.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.932+0000 7f784b7fe700 1 --2- 172.21.15.52:0/3073748745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7834007410 0x7f783400dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:31.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.932+0000 7f784affd700 1 --2- 172.21.15.52:0/3073748745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7834005c40 0x7f7834006050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:31.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.932+0000 7f784a7fc700 1 -- 172.21.15.52:0/3073748745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7834007410 msgr2=0x7f783400dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:31.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.932+0000 7f784a7fc700 1 --2- 172.21.15.52:0/3073748745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7834007410 0x7f783400dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:31.942 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.932+0000 7f784a7fc700 1 -- 172.21.15.52:0/3073748745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7834005c40 msgr2=0x7f7834006050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:31.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.932+0000 7f784a7fc700 1 --2- 172.21.15.52:0/3073748745 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7834005c40 0x7f7834006050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:31.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.932+0000 7f784a7fc700 1 -- 172.21.15.52:0/3073748745 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78340057c0 con 0x7f7834006a60 2023-06-23T18:44:31.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.932+0000 7f784b7fe700 1 --2- 172.21.15.52:0/3073748745 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7834007410 0x7f783400dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:31.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.932+0000 7f784b7fe700 1 -- 172.21.15.52:0/3073748745 reap_dead start 2023-06-23T18:44:31.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.932+0000 7f784a7fc700 1 --2- 172.21.15.52:0/3073748745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7834006a60 0x7f7834006ed0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f784000c190 tx=0x7f7834007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54554738044deba server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:31.943 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.932+0000 7f7849ffb700 1 -- 172.21.15.52:0/3073748745 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840007b30 con 0x7f7834006a60 2023-06-23T18:44:31.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.932+0000 7f7849ffb700 1 -- 172.21.15.52:0/3073748745 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784000ccf0 con 0x7f7834006a60 2023-06-23T18:44:31.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.932+0000 7f7849ffb700 1 -- 172.21.15.52:0/3073748745 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840012660 con 0x7f7834006a60 2023-06-23T18:44:31.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.933+0000 7f7851651700 1 -- 172.21.15.52:0/3073748745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7834006a60 msgr2=0x7f7834006ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:31.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.933+0000 7f7851651700 1 --2- 172.21.15.52:0/3073748745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7834006a60 0x7f7834006ed0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f784000c190 tx=0x7f7834007a90 comp rx=0 tx=0).stop 2023-06-23T18:44:31.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.933+0000 7f7851651700 1 -- 172.21.15.52:0/3073748745 shutdown_connections 2023-06-23T18:44:31.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.933+0000 7f7851651700 1 --2- 172.21.15.52:0/3073748745 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7834006a60 0x7f7834006ed0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:31.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.933+0000 7f7851651700 1 -- 172.21.15.52:0/3073748745 >> 172.21.15.52:0/3073748745 conn(0x7f784c0b95c0 msgr2=0x7f784c0b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:31.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.933+0000 7f7851651700 1 -- 172.21.15.52:0/3073748745 shutdown_connections 2023-06-23T18:44:31.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.933+0000 7f7851651700 1 -- 172.21.15.52:0/3073748745 wait complete. 2023-06-23T18:44:31.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.935+0000 7f7851651700 1 Processor -- start 2023-06-23T18:44:31.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.935+0000 7f7851651700 1 -- start start 2023-06-23T18:44:31.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.936+0000 7f7851651700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7834006a60 0x7f784c1de890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:31.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.936+0000 7f7851651700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f784c0a7a90 0x7f784c0a7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:31.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.936+0000 7f7851651700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f784c0b2e50 0x7f784c0b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:31.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.936+0000 7f7851651700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c1dedd0 con 0x7f784c0a7a90 2023-06-23T18:44:31.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.936+0000 7f7851651700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c142140 con 0x7f784c0b2e50 2023-06-23T18:44:31.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.936+0000 7f7851651700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784c144810 con 0x7f7834006a60 2023-06-23T18:44:31.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.936+0000 7f784affd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7834006a60 0x7f784c1de890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:31.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.936+0000 7f784a7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f784c0a7a90 0x7f784c0a7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:31.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.936+0000 7f784b7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f784c0b2e50 0x7f784c0b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:31.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.936+0000 7f784a7fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f784c0a7a90 0x7f784c0a7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54756/0 (socket says 172.21.15.52:54756) 2023-06-23T18:44:31.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.936+0000 7f784a7fc700 1 -- 172.21.15.52:0/1123277354 learned_addr learned my addr 172.21.15.52:0/1123277354 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:31.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.936+0000 7f784affd700 1 -- 172.21.15.52:0/1123277354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f784c0b2e50 msgr2=0x7f784c0b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:31.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.936+0000 7f784affd700 1 --2- 172.21.15.52:0/1123277354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f784c0b2e50 0x7f784c0b32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:31.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.936+0000 7f784affd700 1 -- 172.21.15.52:0/1123277354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f784c0a7a90 msgr2=0x7f784c0a7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:31.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.936+0000 7f784affd700 1 --2- 172.21.15.52:0/1123277354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f784c0a7a90 0x7f784c0a7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:31.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.936+0000 7f784affd700 1 -- 172.21.15.52:0/1123277354 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784c140160 con 0x7f7834006a60 2023-06-23T18:44:31.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.936+0000 7f784a7fc700 1 --2- 172.21.15.52:0/1123277354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f784c0a7a90 0x7f784c0a7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:31.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.937+0000 7f784affd700 1 --2- 172.21.15.52:0/1123277354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7834006a60 0x7f784c1de890 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f783c0108c0 tx=0x7f783c010bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:31.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.941+0000 7f78337fe700 1 -- 172.21.15.52:0/1123277354 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c015940 con 0x7f7834006a60 2023-06-23T18:44:31.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.941+0000 7f78337fe700 1 -- 172.21.15.52:0/1123277354 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783c015aa0 con 0x7f7834006a60 2023-06-23T18:44:31.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.941+0000 7f78337fe700 1 -- 172.21.15.52:0/1123277354 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c015e30 con 0x7f7834006a60 2023-06-23T18:44:31.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.941+0000 7f7851651700 1 -- 172.21.15.52:0/1123277354 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f784c1df3f0 con 0x7f7834006a60 2023-06-23T18:44:31.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.941+0000 7f7851651700 1 -- 172.21.15.52:0/1123277354 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f784c142e70 con 0x7f7834006a60 2023-06-23T18:44:31.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.941+0000 7f78337fe700 1 -- 172.21.15.52:0/1123277354 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f783c016420 con 0x7f7834006a60 2023-06-23T18:44:31.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.941+0000 7f78337fe700 1 -- 172.21.15.52:0/1123277354 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f783c01f4d0 con 0x7f7834006a60 2023-06-23T18:44:31.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.942+0000 7f7851651700 1 -- 172.21.15.52:0/1123277354 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f784c1449d0 con 0x7f7834006a60 2023-06-23T18:44:31.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:31.946+0000 7f78337fe700 1 -- 172.21.15.52:0/1123277354 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f783c03eb00 con 0x7f7834006a60 2023-06-23T18:44:32.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:32.022+0000 7f7851651700 1 -- 172.21.15.52:0/1123277354 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f784c04e1d0 con 0x7f7834006a60 2023-06-23T18:44:32.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:32.031+0000 7f78337fe700 1 -- 172.21.15.52:0/1123277354 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f783c02d020 con 0x7f7834006a60 2023-06-23T18:44:32.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:32.032+0000 7f7851651700 1 -- 172.21.15.52:0/1123277354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7834006a60 msgr2=0x7f784c1de890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:32.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:32.032+0000 7f7851651700 1 --2- 172.21.15.52:0/1123277354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7834006a60 0x7f784c1de890 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f783c0108c0 tx=0x7f783c010bd0 comp rx=0 tx=0).stop 2023-06-23T18:44:32.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:32.032+0000 7f7851651700 1 -- 172.21.15.52:0/1123277354 shutdown_connections 2023-06-23T18:44:32.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:32.032+0000 7f7851651700 1 --2- 172.21.15.52:0/1123277354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f784c0b2e50 0x7f784c0b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:32.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:32.032+0000 7f7851651700 1 --2- 172.21.15.52:0/1123277354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7834006a60 0x7f784c1de890 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:32.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:32.032+0000 7f7851651700 1 --2- 172.21.15.52:0/1123277354 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f784c0a7a90 0x7f784c0a7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:32.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:32.032+0000 7f7851651700 1 -- 172.21.15.52:0/1123277354 >> 172.21.15.52:0/1123277354 conn(0x7f784c0b95c0 msgr2=0x7f784c0baa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:32.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:32.032+0000 7f7851651700 1 -- 172.21.15.52:0/1123277354 shutdown_connections 2023-06-23T18:44:32.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:32.032+0000 7f7851651700 1 -- 172.21.15.52:0/1123277354 wait complete. 2023-06-23T18:44:32.041 INFO:teuthology.orchestra.run.smithi052.stderr:adjusted tunables profile to default 2023-06-23T18:44:32.050 INFO:tasks.ceph:check_enable_crimson: False 2023-06-23T18:44:32.050 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-06-23T18:44:32.051 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-06-23T18:44:32.051 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-06-23T18:44:32.066 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:32.060+0000 7fc6a58b3200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-23T18:44:32.066 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-06-23T18:44:32.061+0000 7f44ea8a2200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-23T18:44:32.079 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-06-23T18:44:32.079 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-06-23T18:44:32.147 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-06-23T18:44:32.147 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-06-23T18:44:32.236 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:32.231+0000 7fc6a58b3200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-23T18:44:32.241 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2023-06-23T18:44:32.241 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-06-23T18:44:32.263 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-06-23T18:44:32.257+0000 7f44ea8a2200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-23T18:44:32.290 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-23T18:44:32.290 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-06-23T18:44:32.317 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-23T18:44:32.318 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-06-23T18:44:32.384 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-23T18:44:32.385 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-06-23T18:44:32.451 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-23T18:44:32.452 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-06-23T18:44:32.518 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new c371fb28-1b15-4e43-8d5a-43e402920ed9 0 2023-06-23T18:44:32.579 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:32.573+0000 7fc6a58b3200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-23T18:44:32.609 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-06-23T18:44:32.604+0000 7f44ea8a2200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-23T18:44:32.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.676+0000 7fcb66aec700 1 Processor -- start 2023-06-23T18:44:32.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.676+0000 7fcb66aec700 1 -- start start 2023-06-23T18:44:32.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.677+0000 7fcb66aec700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcb6006a4a0 0x7fcb600b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:32.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.677+0000 7fcb66aec700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcb600b9a20 0x7fcb600b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:32.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.677+0000 7fcb66aec700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb600b70e0 con 0x7fcb6006a0d0 2023-06-23T18:44:32.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.677+0000 7fcb66aec700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb6006b090 con 0x7fcb600b9a20 2023-06-23T18:44:32.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.677+0000 7fcb66aec700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb6006a960 con 0x7fcb6006a4a0 2023-06-23T18:44:32.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.677+0000 7fcb5ffff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcb6006a4a0 0x7fcb600b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:32.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.677+0000 7fcb5ffff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcb6006a4a0 0x7fcb600b3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41954/0 (socket says 172.21.15.89:41954) 2023-06-23T18:44:32.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.677+0000 7fcb5ffff700 1 -- 172.21.15.89:0/3488173130 learned_addr learned my addr 172.21.15.89:0/3488173130 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-06-23T18:44:32.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.677+0000 7fcb65089700 1 --2- 172.21.15.89:0/3488173130 >> v2:172.21.15.52:3300/0 conn(0x7fcb600b9a20 0x7fcb600b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:32.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.677+0000 7fcb5ffff700 1 -- 172.21.15.89:0/3488173130 >> v2:172.21.15.52:3300/0 conn(0x7fcb600b9a20 msgr2=0x7fcb600b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:32.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.677+0000 7fcb5ffff700 1 --2- 172.21.15.89:0/3488173130 >> v2:172.21.15.52:3300/0 conn(0x7fcb600b9a20 0x7fcb600b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:32.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.677+0000 7fcb5ffff700 1 -- 172.21.15.89:0/3488173130 >> v1:172.21.15.89:6789/0 conn(0x7fcb6006a0d0 legacy=0x7fcb6006c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:32.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.677+0000 7fcb5ffff700 1 -- 172.21.15.89:0/3488173130 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6006bcf0 con 0x7fcb6006a4a0 2023-06-23T18:44:32.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.678+0000 7fcb5ffff700 1 --2- 172.21.15.89:0/3488173130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb6006a4a0 0x7fcb600b3cb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcb600b80e0 tx=0x7fcb4c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4034c54490345bc2 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:32.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.678+0000 7fcb5f7fe700 1 -- 172.21.15.89:0/3488173130 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c011830 con 0x7fcb6006a4a0 2023-06-23T18:44:32.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.678+0000 7fcb5f7fe700 1 -- 172.21.15.89:0/3488173130 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c011990 con 0x7fcb6006a4a0 2023-06-23T18:44:32.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.678+0000 7fcb5f7fe700 1 -- 172.21.15.89:0/3488173130 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c011d20 con 0x7fcb6006a4a0 2023-06-23T18:44:32.686 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.678+0000 7fcb66aec700 1 -- 172.21.15.89:0/3488173130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb6006a4a0 msgr2=0x7fcb600b3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:32.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.678+0000 7fcb66aec700 1 --2- 172.21.15.89:0/3488173130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb6006a4a0 0x7fcb600b3cb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcb600b80e0 tx=0x7fcb4c009bd0 comp rx=0 tx=0).stop 2023-06-23T18:44:32.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.679+0000 7fcb66aec700 1 -- 172.21.15.89:0/3488173130 shutdown_connections 2023-06-23T18:44:32.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.679+0000 7fcb66aec700 1 --2- 172.21.15.89:0/3488173130 >> v2:172.21.15.52:3300/0 conn(0x7fcb600b9a20 0x7fcb600b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:32.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.679+0000 7fcb66aec700 1 --2- 172.21.15.89:0/3488173130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb6006a4a0 0x7fcb600b3cb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:32.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.679+0000 7fcb66aec700 1 -- 172.21.15.89:0/3488173130 >> 172.21.15.89:0/3488173130 conn(0x7fcb600bd420 msgr2=0x7fcb600bd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:32.687 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.679+0000 7fcb66aec700 1 -- 172.21.15.89:0/3488173130 shutdown_connections 2023-06-23T18:44:32.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.679+0000 7fcb66aec700 1 -- 172.21.15.89:0/3488173130 wait complete. 2023-06-23T18:44:32.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.680+0000 7fcb66aec700 1 Processor -- start 2023-06-23T18:44:32.688 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.680+0000 7fcb66aec700 1 -- start start 2023-06-23T18:44:32.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.681+0000 7fcb66aec700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb6006a0d0 0x7fcb6014c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:32.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.681+0000 7fcb66aec700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb6006a4a0 0x7fcb601df8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:32.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.681+0000 7fcb66aec700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb600b9a20 0x7fcb601dfe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:32.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.681+0000 7fcb66aec700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6014ca30 con 0x7fcb6006a0d0 2023-06-23T18:44:32.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.681+0000 7fcb66aec700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6014d830 con 0x7fcb6006a4a0 2023-06-23T18:44:32.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.681+0000 7fcb66aec700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6014db10 con 0x7fcb600b9a20 2023-06-23T18:44:32.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.682+0000 7fcb5ffff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb6006a4a0 0x7fcb601df8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:32.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.682+0000 7fcb5ffff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb6006a4a0 0x7fcb601df8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41958/0 (socket says 172.21.15.89:41958) 2023-06-23T18:44:32.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.682+0000 7fcb5ffff700 1 -- 172.21.15.89:0/1023212116 learned_addr learned my addr 172.21.15.89:0/1023212116 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-06-23T18:44:32.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.682+0000 7fcb65089700 1 --2- 172.21.15.89:0/1023212116 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb600b9a20 0x7fcb601dfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:32.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.682+0000 7fcb64888700 1 --2- 172.21.15.89:0/1023212116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb6006a0d0 0x7fcb6014c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:32.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.682+0000 7fcb5ffff700 1 -- 172.21.15.89:0/1023212116 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb600b9a20 msgr2=0x7fcb601dfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:32.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.682+0000 7fcb5ffff700 1 --2- 172.21.15.89:0/1023212116 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb600b9a20 0x7fcb601dfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:32.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.682+0000 7fcb5ffff700 1 -- 172.21.15.89:0/1023212116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb6006a0d0 msgr2=0x7fcb6014c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:32.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.682+0000 7fcb5ffff700 1 --2- 172.21.15.89:0/1023212116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb6006a0d0 0x7fcb6014c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:32.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.682+0000 7fcb5ffff700 1 -- 172.21.15.89:0/1023212116 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c009550 con 0x7fcb6006a4a0 2023-06-23T18:44:32.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.682+0000 7fcb5ffff700 1 --2- 172.21.15.89:0/1023212116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb6006a4a0 0x7fcb601df8f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c000c00 tx=0x7fcb4c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:32.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.682+0000 7fcb5d7fa700 1 -- 172.21.15.89:0/1023212116 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c004380 con 0x7fcb6006a4a0 2023-06-23T18:44:32.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.682+0000 7fcb5d7fa700 1 -- 172.21.15.89:0/1023212116 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c01f070 con 0x7fcb6006a4a0 2023-06-23T18:44:32.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.682+0000 7fcb66aec700 1 -- 172.21.15.89:0/1023212116 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb6014ddf0 con 0x7fcb6006a4a0 2023-06-23T18:44:32.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.682+0000 7fcb5d7fa700 1 -- 172.21.15.89:0/1023212116 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c0036a0 con 0x7fcb6006a4a0 2023-06-23T18:44:32.692 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.682+0000 7fcb66aec700 1 -- 172.21.15.89:0/1023212116 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6014e650 con 0x7fcb6006a4a0 2023-06-23T18:44:32.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.682+0000 7fcb5d7fa700 1 -- 172.21.15.89:0/1023212116 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcb4c021030 con 0x7fcb6006a4a0 2023-06-23T18:44:32.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.682+0000 7fcb5d7fa700 1 -- 172.21.15.89:0/1023212116 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fcb4c01a9d0 con 0x7fcb6006a4a0 2023-06-23T18:44:32.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.683+0000 7fcb66aec700 1 -- 172.21.15.89:0/1023212116 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb600b4190 con 0x7fcb6006a4a0 2023-06-23T18:44:32.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.685+0000 7fcb5d7fa700 1 -- 172.21.15.89:0/1023212116 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fcb4c015020 con 0x7fcb6006a4a0 2023-06-23T18:44:32.774 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.768+0000 7fcb66aec700 1 -- 172.21.15.89:0/1023212116 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c371fb28-1b15-4e43-8d5a-43e402920ed9", "id": 0} v 0) v1 -- 0x7fcb6004e1d0 con 0x7fcb6006a4a0 2023-06-23T18:44:32.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.774+0000 7fcb5d7fa700 1 -- 172.21.15.89:0/1023212116 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c371fb28-1b15-4e43-8d5a-43e402920ed9", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcb4c01a520 con 0x7fcb6006a4a0 2023-06-23T18:44:32.780 INFO:teuthology.orchestra.run.smithi089.stdout:0 2023-06-23T18:44:32.781 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.775+0000 7fcb66aec700 1 -- 172.21.15.89:0/1023212116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb6006a4a0 msgr2=0x7fcb601df8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:32.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.775+0000 7fcb66aec700 1 --2- 172.21.15.89:0/1023212116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb6006a4a0 0x7fcb601df8f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c000c00 tx=0x7fcb4c004750 comp rx=0 tx=0).stop 2023-06-23T18:44:32.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.775+0000 7fcb66aec700 1 -- 172.21.15.89:0/1023212116 shutdown_connections 2023-06-23T18:44:32.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.775+0000 7fcb66aec700 1 --2- 172.21.15.89:0/1023212116 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb600b9a20 0x7fcb601dfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:32.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.775+0000 7fcb66aec700 1 --2- 172.21.15.89:0/1023212116 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb6006a0d0 0x7fcb6014c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:32.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.775+0000 7fcb66aec700 1 --2- 172.21.15.89:0/1023212116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb6006a4a0 0x7fcb601df8f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:32.782 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.775+0000 7fcb66aec700 1 -- 172.21.15.89:0/1023212116 >> 172.21.15.89:0/1023212116 conn(0x7fcb600bd420 msgr2=0x7fcb600b3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:32.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.775+0000 7fcb66aec700 1 -- 172.21.15.89:0/1023212116 shutdown_connections 2023-06-23T18:44:32.783 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.775+0000 7fcb66aec700 1 -- 172.21.15.89:0/1023212116 wait complete. 2023-06-23T18:44:32.792 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 4a142f04-33eb-47ec-9cc5-b08b44d82658 1 2023-06-23T18:44:32.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.951+0000 7f28ce5f6700 1 Processor -- start 2023-06-23T18:44:32.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.951+0000 7f28ce5f6700 1 -- start start 2023-06-23T18:44:32.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.952+0000 7f28ce5f6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f28c80b8c80 0x7f28c8071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:32.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.952+0000 7f28ce5f6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f28c8141220 0x7f28c81472e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:32.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.952+0000 7f28ce5f6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c80b8360 con 0x7f28c81416a0 2023-06-23T18:44:32.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.952+0000 7f28ce5f6700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c80b4bb0 con 0x7f28c8141220 2023-06-23T18:44:32.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.952+0000 7f28ce5f6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c80b7da0 con 0x7f28c80b8c80 2023-06-23T18:44:32.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.952+0000 7f28c7fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f28c80b8c80 0x7f28c8071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:32.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.952+0000 7f28c7fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f28c80b8c80 0x7f28c8071240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41970/0 (socket says 172.21.15.89:41970) 2023-06-23T18:44:32.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.952+0000 7f28c7fff700 1 -- 172.21.15.89:0/256612910 learned_addr learned my addr 172.21.15.89:0/256612910 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-06-23T18:44:32.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.952+0000 7f28c77fe700 1 --2- 172.21.15.89:0/256612910 >> v2:172.21.15.52:3300/0 conn(0x7f28c8141220 0x7f28c81472e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:32.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.953+0000 7f28c7fff700 1 -- 172.21.15.89:0/256612910 >> v2:172.21.15.52:3300/0 conn(0x7f28c8141220 msgr2=0x7f28c81472e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:32.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.953+0000 7f28c7fff700 1 --2- 172.21.15.89:0/256612910 >> v2:172.21.15.52:3300/0 conn(0x7f28c8141220 0x7f28c81472e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:32.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.953+0000 7f28c7fff700 1 -- 172.21.15.89:0/256612910 >> v1:172.21.15.89:6789/0 conn(0x7f28c81416a0 legacy=0x7f28c814a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:32.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.953+0000 7f28c7fff700 1 -- 172.21.15.89:0/256612910 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c80b8080 con 0x7f28c80b8c80 2023-06-23T18:44:32.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.953+0000 7f28c6ffd700 1 -- 172.21.15.89:0/256612910 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003764825 0 0) 0x7f28c80b8360 con 0x7f28c81416a0 2023-06-23T18:44:32.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.953+0000 7f28c7fff700 1 --2- 172.21.15.89:0/256612910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28c80b8c80 0x7f28c8071240 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f28c80b9470 tx=0x7f28b800be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88e22294491212bb server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:32.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.953+0000 7f28c6ffd700 1 -- 172.21.15.89:0/256612910 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b800dc70 con 0x7f28c80b8c80 2023-06-23T18:44:32.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.953+0000 7f28c6ffd700 1 -- 172.21.15.89:0/256612910 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b800ddd0 con 0x7f28c80b8c80 2023-06-23T18:44:32.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.953+0000 7f28c6ffd700 1 -- 172.21.15.89:0/256612910 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b8010690 con 0x7f28c80b8c80 2023-06-23T18:44:32.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.954+0000 7f28ce5f6700 1 -- 172.21.15.89:0/256612910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28c80b8c80 msgr2=0x7f28c8071240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:32.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.954+0000 7f28ce5f6700 1 --2- 172.21.15.89:0/256612910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28c80b8c80 0x7f28c8071240 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f28c80b9470 tx=0x7f28b800be70 comp rx=0 tx=0).stop 2023-06-23T18:44:32.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.954+0000 7f28ce5f6700 1 -- 172.21.15.89:0/256612910 shutdown_connections 2023-06-23T18:44:32.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.954+0000 7f28ce5f6700 1 --2- 172.21.15.89:0/256612910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28c80b8c80 0x7f28c8071240 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:32.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.954+0000 7f28ce5f6700 1 --2- 172.21.15.89:0/256612910 >> v2:172.21.15.52:3300/0 conn(0x7f28c8141220 0x7f28c81472e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:32.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.954+0000 7f28ce5f6700 1 -- 172.21.15.89:0/256612910 >> 172.21.15.89:0/256612910 conn(0x7f28c80bd420 msgr2=0x7f28c80bd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:32.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.954+0000 7f28ce5f6700 1 -- 172.21.15.89:0/256612910 shutdown_connections 2023-06-23T18:44:32.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.954+0000 7f28ce5f6700 1 -- 172.21.15.89:0/256612910 wait complete. 2023-06-23T18:44:32.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.955+0000 7f28ce5f6700 1 Processor -- start 2023-06-23T18:44:32.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.955+0000 7f28ce5f6700 1 -- start start 2023-06-23T18:44:32.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.956+0000 7f28ce5f6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28c80b8c80 0x7f28c8147c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:32.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.956+0000 7f28ce5f6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28c8141220 0x7f28c8145950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:32.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.956+0000 7f28ce5f6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28c81416a0 0x7f28c8145e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:32.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.956+0000 7f28ce5f6700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c8148180 con 0x7f28c80b8c80 2023-06-23T18:44:32.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.956+0000 7f28ce5f6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c8144540 con 0x7f28c8141220 2023-06-23T18:44:32.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.956+0000 7f28ce5f6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c80b4080 con 0x7f28c81416a0 2023-06-23T18:44:32.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.956+0000 7f28c77fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28c8141220 0x7f28c8145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:32.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.956+0000 7f28c77fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28c8141220 0x7f28c8145950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41986/0 (socket says 172.21.15.89:41986) 2023-06-23T18:44:32.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.956+0000 7f28c7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28c80b8c80 0x7f28c8147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:32.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.956+0000 7f28c77fe700 1 -- 172.21.15.89:0/490263052 learned_addr learned my addr 172.21.15.89:0/490263052 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-06-23T18:44:32.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.956+0000 7f28ccb93700 1 --2- 172.21.15.89:0/490263052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28c81416a0 0x7f28c8145e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:32.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.956+0000 7f28c7fff700 1 -- 172.21.15.89:0/490263052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28c81416a0 msgr2=0x7f28c8145e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:32.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.956+0000 7f28c7fff700 1 --2- 172.21.15.89:0/490263052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28c81416a0 0x7f28c8145e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:32.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.956+0000 7f28c7fff700 1 -- 172.21.15.89:0/490263052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28c8141220 msgr2=0x7f28c8145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:32.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.956+0000 7f28c7fff700 1 --2- 172.21.15.89:0/490263052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28c8141220 0x7f28c8145950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:32.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.956+0000 7f28c7fff700 1 -- 172.21.15.89:0/490263052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b800b7f0 con 0x7f28c80b8c80 2023-06-23T18:44:32.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.956+0000 7f28c77fe700 1 --2- 172.21.15.89:0/490263052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28c8141220 0x7f28c8145950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:32.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.956+0000 7f28c7fff700 1 --2- 172.21.15.89:0/490263052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28c80b8c80 0x7f28c8147c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f28b8018000 tx=0x7f28b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:32.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.956+0000 7f28c4ff9700 1 -- 172.21.15.89:0/490263052 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b801dce0 con 0x7f28c80b8c80 2023-06-23T18:44:32.967 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.956+0000 7f28c4ff9700 1 -- 172.21.15.89:0/490263052 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b801de40 con 0x7f28c80b8c80 2023-06-23T18:44:32.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.956+0000 7f28ce5f6700 1 -- 172.21.15.89:0/490263052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c8144b50 con 0x7f28c80b8c80 2023-06-23T18:44:32.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.956+0000 7f28c4ff9700 1 -- 172.21.15.89:0/490263052 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b80038c0 con 0x7f28c80b8c80 2023-06-23T18:44:32.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.956+0000 7f28ce5f6700 1 -- 172.21.15.89:0/490263052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c8143ef0 con 0x7f28c80b8c80 2023-06-23T18:44:32.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.957+0000 7f28c4ff9700 1 -- 172.21.15.89:0/490263052 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f28b8003d20 con 0x7f28c80b8c80 2023-06-23T18:44:32.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.957+0000 7f28c4ff9700 1 -- 172.21.15.89:0/490263052 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f28b80277f0 con 0x7f28c80b8c80 2023-06-23T18:44:32.968 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.957+0000 7f28ce5f6700 1 -- 172.21.15.89:0/490263052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c804e1d0 con 0x7f28c80b8c80 2023-06-23T18:44:32.969 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:32.960+0000 7f28c4ff9700 1 -- 172.21.15.89:0/490263052 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f28b8010c90 con 0x7f28c80b8c80 2023-06-23T18:44:33.047 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.041+0000 7f28ce5f6700 1 -- 172.21.15.89:0/490263052 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4a142f04-33eb-47ec-9cc5-b08b44d82658", "id": 1} v 0) v1 -- 0x7f28c81471d0 con 0x7f28c80b8c80 2023-06-23T18:44:33.049 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.044+0000 7f28c4ff9700 1 -- 172.21.15.89:0/490263052 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4a142f04-33eb-47ec-9cc5-b08b44d82658", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f28b8010470 con 0x7f28c80b8c80 2023-06-23T18:44:33.050 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-06-23T18:44:33.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.045+0000 7f28ce5f6700 1 -- 172.21.15.89:0/490263052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28c80b8c80 msgr2=0x7f28c8147c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:33.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.045+0000 7f28ce5f6700 1 --2- 172.21.15.89:0/490263052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28c80b8c80 0x7f28c8147c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f28b8018000 tx=0x7f28b8004750 comp rx=0 tx=0).stop 2023-06-23T18:44:33.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.045+0000 7f28ce5f6700 1 -- 172.21.15.89:0/490263052 shutdown_connections 2023-06-23T18:44:33.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.045+0000 7f28ce5f6700 1 --2- 172.21.15.89:0/490263052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28c81416a0 0x7f28c8145e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.045+0000 7f28ce5f6700 1 --2- 172.21.15.89:0/490263052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28c80b8c80 0x7f28c8147c40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.051 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.045+0000 7f28ce5f6700 1 --2- 172.21.15.89:0/490263052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28c8141220 0x7f28c8145950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.045+0000 7f28ce5f6700 1 -- 172.21.15.89:0/490263052 >> 172.21.15.89:0/490263052 conn(0x7f28c80bd420 msgr2=0x7f28c80bb320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:33.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.045+0000 7f28ce5f6700 1 -- 172.21.15.89:0/490263052 shutdown_connections 2023-06-23T18:44:33.052 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.045+0000 7f28ce5f6700 1 -- 172.21.15.89:0/490263052 wait complete. 2023-06-23T18:44:33.062 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new d7bb089d-4c55-4370-ba59-7fe88c39512a 2 2023-06-23T18:44:33.104 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:33.098+0000 7fc6a58b3200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-06-23T18:44:33.140 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-06-23T18:44:33.135+0000 7f44ea8a2200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-06-23T18:44:33.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.178+0000 7fabb4a72700 1 Processor -- start 2023-06-23T18:44:33.184 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.178+0000 7fabb4a72700 1 -- start start 2023-06-23T18:44:33.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.179+0000 7fabb4a72700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabb0070b10 0x7fabb0070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:33.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.179+0000 7fabb4a72700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fabb014a4c0 0x7fabb014a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:33.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.179+0000 7fabb4a72700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb0141260 con 0x7fabb006b0e0 2023-06-23T18:44:33.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.179+0000 7fabb4a72700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb014ae40 con 0x7fabb014a4c0 2023-06-23T18:44:33.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.179+0000 7fabb4a72700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb0070140 con 0x7fabb0070b10 2023-06-23T18:44:33.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.179+0000 7fabadd9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabb0070b10 0x7fabb0070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:33.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.179+0000 7fabadd9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabb0070b10 0x7fabb0070f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:53846/0 (socket says 172.21.15.89:53846) 2023-06-23T18:44:33.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.179+0000 7fabadd9b700 1 -- 172.21.15.89:0/3215195401 learned_addr learned my addr 172.21.15.89:0/3215195401 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-06-23T18:44:33.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.179+0000 7fabaed9d700 1 --2- 172.21.15.89:0/3215195401 >> v2:172.21.15.52:3300/0 conn(0x7fabb014a4c0 0x7fabb014a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:33.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.179+0000 7fabadd9b700 1 -- 172.21.15.89:0/3215195401 >> v2:172.21.15.52:3300/0 conn(0x7fabb014a4c0 msgr2=0x7fabb014a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:33.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.179+0000 7fabadd9b700 1 --2- 172.21.15.89:0/3215195401 >> v2:172.21.15.52:3300/0 conn(0x7fabb014a4c0 0x7fabb014a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.179+0000 7fabadd9b700 1 -- 172.21.15.89:0/3215195401 >> v1:172.21.15.52:6789/0 conn(0x7fabb006b0e0 legacy=0x7fabb0140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:33.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.179+0000 7fabadd9b700 1 -- 172.21.15.89:0/3215195401 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb0070420 con 0x7fabb0070b10 2023-06-23T18:44:33.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.180+0000 7fabadd9b700 1 --2- 172.21.15.89:0/3215195401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabb0070b10 0x7fabb0070f70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faba40098f0 tx=0x7faba4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38dd7cb7c6d8f2d1 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:33.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.180+0000 7fabad59a700 1 -- 172.21.15.89:0/3215195401 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba400c900 con 0x7fabb0070b10 2023-06-23T18:44:33.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.180+0000 7fabad59a700 1 -- 172.21.15.89:0/3215195401 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba400ca60 con 0x7fabb0070b10 2023-06-23T18:44:33.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.180+0000 7fabad59a700 1 -- 172.21.15.89:0/3215195401 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba400cdf0 con 0x7fabb0070b10 2023-06-23T18:44:33.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.180+0000 7fabb4a72700 1 -- 172.21.15.89:0/3215195401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabb0070b10 msgr2=0x7fabb0070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:33.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.180+0000 7fabb4a72700 1 --2- 172.21.15.89:0/3215195401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabb0070b10 0x7fabb0070f70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faba40098f0 tx=0x7faba4009c00 comp rx=0 tx=0).stop 2023-06-23T18:44:33.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.180+0000 7fabb4a72700 1 -- 172.21.15.89:0/3215195401 shutdown_connections 2023-06-23T18:44:33.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.180+0000 7fabb4a72700 1 --2- 172.21.15.89:0/3215195401 >> v2:172.21.15.52:3300/0 conn(0x7fabb014a4c0 0x7fabb014a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.180+0000 7fabb4a72700 1 --2- 172.21.15.89:0/3215195401 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabb0070b10 0x7fabb0070f70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.180+0000 7fabb4a72700 1 -- 172.21.15.89:0/3215195401 >> 172.21.15.89:0/3215195401 conn(0x7fabb00b95c0 msgr2=0x7fabb00b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:33.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.180+0000 7fabb4a72700 1 -- 172.21.15.89:0/3215195401 shutdown_connections 2023-06-23T18:44:33.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.181+0000 7fabb4a72700 1 -- 172.21.15.89:0/3215195401 wait complete. 2023-06-23T18:44:33.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.182+0000 7fabb4a72700 1 Processor -- start 2023-06-23T18:44:33.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.182+0000 7fabb4a72700 1 -- start start 2023-06-23T18:44:33.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.182+0000 7fabb4a72700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabb006b0e0 0x7fabb00bbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:33.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.182+0000 7fabb4a72700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabb0070b10 0x7fabb01e30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:33.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.182+0000 7fabb4a72700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabb014a4c0 0x7fabb01e3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:33.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.182+0000 7fabb4a72700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb00bc240 con 0x7fabb014a4c0 2023-06-23T18:44:33.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.182+0000 7fabb4a72700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb0142d90 con 0x7fabb006b0e0 2023-06-23T18:44:33.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.182+0000 7fabb4a72700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb0143070 con 0x7fabb0070b10 2023-06-23T18:44:33.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.182+0000 7fabadd9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabb0070b10 0x7fabb01e30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:33.193 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.182+0000 7fabae59c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabb006b0e0 0x7fabb00bbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:33.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.183+0000 7fabadd9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabb0070b10 0x7fabb01e30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:53858/0 (socket says 172.21.15.89:53858) 2023-06-23T18:44:33.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.183+0000 7fabadd9b700 1 -- 172.21.15.89:0/4150613260 learned_addr learned my addr 172.21.15.89:0/4150613260 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-06-23T18:44:33.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.183+0000 7fabaed9d700 1 --2- 172.21.15.89:0/4150613260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabb014a4c0 0x7fabb01e3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:33.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.183+0000 7fabae59c700 1 -- 172.21.15.89:0/4150613260 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabb0070b10 msgr2=0x7fabb01e30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:33.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.183+0000 7fabae59c700 1 --2- 172.21.15.89:0/4150613260 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabb0070b10 0x7fabb01e30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.183+0000 7fabae59c700 1 -- 172.21.15.89:0/4150613260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabb014a4c0 msgr2=0x7fabb01e3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:33.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.183+0000 7fabae59c700 1 --2- 172.21.15.89:0/4150613260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabb014a4c0 0x7fabb01e3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.183+0000 7fabae59c700 1 -- 172.21.15.89:0/4150613260 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba4009550 con 0x7fabb006b0e0 2023-06-23T18:44:33.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.183+0000 7fabaed9d700 1 --2- 172.21.15.89:0/4150613260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabb014a4c0 0x7fabb01e3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:33.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.183+0000 7fabadd9b700 1 --2- 172.21.15.89:0/4150613260 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabb0070b10 0x7fabb01e30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:33.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.183+0000 7fabae59c700 1 --2- 172.21.15.89:0/4150613260 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabb006b0e0 0x7fabb00bbd00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faba0000f60 tx=0x7faba000c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:33.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.183+0000 7fab9effd700 1 -- 172.21.15.89:0/4150613260 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba00052d0 con 0x7fabb006b0e0 2023-06-23T18:44:33.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.183+0000 7fab9effd700 1 -- 172.21.15.89:0/4150613260 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba0005430 con 0x7fabb006b0e0 2023-06-23T18:44:33.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.183+0000 7fabb4a72700 1 -- 172.21.15.89:0/4150613260 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb0143350 con 0x7fabb006b0e0 2023-06-23T18:44:33.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.183+0000 7fab9effd700 1 -- 172.21.15.89:0/4150613260 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba00038c0 con 0x7fabb006b0e0 2023-06-23T18:44:33.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.183+0000 7fabb4a72700 1 -- 172.21.15.89:0/4150613260 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb0143630 con 0x7fabb006b0e0 2023-06-23T18:44:33.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.183+0000 7fab9effd700 1 -- 172.21.15.89:0/4150613260 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faba0003d20 con 0x7fabb006b0e0 2023-06-23T18:44:33.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.183+0000 7fab9effd700 1 -- 172.21.15.89:0/4150613260 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7faba0011d10 con 0x7fabb006b0e0 2023-06-23T18:44:33.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.184+0000 7fabb4a72700 1 -- 172.21.15.89:0/4150613260 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb004e1d0 con 0x7fabb006b0e0 2023-06-23T18:44:33.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.186+0000 7fab9effd700 1 -- 172.21.15.89:0/4150613260 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7faba0017070 con 0x7fabb006b0e0 2023-06-23T18:44:33.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.269+0000 7fabb4a72700 1 -- 172.21.15.89:0/4150613260 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d7bb089d-4c55-4370-ba59-7fe88c39512a", "id": 2} v 0) v1 -- 0x7fabb00b8b00 con 0x7fabb006b0e0 2023-06-23T18:44:33.278 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.272+0000 7fab9effd700 1 -- 172.21.15.89:0/4150613260 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d7bb089d-4c55-4370-ba59-7fe88c39512a", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7faba000ce30 con 0x7fabb006b0e0 2023-06-23T18:44:33.278 INFO:teuthology.orchestra.run.smithi089.stdout:2 2023-06-23T18:44:33.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.273+0000 7fabb4a72700 1 -- 172.21.15.89:0/4150613260 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabb006b0e0 msgr2=0x7fabb00bbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:33.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.273+0000 7fabb4a72700 1 --2- 172.21.15.89:0/4150613260 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabb006b0e0 0x7fabb00bbd00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faba0000f60 tx=0x7faba000c730 comp rx=0 tx=0).stop 2023-06-23T18:44:33.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.273+0000 7fabb4a72700 1 -- 172.21.15.89:0/4150613260 shutdown_connections 2023-06-23T18:44:33.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.273+0000 7fabb4a72700 1 --2- 172.21.15.89:0/4150613260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fabb014a4c0 0x7fabb01e3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.279 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.273+0000 7fabb4a72700 1 --2- 172.21.15.89:0/4150613260 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fabb006b0e0 0x7fabb00bbd00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.273+0000 7fabb4a72700 1 --2- 172.21.15.89:0/4150613260 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fabb0070b10 0x7fabb01e30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.273+0000 7fabb4a72700 1 -- 172.21.15.89:0/4150613260 >> 172.21.15.89:0/4150613260 conn(0x7fabb00b95c0 msgr2=0x7fabb013e190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:33.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.273+0000 7fabb4a72700 1 -- 172.21.15.89:0/4150613260 shutdown_connections 2023-06-23T18:44:33.280 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.273+0000 7fabb4a72700 1 -- 172.21.15.89:0/4150613260 wait complete. 2023-06-23T18:44:33.290 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 4bcdcdc3-6a8f-468e-877e-57f76079ac3a 3 2023-06-23T18:44:33.306 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:33.300+0000 7fc6a58b3200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-06-23T18:44:33.341 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-06-23T18:44:33.335+0000 7f44ea8a2200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-06-23T18:44:33.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.422+0000 7ff19d383700 1 Processor -- start 2023-06-23T18:44:33.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.422+0000 7ff19d383700 1 -- start start 2023-06-23T18:44:33.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.422+0000 7ff19d383700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff1980b9960 0x7ff1980b87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:33.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.422+0000 7ff19d383700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff1980b7da0 0x7ff1981422d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:33.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.422+0000 7ff19d383700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff19806c750 con 0x7ff1980b6c50 2023-06-23T18:44:33.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.422+0000 7ff19d383700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1980b9540 con 0x7ff1980b9960 2023-06-23T18:44:33.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.422+0000 7ff19d383700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1980b8d10 con 0x7ff1980b7da0 2023-06-23T18:44:33.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.423+0000 7ff1977fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff1980b7da0 0x7ff1981422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:33.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.423+0000 7ff1977fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff1980b7da0 0x7ff1981422d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41996/0 (socket says 172.21.15.89:41996) 2023-06-23T18:44:33.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.423+0000 7ff1977fe700 1 -- 172.21.15.89:0/3903267925 learned_addr learned my addr 172.21.15.89:0/3903267925 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-06-23T18:44:33.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.423+0000 7ff1967fc700 1 --2- 172.21.15.89:0/3903267925 >> v2:172.21.15.52:3300/0 conn(0x7ff1980b9960 0x7ff1980b87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:33.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.423+0000 7ff1977fe700 1 -- 172.21.15.89:0/3903267925 >> v2:172.21.15.52:3300/0 conn(0x7ff1980b9960 msgr2=0x7ff1980b87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:33.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.423+0000 7ff1977fe700 1 --2- 172.21.15.89:0/3903267925 >> v2:172.21.15.52:3300/0 conn(0x7ff1980b9960 0x7ff1980b87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.423+0000 7ff1977fe700 1 -- 172.21.15.89:0/3903267925 >> v1:172.21.15.52:6789/0 conn(0x7ff1980b6c50 legacy=0x7ff19806b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:33.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.423+0000 7ff1977fe700 1 -- 172.21.15.89:0/3903267925 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff198071e20 con 0x7ff1980b7da0 2023-06-23T18:44:33.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.423+0000 7ff1977fe700 1 --2- 172.21.15.89:0/3903267925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1980b7da0 0x7ff1981422d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff198071a10 tx=0x7ff19000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf2d82128cba23c9 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:33.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.423+0000 7ff195ffb700 1 -- 172.21.15.89:0/3903267925 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19000e070 con 0x7ff1980b7da0 2023-06-23T18:44:33.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.423+0000 7ff195ffb700 1 -- 172.21.15.89:0/3903267925 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19000b910 con 0x7ff1980b7da0 2023-06-23T18:44:33.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.423+0000 7ff195ffb700 1 -- 172.21.15.89:0/3903267925 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19000bcc0 con 0x7ff1980b7da0 2023-06-23T18:44:33.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.424+0000 7ff19d383700 1 -- 172.21.15.89:0/3903267925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1980b7da0 msgr2=0x7ff1981422d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:33.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.424+0000 7ff19d383700 1 --2- 172.21.15.89:0/3903267925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1980b7da0 0x7ff1981422d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff198071a10 tx=0x7ff19000b330 comp rx=0 tx=0).stop 2023-06-23T18:44:33.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.424+0000 7ff19d383700 1 -- 172.21.15.89:0/3903267925 shutdown_connections 2023-06-23T18:44:33.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.424+0000 7ff19d383700 1 --2- 172.21.15.89:0/3903267925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1980b7da0 0x7ff1981422d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.424+0000 7ff19d383700 1 --2- 172.21.15.89:0/3903267925 >> v2:172.21.15.52:3300/0 conn(0x7ff1980b9960 0x7ff1980b87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.424+0000 7ff19d383700 1 -- 172.21.15.89:0/3903267925 >> 172.21.15.89:0/3903267925 conn(0x7ff1980bd420 msgr2=0x7ff1980bd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:33.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.424+0000 7ff19d383700 1 -- 172.21.15.89:0/3903267925 shutdown_connections 2023-06-23T18:44:33.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.424+0000 7ff19d383700 1 -- 172.21.15.89:0/3903267925 wait complete. 2023-06-23T18:44:33.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.425+0000 7ff19d383700 1 Processor -- start 2023-06-23T18:44:33.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.425+0000 7ff19d383700 1 -- start start 2023-06-23T18:44:33.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.426+0000 7ff19d383700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1980b6c50 0x7ff1981392f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:33.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.426+0000 7ff19d383700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1980b7da0 0x7ff1981de4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:33.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.426+0000 7ff19d383700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1980b9960 0x7ff1981de9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:33.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.426+0000 7ff19d383700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff198139830 con 0x7ff1980b7da0 2023-06-23T18:44:33.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.426+0000 7ff19d383700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff198135a70 con 0x7ff1980b9960 2023-06-23T18:44:33.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.426+0000 7ff19d383700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1980b43c0 con 0x7ff1980b6c50 2023-06-23T18:44:33.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.426+0000 7ff196ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1980b6c50 0x7ff1981392f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:33.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.426+0000 7ff1977fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1980b9960 0x7ff1981de9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:33.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.426+0000 7ff196ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1980b6c50 0x7ff1981392f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:53868/0 (socket says 172.21.15.89:53868) 2023-06-23T18:44:33.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.426+0000 7ff196ffd700 1 -- 172.21.15.89:0/2181628487 learned_addr learned my addr 172.21.15.89:0/2181628487 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-06-23T18:44:33.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.426+0000 7ff1967fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1980b7da0 0x7ff1981de4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:33.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.426+0000 7ff196ffd700 1 -- 172.21.15.89:0/2181628487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1980b9960 msgr2=0x7ff1981de9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:33.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.426+0000 7ff196ffd700 1 --2- 172.21.15.89:0/2181628487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1980b9960 0x7ff1981de9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.426+0000 7ff196ffd700 1 -- 172.21.15.89:0/2181628487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1980b7da0 msgr2=0x7ff1981de4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:33.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.426+0000 7ff196ffd700 1 --2- 172.21.15.89:0/2181628487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1980b7da0 0x7ff1981de4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.426+0000 7ff196ffd700 1 -- 172.21.15.89:0/2181628487 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff190009b30 con 0x7ff1980b6c50 2023-06-23T18:44:33.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.426+0000 7ff1967fc700 1 --2- 172.21.15.89:0/2181628487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1980b7da0 0x7ff1981de4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:33.437 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.426+0000 7ff196ffd700 1 --2- 172.21.15.89:0/2181628487 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1980b6c50 0x7ff1981392f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff18800c480 tx=0x7ff18800c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:33.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.426+0000 7ff17f7fe700 1 -- 172.21.15.89:0/2181628487 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1880052d0 con 0x7ff1980b6c50 2023-06-23T18:44:33.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.427+0000 7ff17f7fe700 1 -- 172.21.15.89:0/2181628487 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff188005430 con 0x7ff1980b6c50 2023-06-23T18:44:33.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.427+0000 7ff17f7fe700 1 -- 172.21.15.89:0/2181628487 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1880038c0 con 0x7ff1980b6c50 2023-06-23T18:44:33.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.427+0000 7ff19d383700 1 -- 172.21.15.89:0/2181628487 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff198133fb0 con 0x7ff1980b6c50 2023-06-23T18:44:33.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.427+0000 7ff19d383700 1 -- 172.21.15.89:0/2181628487 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff198134510 con 0x7ff1980b6c50 2023-06-23T18:44:33.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.427+0000 7ff17f7fe700 1 -- 172.21.15.89:0/2181628487 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff188003d20 con 0x7ff1980b6c50 2023-06-23T18:44:33.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.427+0000 7ff17f7fe700 1 -- 172.21.15.89:0/2181628487 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7ff188011cc0 con 0x7ff1980b6c50 2023-06-23T18:44:33.438 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.427+0000 7ff19d383700 1 -- 172.21.15.89:0/2181628487 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19804e1d0 con 0x7ff1980b6c50 2023-06-23T18:44:33.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.431+0000 7ff17f7fe700 1 -- 172.21.15.89:0/2181628487 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ff188017070 con 0x7ff1980b6c50 2023-06-23T18:44:33.519 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.513+0000 7ff19d383700 1 -- 172.21.15.89:0/2181628487 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4bcdcdc3-6a8f-468e-877e-57f76079ac3a", "id": 3} v 0) v1 -- 0x7ff19806a9e0 con 0x7ff1980b6c50 2023-06-23T18:44:33.522 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.517+0000 7ff17f7fe700 1 -- 172.21.15.89:0/2181628487 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4bcdcdc3-6a8f-468e-877e-57f76079ac3a", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff18800ce50 con 0x7ff1980b6c50 2023-06-23T18:44:33.523 INFO:teuthology.orchestra.run.smithi089.stdout:3 2023-06-23T18:44:33.523 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.517+0000 7ff19d383700 1 -- 172.21.15.89:0/2181628487 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1980b6c50 msgr2=0x7ff1981392f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:33.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.517+0000 7ff19d383700 1 --2- 172.21.15.89:0/2181628487 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1980b6c50 0x7ff1981392f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff18800c480 tx=0x7ff18800c790 comp rx=0 tx=0).stop 2023-06-23T18:44:33.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.517+0000 7ff19d383700 1 -- 172.21.15.89:0/2181628487 shutdown_connections 2023-06-23T18:44:33.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.517+0000 7ff19d383700 1 --2- 172.21.15.89:0/2181628487 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1980b9960 0x7ff1981de9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.517+0000 7ff19d383700 1 --2- 172.21.15.89:0/2181628487 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff1980b6c50 0x7ff1981392f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.517+0000 7ff19d383700 1 --2- 172.21.15.89:0/2181628487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1980b7da0 0x7ff1981de4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.517+0000 7ff19d383700 1 -- 172.21.15.89:0/2181628487 >> 172.21.15.89:0/2181628487 conn(0x7ff1980bd420 msgr2=0x7ff19813b990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:33.524 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.518+0000 7ff19d383700 1 -- 172.21.15.89:0/2181628487 shutdown_connections 2023-06-23T18:44:33.525 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.518+0000 7ff19d383700 1 -- 172.21.15.89:0/2181628487 wait complete. 2023-06-23T18:44:33.535 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new cac63000-ae94-4b08-93e6-a99119640b63 4 2023-06-23T18:44:33.709 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:33.703+0000 7fc6a58b3200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-23T18:44:33.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.717+0000 7f0e1eef2700 1 Processor -- start 2023-06-23T18:44:33.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.717+0000 7f0e1eef2700 1 -- start start 2023-06-23T18:44:33.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.718+0000 7f0e1eef2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0e180b6c50 0x7f0e180b87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:33.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.718+0000 7f0e1eef2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e180b9960 0x7f0e1806b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:33.725 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.718+0000 7f0e1eef2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0e180b7da0 0x7f0e181422d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:33.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.718+0000 7f0e1eef2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e180b9540 con 0x7f0e180b6c50 2023-06-23T18:44:33.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.718+0000 7f0e1eef2700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e180b8d10 con 0x7f0e180b7da0 2023-06-23T18:44:33.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.718+0000 7f0e1eef2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1806c750 con 0x7f0e180b9960 2023-06-23T18:44:33.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.718+0000 7f0e1d48f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0e180b7da0 0x7f0e181422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:33.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.718+0000 7f0e17fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e180b9960 0x7f0e1806b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:33.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.718+0000 7f0e1d48f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0e180b7da0 0x7f0e181422d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42010/0 (socket says 172.21.15.89:42010) 2023-06-23T18:44:33.726 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.718+0000 7f0e17fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e180b9960 0x7f0e1806b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:53878/0 (socket says 172.21.15.89:53878) 2023-06-23T18:44:33.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.718+0000 7f0e1d48f700 1 -- 172.21.15.89:0/4272625662 learned_addr learned my addr 172.21.15.89:0/4272625662 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-06-23T18:44:33.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.718+0000 7f0e1cc8e700 1 --2- 172.21.15.89:0/4272625662 >> v2:172.21.15.52:3300/0 conn(0x7f0e180b6c50 0x7f0e180b87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:33.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.718+0000 7f0e1d48f700 1 -- 172.21.15.89:0/4272625662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e180b9960 msgr2=0x7f0e1806b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:33.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.718+0000 7f0e1d48f700 1 --2- 172.21.15.89:0/4272625662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e180b9960 0x7f0e1806b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.727 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.718+0000 7f0e1d48f700 1 -- 172.21.15.89:0/4272625662 >> v2:172.21.15.52:3300/0 conn(0x7f0e180b6c50 msgr2=0x7f0e180b87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:33.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.718+0000 7f0e1d48f700 1 --2- 172.21.15.89:0/4272625662 >> v2:172.21.15.52:3300/0 conn(0x7f0e180b6c50 0x7f0e180b87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.718+0000 7f0e1d48f700 1 -- 172.21.15.89:0/4272625662 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e18071e20 con 0x7f0e180b7da0 2023-06-23T18:44:33.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.718+0000 7f0e17fff700 1 --2- 172.21.15.89:0/4272625662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e180b9960 0x7f0e1806b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:33.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.718+0000 7f0e1d48f700 1 --2- 172.21.15.89:0/4272625662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e180b7da0 0x7f0e181422d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0e18071a40 tx=0x7f0e1000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8f5844979ad9ad7 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:33.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.718+0000 7f0e177fe700 1 -- 172.21.15.89:0/4272625662 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1000e070 con 0x7f0e180b7da0 2023-06-23T18:44:33.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.719+0000 7f0e177fe700 1 -- 172.21.15.89:0/4272625662 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1000b910 con 0x7f0e180b7da0 2023-06-23T18:44:33.728 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.719+0000 7f0e177fe700 1 -- 172.21.15.89:0/4272625662 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1000bcc0 con 0x7f0e180b7da0 2023-06-23T18:44:33.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.719+0000 7f0e1eef2700 1 -- 172.21.15.89:0/4272625662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e180b7da0 msgr2=0x7f0e181422d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:33.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.719+0000 7f0e1eef2700 1 --2- 172.21.15.89:0/4272625662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e180b7da0 0x7f0e181422d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0e18071a40 tx=0x7f0e1000b330 comp rx=0 tx=0).stop 2023-06-23T18:44:33.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.719+0000 7f0e1eef2700 1 -- 172.21.15.89:0/4272625662 shutdown_connections 2023-06-23T18:44:33.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.719+0000 7f0e1eef2700 1 --2- 172.21.15.89:0/4272625662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e180b7da0 0x7f0e181422d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.719+0000 7f0e1eef2700 1 --2- 172.21.15.89:0/4272625662 >> v2:172.21.15.52:3300/0 conn(0x7f0e180b6c50 0x7f0e180b87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.719+0000 7f0e1eef2700 1 --2- 172.21.15.89:0/4272625662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e180b9960 0x7f0e1806b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.719+0000 7f0e1eef2700 1 -- 172.21.15.89:0/4272625662 >> 172.21.15.89:0/4272625662 conn(0x7f0e180bd420 msgr2=0x7f0e180bd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:33.729 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.719+0000 7f0e1eef2700 1 -- 172.21.15.89:0/4272625662 shutdown_connections 2023-06-23T18:44:33.730 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.719+0000 7f0e1eef2700 1 -- 172.21.15.89:0/4272625662 wait complete. 2023-06-23T18:44:33.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.721+0000 7f0e1eef2700 1 Processor -- start 2023-06-23T18:44:33.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.721+0000 7f0e1eef2700 1 -- start start 2023-06-23T18:44:33.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.722+0000 7f0e1eef2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e180b6c50 0x7f0e1813e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:33.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.722+0000 7f0e1eef2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e180b7da0 0x7f0e1813cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:33.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.722+0000 7f0e1eef2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e180b9960 0x7f0e181e1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:33.732 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.722+0000 7f0e1eef2700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1813d4e0 con 0x7f0e180b6c50 2023-06-23T18:44:33.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.722+0000 7f0e1eef2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1813ec80 con 0x7f0e180b7da0 2023-06-23T18:44:33.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.722+0000 7f0e1eef2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1813a460 con 0x7f0e180b9960 2023-06-23T18:44:33.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.722+0000 7f0e1d48f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e180b9960 0x7f0e181e1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:33.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.722+0000 7f0e17fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e180b7da0 0x7f0e1813cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:33.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.722+0000 7f0e1d48f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e180b9960 0x7f0e181e1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:53882/0 (socket says 172.21.15.89:53882) 2023-06-23T18:44:33.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.722+0000 7f0e1d48f700 1 -- 172.21.15.89:0/4148628846 learned_addr learned my addr 172.21.15.89:0/4148628846 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-06-23T18:44:33.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.722+0000 7f0e17fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e180b7da0 0x7f0e1813cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42024/0 (socket says 172.21.15.89:42024) 2023-06-23T18:44:33.733 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.722+0000 7f0e1cc8e700 1 --2- 172.21.15.89:0/4148628846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e180b6c50 0x7f0e1813e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:33.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.723+0000 7f0e1d48f700 1 -- 172.21.15.89:0/4148628846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e180b7da0 msgr2=0x7f0e1813cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:33.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.723+0000 7f0e1d48f700 1 --2- 172.21.15.89:0/4148628846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e180b7da0 0x7f0e1813cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.723+0000 7f0e1d48f700 1 -- 172.21.15.89:0/4148628846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e180b6c50 msgr2=0x7f0e1813e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:33.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.723+0000 7f0e1d48f700 1 --2- 172.21.15.89:0/4148628846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e180b6c50 0x7f0e1813e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.723+0000 7f0e1d48f700 1 -- 172.21.15.89:0/4148628846 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e040094a0 con 0x7f0e180b9960 2023-06-23T18:44:33.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.723+0000 7f0e17fff700 1 --2- 172.21.15.89:0/4148628846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e180b7da0 0x7f0e1813cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:33.734 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.723+0000 7f0e1cc8e700 1 --2- 172.21.15.89:0/4148628846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e180b6c50 0x7f0e1813e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:33.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.723+0000 7f0e1d48f700 1 --2- 172.21.15.89:0/4148628846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e180b9960 0x7f0e181e1290 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0e10012000 tx=0x7f0e10004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:33.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.723+0000 7f0e157fa700 1 -- 172.21.15.89:0/4148628846 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e100099b0 con 0x7f0e180b9960 2023-06-23T18:44:33.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.723+0000 7f0e157fa700 1 -- 172.21.15.89:0/4148628846 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1000ce80 con 0x7f0e180b9960 2023-06-23T18:44:33.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.723+0000 7f0e1eef2700 1 -- 172.21.15.89:0/4148628846 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e10009b30 con 0x7f0e180b9960 2023-06-23T18:44:33.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.723+0000 7f0e157fa700 1 -- 172.21.15.89:0/4148628846 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e10004470 con 0x7f0e180b9960 2023-06-23T18:44:33.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.723+0000 7f0e1eef2700 1 -- 172.21.15.89:0/4148628846 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e181ce510 con 0x7f0e180b9960 2023-06-23T18:44:33.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.723+0000 7f0e157fa700 1 -- 172.21.15.89:0/4148628846 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0e1001c440 con 0x7f0e180b9960 2023-06-23T18:44:33.735 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.723+0000 7f0e157fa700 1 -- 172.21.15.89:0/4148628846 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f0e10025920 con 0x7f0e180b9960 2023-06-23T18:44:33.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.724+0000 7f0e1eef2700 1 -- 172.21.15.89:0/4148628846 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e1804e1d0 con 0x7f0e180b9960 2023-06-23T18:44:33.736 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.726+0000 7f0e157fa700 1 -- 172.21.15.89:0/4148628846 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f0e10044b00 con 0x7f0e180b9960 2023-06-23T18:44:33.736 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-06-23T18:44:33.725+0000 7f44ea8a2200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-23T18:44:33.814 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.809+0000 7f0e1eef2700 1 -- 172.21.15.89:0/4148628846 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cac63000-ae94-4b08-93e6-a99119640b63", "id": 4} v 0) v1 -- 0x7f0e1813dcc0 con 0x7f0e180b9960 2023-06-23T18:44:33.817 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.812+0000 7f0e157fa700 1 -- 172.21.15.89:0/4148628846 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cac63000-ae94-4b08-93e6-a99119640b63", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0e10033070 con 0x7f0e180b9960 2023-06-23T18:44:33.817 INFO:teuthology.orchestra.run.smithi089.stdout:4 2023-06-23T18:44:33.818 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.812+0000 7f0e1eef2700 1 -- 172.21.15.89:0/4148628846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e180b9960 msgr2=0x7f0e181e1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:33.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.812+0000 7f0e1eef2700 1 --2- 172.21.15.89:0/4148628846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e180b9960 0x7f0e181e1290 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0e10012000 tx=0x7f0e10004ad0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.813+0000 7f0e1eef2700 1 -- 172.21.15.89:0/4148628846 shutdown_connections 2023-06-23T18:44:33.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.813+0000 7f0e1eef2700 1 --2- 172.21.15.89:0/4148628846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e180b9960 0x7f0e181e1290 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.813+0000 7f0e1eef2700 1 --2- 172.21.15.89:0/4148628846 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0e180b6c50 0x7f0e1813e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.813+0000 7f0e1eef2700 1 --2- 172.21.15.89:0/4148628846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e180b7da0 0x7f0e1813cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.813+0000 7f0e1eef2700 1 -- 172.21.15.89:0/4148628846 >> 172.21.15.89:0/4148628846 conn(0x7f0e180bd420 msgr2=0x7f0e180bd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:33.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.813+0000 7f0e1eef2700 1 -- 172.21.15.89:0/4148628846 shutdown_connections 2023-06-23T18:44:33.819 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.813+0000 7f0e1eef2700 1 -- 172.21.15.89:0/4148628846 wait complete. 2023-06-23T18:44:33.830 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 45c53102-18a6-4fd7-9c25-8ea5e1ef6851 5 2023-06-23T18:44:33.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.947+0000 7f2808400700 1 Processor -- start 2023-06-23T18:44:33.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.947+0000 7f2808400700 1 -- start start 2023-06-23T18:44:33.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.948+0000 7f2808400700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f280006b0e0 0x7f280006c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:33.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.948+0000 7f2808400700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28000b7da0 con 0x7f28000b8a20 2023-06-23T18:44:33.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.948+0000 7f2808400700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28000b9390 con 0x7f28000b6c50 2023-06-23T18:44:33.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.948+0000 7f2808400700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28000b9c30 con 0x7f280006b0e0 2023-06-23T18:44:33.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.948+0000 7f280619c700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f28000b6c50 0x7f28000b8230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35526/0 (socket says 172.21.15.89:35526) 2023-06-23T18:44:33.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.949+0000 7f280619c700 1 -- 172.21.15.89:0/858744385 learned_addr learned my addr 172.21.15.89:0/858744385 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-06-23T18:44:33.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.949+0000 7f280599b700 1 --2- 172.21.15.89:0/858744385 >> v2:172.21.15.52:3300/0 conn(0x7f280006b0e0 0x7f280006c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:33.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.949+0000 7f280519a700 1 -- 172.21.15.89:0/858744385 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1069466365 0 0) 0x7f28000b9390 con 0x7f28000b6c50 2023-06-23T18:44:33.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.949+0000 7f280519a700 1 -- 172.21.15.89:0/858744385 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27ec0035b0 con 0x7f28000b6c50 2023-06-23T18:44:33.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.949+0000 7f280519a700 1 -- 172.21.15.89:0/858744385 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632549242 0 0) 0x7f28000b7da0 con 0x7f28000b8a20 2023-06-23T18:44:33.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.949+0000 7f280519a700 1 -- 172.21.15.89:0/858744385 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28000b9390 con 0x7f28000b8a20 2023-06-23T18:44:33.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.949+0000 7f280599b700 1 -- 172.21.15.89:0/858744385 >> v1:172.21.15.89:6789/0 conn(0x7f28000b6c50 legacy=0x7f28000b8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:33.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.949+0000 7f280599b700 1 -- 172.21.15.89:0/858744385 >> v1:172.21.15.52:6789/0 conn(0x7f28000b8a20 legacy=0x7f2800141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:33.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.949+0000 7f280599b700 1 -- 172.21.15.89:0/858744385 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28000b9670 con 0x7f280006b0e0 2023-06-23T18:44:33.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.949+0000 7f280599b700 1 --2- 172.21.15.89:0/858744385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f280006b0e0 0x7f280006c120 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009840 tx=0x7f27f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3766cda71ef4a366 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:33.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.949+0000 7f280519a700 1 -- 172.21.15.89:0/858744385 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f0011830 con 0x7f280006b0e0 2023-06-23T18:44:33.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.949+0000 7f280519a700 1 -- 172.21.15.89:0/858744385 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f0011990 con 0x7f280006b0e0 2023-06-23T18:44:33.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.949+0000 7f280519a700 1 -- 172.21.15.89:0/858744385 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f0011d20 con 0x7f280006b0e0 2023-06-23T18:44:33.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.950+0000 7f2808400700 1 -- 172.21.15.89:0/858744385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f280006b0e0 msgr2=0x7f280006c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:33.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.950+0000 7f2808400700 1 --2- 172.21.15.89:0/858744385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f280006b0e0 0x7f280006c120 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009840 tx=0x7f27f0009b50 comp rx=0 tx=0).stop 2023-06-23T18:44:33.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.950+0000 7f2808400700 1 -- 172.21.15.89:0/858744385 shutdown_connections 2023-06-23T18:44:33.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.950+0000 7f2808400700 1 --2- 172.21.15.89:0/858744385 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f280006b0e0 0x7f280006c120 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.950+0000 7f2808400700 1 -- 172.21.15.89:0/858744385 >> 172.21.15.89:0/858744385 conn(0x7f28000bd420 msgr2=0x7f28000bd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:33.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.950+0000 7f2808400700 1 -- 172.21.15.89:0/858744385 shutdown_connections 2023-06-23T18:44:33.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.950+0000 7f2808400700 1 -- 172.21.15.89:0/858744385 wait complete. 2023-06-23T18:44:33.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.952+0000 7f2808400700 1 Processor -- start 2023-06-23T18:44:33.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.952+0000 7f2808400700 1 -- start start 2023-06-23T18:44:33.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.953+0000 7f2808400700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f280006b0e0 0x7f280013f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:33.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.953+0000 7f2808400700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28000b6c50 0x7f28001d2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:33.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.953+0000 7f2808400700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28000b8a20 0x7f28001ddfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:33.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.953+0000 7f2808400700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280013dae0 con 0x7f28000b8a20 2023-06-23T18:44:33.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.953+0000 7f2808400700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280013f540 con 0x7f28000b6c50 2023-06-23T18:44:33.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.953+0000 7f2808400700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28001d1a60 con 0x7f280006b0e0 2023-06-23T18:44:33.962 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.953+0000 7f280599b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28000b6c50 0x7f28001d2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:33.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.953+0000 7f280619c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f280006b0e0 0x7f280013f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:33.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.953+0000 7f280599b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28000b6c50 0x7f28001d2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42026/0 (socket says 172.21.15.89:42026) 2023-06-23T18:44:33.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.953+0000 7f280599b700 1 -- 172.21.15.89:0/388524729 learned_addr learned my addr 172.21.15.89:0/388524729 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-06-23T18:44:33.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.953+0000 7f280699d700 1 --2- 172.21.15.89:0/388524729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28000b8a20 0x7f28001ddfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:33.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.954+0000 7f280699d700 1 -- 172.21.15.89:0/388524729 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f280006b0e0 msgr2=0x7f280013f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:33.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.954+0000 7f280699d700 1 --2- 172.21.15.89:0/388524729 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f280006b0e0 0x7f280013f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.954+0000 7f280699d700 1 -- 172.21.15.89:0/388524729 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28000b6c50 msgr2=0x7f28001d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:33.963 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.954+0000 7f280699d700 1 --2- 172.21.15.89:0/388524729 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28000b6c50 0x7f28001d2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:33.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.954+0000 7f280699d700 1 -- 172.21.15.89:0/388524729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f00094a0 con 0x7f28000b8a20 2023-06-23T18:44:33.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.954+0000 7f280619c700 1 --2- 172.21.15.89:0/388524729 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f280006b0e0 0x7f280013f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:33.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.954+0000 7f280599b700 1 --2- 172.21.15.89:0/388524729 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28000b6c50 0x7f28001d2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:33.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.954+0000 7f280699d700 1 --2- 172.21.15.89:0/388524729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28000b8a20 0x7f28001ddfe0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f27f800cb10 tx=0x7f27f800ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:33.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.954+0000 7f27f6ffd700 1 -- 172.21.15.89:0/388524729 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f8003c00 con 0x7f28000b8a20 2023-06-23T18:44:33.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.954+0000 7f27f6ffd700 1 -- 172.21.15.89:0/388524729 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f8003d60 con 0x7f28000b8a20 2023-06-23T18:44:33.964 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.954+0000 7f2808400700 1 -- 172.21.15.89:0/388524729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28001d17c0 con 0x7f28000b8a20 2023-06-23T18:44:33.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.954+0000 7f27f6ffd700 1 -- 172.21.15.89:0/388524729 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f800aa20 con 0x7f28000b8a20 2023-06-23T18:44:33.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.954+0000 7f2808400700 1 -- 172.21.15.89:0/388524729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280013dd70 con 0x7f28000b8a20 2023-06-23T18:44:33.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.954+0000 7f27f6ffd700 1 -- 172.21.15.89:0/388524729 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f27f80050d0 con 0x7f28000b8a20 2023-06-23T18:44:33.965 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.954+0000 7f27f6ffd700 1 -- 172.21.15.89:0/388524729 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f27f8012510 con 0x7f28000b8a20 2023-06-23T18:44:33.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.955+0000 7f2808400700 1 -- 172.21.15.89:0/388524729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28001d27e0 con 0x7f28000b8a20 2023-06-23T18:44:33.966 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:33.958+0000 7f27f6ffd700 1 -- 172.21.15.89:0/388524729 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f27f8005380 con 0x7f28000b8a20 2023-06-23T18:44:34.055 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.049+0000 7f2808400700 1 -- 172.21.15.89:0/388524729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd new", "uuid": "45c53102-18a6-4fd7-9c25-8ea5e1ef6851", "id": 5} v 0) v1 -- 0x7f280004e1d0 con 0x7f28000b8a20 2023-06-23T18:44:34.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.051+0000 7f27f6ffd700 1 -- 172.21.15.89:0/388524729 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "45c53102-18a6-4fd7-9c25-8ea5e1ef6851", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f27f8005520 con 0x7f28000b8a20 2023-06-23T18:44:34.057 INFO:teuthology.orchestra.run.smithi089.stdout:5 2023-06-23T18:44:34.058 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.052+0000 7f2808400700 1 -- 172.21.15.89:0/388524729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28000b8a20 msgr2=0x7f28001ddfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:34.058 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.052+0000 7f2808400700 1 --2- 172.21.15.89:0/388524729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28000b8a20 0x7f28001ddfe0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f27f800cb10 tx=0x7f27f800ce20 comp rx=0 tx=0).stop 2023-06-23T18:44:34.058 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.052+0000 7f2808400700 1 -- 172.21.15.89:0/388524729 shutdown_connections 2023-06-23T18:44:34.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.052+0000 7f2808400700 1 --2- 172.21.15.89:0/388524729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28000b8a20 0x7f28001ddfe0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:34.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.052+0000 7f2808400700 1 --2- 172.21.15.89:0/388524729 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f280006b0e0 0x7f280013f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:34.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.052+0000 7f2808400700 1 --2- 172.21.15.89:0/388524729 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28000b6c50 0x7f28001d2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:34.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.052+0000 7f2808400700 1 -- 172.21.15.89:0/388524729 >> 172.21.15.89:0/388524729 conn(0x7f28000bd420 msgr2=0x7f2800071000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:34.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.052+0000 7f2808400700 1 -- 172.21.15.89:0/388524729 shutdown_connections 2023-06-23T18:44:34.059 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.052+0000 7f2808400700 1 -- 172.21.15.89:0/388524729 wait complete. 2023-06-23T18:44:34.069 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new abee09d1-8eba-484f-a25c-871c1fe2e843 6 2023-06-23T18:44:34.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.186+0000 7f2bbdb1b700 1 Processor -- start 2023-06-23T18:44:34.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.186+0000 7f2bbdb1b700 1 -- start start 2023-06-23T18:44:34.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.186+0000 7f2bbdb1b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2bb806b0e0 0x7f2bb806fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:34.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.186+0000 7f2bbdb1b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bb8070930 0x7f2bb80b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:34.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.186+0000 7f2bbdb1b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb80b6fe0 con 0x7f2bb80afe00 2023-06-23T18:44:34.194 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.186+0000 7f2bbdb1b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb8071c00 con 0x7f2bb806b0e0 2023-06-23T18:44:34.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.186+0000 7f2bbdb1b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb80b6a20 con 0x7f2bb8070930 2023-06-23T18:44:34.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.186+0000 7f2bb6ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bb8070930 0x7f2bb80b73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:34.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.186+0000 7f2bb6ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bb8070930 0x7f2bb80b73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:53890/0 (socket says 172.21.15.89:53890) 2023-06-23T18:44:34.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.186+0000 7f2bb6ffd700 1 -- 172.21.15.89:0/729447978 learned_addr learned my addr 172.21.15.89:0/729447978 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-06-23T18:44:34.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.187+0000 7f2bb77fe700 1 --2- 172.21.15.89:0/729447978 >> v2:172.21.15.52:3300/0 conn(0x7f2bb806b0e0 0x7f2bb806fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:34.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.187+0000 7f2bb67fc700 1 -- 172.21.15.89:0/729447978 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269136823 0 0) 0x7f2bb80b6fe0 con 0x7f2bb80afe00 2023-06-23T18:44:34.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.187+0000 7f2bb6ffd700 1 -- 172.21.15.89:0/729447978 >> v2:172.21.15.52:3300/0 conn(0x7f2bb806b0e0 msgr2=0x7f2bb806fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:34.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.187+0000 7f2bb6ffd700 1 --2- 172.21.15.89:0/729447978 >> v2:172.21.15.52:3300/0 conn(0x7f2bb806b0e0 0x7f2bb806fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:34.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.187+0000 7f2bb6ffd700 1 -- 172.21.15.89:0/729447978 >> v1:172.21.15.52:6789/0 conn(0x7f2bb80afe00 legacy=0x7f2bb814de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:34.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.187+0000 7f2bb6ffd700 1 -- 172.21.15.89:0/729447978 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb80b6d00 con 0x7f2bb8070930 2023-06-23T18:44:34.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.187+0000 7f2bb6ffd700 1 --2- 172.21.15.89:0/729447978 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bb8070930 0x7f2bb80b73c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0098f0 tx=0x7f2bac009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d9bd2f34bfdf4e9 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:34.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.187+0000 7f2bb67fc700 1 -- 172.21.15.89:0/729447978 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac011830 con 0x7f2bb8070930 2023-06-23T18:44:34.196 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.187+0000 7f2bb67fc700 1 -- 172.21.15.89:0/729447978 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bac011990 con 0x7f2bb8070930 2023-06-23T18:44:34.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.187+0000 7f2bb67fc700 1 -- 172.21.15.89:0/729447978 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac011d20 con 0x7f2bb8070930 2023-06-23T18:44:34.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.188+0000 7f2bbdb1b700 1 -- 172.21.15.89:0/729447978 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bb8070930 msgr2=0x7f2bb80b73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:34.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.188+0000 7f2bbdb1b700 1 --2- 172.21.15.89:0/729447978 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bb8070930 0x7f2bb80b73c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0098f0 tx=0x7f2bac009c00 comp rx=0 tx=0).stop 2023-06-23T18:44:34.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.188+0000 7f2bbdb1b700 1 -- 172.21.15.89:0/729447978 shutdown_connections 2023-06-23T18:44:34.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.188+0000 7f2bbdb1b700 1 --2- 172.21.15.89:0/729447978 >> v2:172.21.15.52:3300/0 conn(0x7f2bb806b0e0 0x7f2bb806fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:34.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.188+0000 7f2bbdb1b700 1 --2- 172.21.15.89:0/729447978 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bb8070930 0x7f2bb80b73c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:34.197 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.188+0000 7f2bbdb1b700 1 -- 172.21.15.89:0/729447978 >> 172.21.15.89:0/729447978 conn(0x7f2bb80b95c0 msgr2=0x7f2bb80b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:34.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.188+0000 7f2bbdb1b700 1 -- 172.21.15.89:0/729447978 shutdown_connections 2023-06-23T18:44:34.198 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.188+0000 7f2bbdb1b700 1 -- 172.21.15.89:0/729447978 wait complete. 2023-06-23T18:44:34.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.189+0000 7f2bbdb1b700 1 Processor -- start 2023-06-23T18:44:34.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.189+0000 7f2bbdb1b700 1 -- start start 2023-06-23T18:44:34.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.190+0000 7f2bbdb1b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bb806b0e0 0x7f2bb80aea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:34.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.190+0000 7f2bbdb1b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bb8070930 0x7f2bb80ac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:34.200 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.190+0000 7f2bbdb1b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bb80afe00 0x7f2bb80acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:34.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.190+0000 7f2bbdb1b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb80aef50 con 0x7f2bb8070930 2023-06-23T18:44:34.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.190+0000 7f2bbdb1b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb81d1c70 con 0x7f2bb806b0e0 2023-06-23T18:44:34.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.190+0000 7f2bbdb1b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb81d0b50 con 0x7f2bb80afe00 2023-06-23T18:44:34.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.190+0000 7f2bb7fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bb80afe00 0x7f2bb80acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:34.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.190+0000 7f2bb77fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bb806b0e0 0x7f2bb80aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:34.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.190+0000 7f2bb7fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bb80afe00 0x7f2bb80acae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:53900/0 (socket says 172.21.15.89:53900) 2023-06-23T18:44:34.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.190+0000 7f2bb6ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bb8070930 0x7f2bb80ac5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:34.201 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.190+0000 7f2bb7fff700 1 -- 172.21.15.89:0/1323304062 learned_addr learned my addr 172.21.15.89:0/1323304062 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-06-23T18:44:34.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.190+0000 7f2bb77fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bb806b0e0 0x7f2bb80aea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42036/0 (socket says 172.21.15.89:42036) 2023-06-23T18:44:34.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.190+0000 7f2bb6ffd700 1 -- 172.21.15.89:0/1323304062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bb80afe00 msgr2=0x7f2bb80acae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:34.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.190+0000 7f2bb6ffd700 1 --2- 172.21.15.89:0/1323304062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bb80afe00 0x7f2bb80acae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:34.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.190+0000 7f2bb6ffd700 1 -- 172.21.15.89:0/1323304062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bb806b0e0 msgr2=0x7f2bb80aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:34.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.190+0000 7f2bb6ffd700 1 --2- 172.21.15.89:0/1323304062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bb806b0e0 0x7f2bb80aea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:34.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.190+0000 7f2bb6ffd700 1 -- 172.21.15.89:0/1323304062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bac009550 con 0x7f2bb8070930 2023-06-23T18:44:34.202 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.190+0000 7f2bb7fff700 1 --2- 172.21.15.89:0/1323304062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bb80afe00 0x7f2bb80acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:34.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.190+0000 7f2bb77fe700 1 --2- 172.21.15.89:0/1323304062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bb806b0e0 0x7f2bb80aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:34.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.190+0000 7f2bb6ffd700 1 --2- 172.21.15.89:0/1323304062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bb8070930 0x7f2bb80ac5a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2bac016000 tx=0x7f2bac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:34.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.191+0000 7f2b9ffff700 1 -- 172.21.15.89:0/1323304062 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac004300 con 0x7f2bb8070930 2023-06-23T18:44:34.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.191+0000 7f2b9ffff700 1 -- 172.21.15.89:0/1323304062 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bac01f070 con 0x7f2bb8070930 2023-06-23T18:44:34.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.191+0000 7f2bbdb1b700 1 -- 172.21.15.89:0/1323304062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb81d1ec0 con 0x7f2bb8070930 2023-06-23T18:44:34.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.191+0000 7f2b9ffff700 1 -- 172.21.15.89:0/1323304062 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac0036a0 con 0x7f2bb8070930 2023-06-23T18:44:34.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.191+0000 7f2bbdb1b700 1 -- 172.21.15.89:0/1323304062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb81d2480 con 0x7f2bb8070930 2023-06-23T18:44:34.203 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.191+0000 7f2b9ffff700 1 -- 172.21.15.89:0/1323304062 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2bac021030 con 0x7f2bb8070930 2023-06-23T18:44:34.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.191+0000 7f2b9ffff700 1 -- 172.21.15.89:0/1323304062 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f2bac006d50 con 0x7f2bb8070930 2023-06-23T18:44:34.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.191+0000 7f2bbdb1b700 1 -- 172.21.15.89:0/1323304062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb80adbb0 con 0x7f2bb8070930 2023-06-23T18:44:34.204 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.194+0000 7f2b9ffff700 1 -- 172.21.15.89:0/1323304062 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f2bb80adbb0 con 0x7f2bb8070930 2023-06-23T18:44:34.283 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.277+0000 7f2bbdb1b700 1 -- 172.21.15.89:0/1323304062 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd new", "uuid": "abee09d1-8eba-484f-a25c-871c1fe2e843", "id": 6} v 0) v1 -- 0x7f2bb81d2610 con 0x7f2bb8070930 2023-06-23T18:44:34.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.279+0000 7f2b9ffff700 1 -- 172.21.15.89:0/1323304062 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "abee09d1-8eba-484f-a25c-871c1fe2e843", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2bac031020 con 0x7f2bb8070930 2023-06-23T18:44:34.285 INFO:teuthology.orchestra.run.smithi089.stdout:6 2023-06-23T18:44:34.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.280+0000 7f2bbdb1b700 1 -- 172.21.15.89:0/1323304062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bb8070930 msgr2=0x7f2bb80ac5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:34.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.280+0000 7f2bbdb1b700 1 --2- 172.21.15.89:0/1323304062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bb8070930 0x7f2bb80ac5a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2bac016000 tx=0x7f2bac004750 comp rx=0 tx=0).stop 2023-06-23T18:44:34.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.280+0000 7f2bbdb1b700 1 -- 172.21.15.89:0/1323304062 shutdown_connections 2023-06-23T18:44:34.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.280+0000 7f2bbdb1b700 1 --2- 172.21.15.89:0/1323304062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bb80afe00 0x7f2bb80acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:34.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.280+0000 7f2bbdb1b700 1 --2- 172.21.15.89:0/1323304062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bb806b0e0 0x7f2bb80aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:34.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.280+0000 7f2bbdb1b700 1 --2- 172.21.15.89:0/1323304062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bb8070930 0x7f2bb80ac5a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:34.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.280+0000 7f2bbdb1b700 1 -- 172.21.15.89:0/1323304062 >> 172.21.15.89:0/1323304062 conn(0x7f2bb80b95c0 msgr2=0x7f2bb8149fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:34.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.281+0000 7f2bbdb1b700 1 -- 172.21.15.89:0/1323304062 shutdown_connections 2023-06-23T18:44:34.288 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.281+0000 7f2bbdb1b700 1 -- 172.21.15.89:0/1323304062 wait complete. 2023-06-23T18:44:34.298 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 5acf9e2e-00dd-4f9b-a7d9-3d820f695de3 7 2023-06-23T18:44:34.416 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:34.410+0000 7fc6a58b3200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-23T18:44:34.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.416+0000 7fd316420700 1 Processor -- start 2023-06-23T18:44:34.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.416+0000 7fd316420700 1 -- start start 2023-06-23T18:44:34.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.417+0000 7fd316420700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd31014a600 0x7fd3100bb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:34.424 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.417+0000 7fd316420700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3100b59b0 0x7fd3100bb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:34.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.417+0000 7fd316420700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3100be040 con 0x7fd3100b6870 2023-06-23T18:44:34.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.417+0000 7fd316420700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd31014aae0 con 0x7fd31014a600 2023-06-23T18:44:34.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.417+0000 7fd316420700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31014adc0 con 0x7fd3100b59b0 2023-06-23T18:44:34.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.417+0000 7fd30ffff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd3100b6870 0x7fd310144480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:35534/0 (socket says 172.21.15.89:35534) 2023-06-23T18:44:34.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.417+0000 7fd3149bd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3100b59b0 0x7fd3100bb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:34.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.417+0000 7fd30ffff700 1 -- 172.21.15.89:0/830105517 learned_addr learned my addr 172.21.15.89:0/830105517 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-06-23T18:44:34.425 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.417+0000 7fd30f7fe700 1 --2- 172.21.15.89:0/830105517 >> v2:172.21.15.52:3300/0 conn(0x7fd31014a600 0x7fd3100bb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:34.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.417+0000 7fd30effd700 1 -- 172.21.15.89:0/830105517 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3605095926 0 0) 0x7fd3100be040 con 0x7fd3100b6870 2023-06-23T18:44:34.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.417+0000 7fd3149bd700 1 -- 172.21.15.89:0/830105517 >> v2:172.21.15.52:3300/0 conn(0x7fd31014a600 msgr2=0x7fd3100bb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:34.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.418+0000 7fd3149bd700 1 --2- 172.21.15.89:0/830105517 >> v2:172.21.15.52:3300/0 conn(0x7fd31014a600 0x7fd3100bb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:34.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.418+0000 7fd3149bd700 1 -- 172.21.15.89:0/830105517 >> v1:172.21.15.89:6789/0 conn(0x7fd3100b6870 legacy=0x7fd310144480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:34.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.418+0000 7fd3149bd700 1 -- 172.21.15.89:0/830105517 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31014b0a0 con 0x7fd3100b59b0 2023-06-23T18:44:34.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.418+0000 7fd3149bd700 1 --2- 172.21.15.89:0/830105517 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3100b59b0 0x7fd3100bb730 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd308009d90 tx=0x7fd30800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee2eba33c2cdf3d6 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:34.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.418+0000 7fd30effd700 1 -- 172.21.15.89:0/830105517 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30800e070 con 0x7fd3100b59b0 2023-06-23T18:44:34.426 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.418+0000 7fd30effd700 1 -- 172.21.15.89:0/830105517 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30800bb20 con 0x7fd3100b59b0 2023-06-23T18:44:34.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.418+0000 7fd30effd700 1 -- 172.21.15.89:0/830105517 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd308012430 con 0x7fd3100b59b0 2023-06-23T18:44:34.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.418+0000 7fd316420700 1 -- 172.21.15.89:0/830105517 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3100b59b0 msgr2=0x7fd3100bb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:34.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.418+0000 7fd316420700 1 --2- 172.21.15.89:0/830105517 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3100b59b0 0x7fd3100bb730 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd308009d90 tx=0x7fd30800b330 comp rx=0 tx=0).stop 2023-06-23T18:44:34.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.418+0000 7fd316420700 1 -- 172.21.15.89:0/830105517 shutdown_connections 2023-06-23T18:44:34.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.418+0000 7fd316420700 1 --2- 172.21.15.89:0/830105517 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3100b59b0 0x7fd3100bb730 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:34.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.418+0000 7fd316420700 1 --2- 172.21.15.89:0/830105517 >> v2:172.21.15.52:3300/0 conn(0x7fd31014a600 0x7fd3100bb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:34.427 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.418+0000 7fd316420700 1 -- 172.21.15.89:0/830105517 >> 172.21.15.89:0/830105517 conn(0x7fd3100bd140 msgr2=0x7fd3100bd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:34.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.418+0000 7fd316420700 1 -- 172.21.15.89:0/830105517 shutdown_connections 2023-06-23T18:44:34.428 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.419+0000 7fd316420700 1 -- 172.21.15.89:0/830105517 wait complete. 2023-06-23T18:44:34.428 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-06-23T18:44:34.418+0000 7f44ea8a2200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-23T18:44:34.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.420+0000 7fd316420700 1 Processor -- start 2023-06-23T18:44:34.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.420+0000 7fd316420700 1 -- start start 2023-06-23T18:44:34.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.421+0000 7fd316420700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3100b59b0 0x7fd3100b9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:34.430 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.421+0000 7fd316420700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3100b6870 0x7fd31013e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:34.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.421+0000 7fd316420700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd31014a600 0x7fd3101e2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:34.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.421+0000 7fd316420700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31013f780 con 0x7fd31014a600 2023-06-23T18:44:34.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.421+0000 7fd316420700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3100ba190 con 0x7fd3100b6870 2023-06-23T18:44:34.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.421+0000 7fd316420700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3100ba470 con 0x7fd3100b59b0 2023-06-23T18:44:34.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.421+0000 7fd30ffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3100b59b0 0x7fd3100b9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:34.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.421+0000 7fd30f7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3100b6870 0x7fd31013e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:34.431 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.421+0000 7fd30ffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3100b59b0 0x7fd3100b9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:53930/0 (socket says 172.21.15.89:53930) 2023-06-23T18:44:34.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.421+0000 7fd30ffff700 1 -- 172.21.15.89:0/3777688633 learned_addr learned my addr 172.21.15.89:0/3777688633 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-06-23T18:44:34.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.421+0000 7fd3149bd700 1 --2- 172.21.15.89:0/3777688633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd31014a600 0x7fd3101e2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:34.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.421+0000 7fd30ffff700 1 -- 172.21.15.89:0/3777688633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3100b6870 msgr2=0x7fd31013e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:34.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.421+0000 7fd30ffff700 1 --2- 172.21.15.89:0/3777688633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3100b6870 0x7fd31013e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:34.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.421+0000 7fd30ffff700 1 -- 172.21.15.89:0/3777688633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd31014a600 msgr2=0x7fd3101e2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:34.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.421+0000 7fd30ffff700 1 --2- 172.21.15.89:0/3777688633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd31014a600 0x7fd3101e2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:34.432 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.421+0000 7fd30ffff700 1 -- 172.21.15.89:0/3777688633 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd308009a70 con 0x7fd3100b59b0 2023-06-23T18:44:34.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.421+0000 7fd3149bd700 1 --2- 172.21.15.89:0/3777688633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd31014a600 0x7fd3101e2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:34.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.421+0000 7fd30f7fe700 1 --2- 172.21.15.89:0/3777688633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3100b6870 0x7fd31013e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:34.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.421+0000 7fd30ffff700 1 --2- 172.21.15.89:0/3777688633 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3100b59b0 0x7fd3100b9670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd30000c750 tx=0x7fd30000ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:34.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.422+0000 7fd30cff9700 1 -- 172.21.15.89:0/3777688633 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd300004c80 con 0x7fd3100b59b0 2023-06-23T18:44:34.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.422+0000 7fd30cff9700 1 -- 172.21.15.89:0/3777688633 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd300004e00 con 0x7fd3100b59b0 2023-06-23T18:44:34.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.422+0000 7fd30cff9700 1 -- 172.21.15.89:0/3777688633 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd300007310 con 0x7fd3100b59b0 2023-06-23T18:44:34.433 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.422+0000 7fd316420700 1 -- 172.21.15.89:0/3777688633 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3101e3740 con 0x7fd3100b59b0 2023-06-23T18:44:34.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.422+0000 7fd316420700 1 -- 172.21.15.89:0/3777688633 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd31013e4c0 con 0x7fd3100b59b0 2023-06-23T18:44:34.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.422+0000 7fd30cff9700 1 -- 172.21.15.89:0/3777688633 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd30001d3f0 con 0x7fd3100b59b0 2023-06-23T18:44:34.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.422+0000 7fd30cff9700 1 -- 172.21.15.89:0/3777688633 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fd300013a20 con 0x7fd3100b59b0 2023-06-23T18:44:34.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.423+0000 7fd316420700 1 -- 172.21.15.89:0/3777688633 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31004e1d0 con 0x7fd3100b59b0 2023-06-23T18:44:34.434 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.425+0000 7fd30cff9700 1 -- 172.21.15.89:0/3777688633 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fd300013c80 con 0x7fd3100b59b0 2023-06-23T18:44:34.493 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:34.487+0000 7fc6a58b3200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-23T18:44:34.499 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-06-23T18:44:34.494+0000 7f44ea8a2200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-23T18:44:34.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.507+0000 7fd316420700 1 -- 172.21.15.89:0/3777688633 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5acf9e2e-00dd-4f9b-a7d9-3d820f695de3", "id": 7} v 0) v1 -- 0x7fd3100b80e0 con 0x7fd3100b59b0 2023-06-23T18:44:34.516 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.510+0000 7fd30cff9700 1 -- 172.21.15.89:0/3777688633 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5acf9e2e-00dd-4f9b-a7d9-3d820f695de3", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd3000133c0 con 0x7fd3100b59b0 2023-06-23T18:44:34.516 INFO:teuthology.orchestra.run.smithi089.stdout:7 2023-06-23T18:44:34.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.511+0000 7fd316420700 1 -- 172.21.15.89:0/3777688633 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3100b59b0 msgr2=0x7fd3100b9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:34.517 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.511+0000 7fd316420700 1 --2- 172.21.15.89:0/3777688633 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3100b59b0 0x7fd3100b9670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd30000c750 tx=0x7fd30000ca60 comp rx=0 tx=0).stop 2023-06-23T18:44:34.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.511+0000 7fd316420700 1 -- 172.21.15.89:0/3777688633 shutdown_connections 2023-06-23T18:44:34.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.511+0000 7fd316420700 1 --2- 172.21.15.89:0/3777688633 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd31014a600 0x7fd3101e2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:34.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.511+0000 7fd316420700 1 --2- 172.21.15.89:0/3777688633 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3100b59b0 0x7fd3100b9670 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:34.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.511+0000 7fd316420700 1 --2- 172.21.15.89:0/3777688633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3100b6870 0x7fd31013e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:34.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.511+0000 7fd316420700 1 -- 172.21.15.89:0/3777688633 >> 172.21.15.89:0/3777688633 conn(0x7fd3100bd140 msgr2=0x7fd310142110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:34.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.511+0000 7fd316420700 1 -- 172.21.15.89:0/3777688633 shutdown_connections 2023-06-23T18:44:34.518 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-23T18:44:34.512+0000 7fd316420700 1 -- 172.21.15.89:0/3777688633 wait complete. 2023-06-23T18:44:34.529 INFO:tasks.ceph.osd.0:Restarting daemon 2023-06-23T18:44:34.530 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-06-23T18:44:34.532 INFO:tasks.ceph.osd.0:Started 2023-06-23T18:44:34.532 INFO:tasks.ceph.osd.1:Restarting daemon 2023-06-23T18:44:34.532 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-06-23T18:44:34.534 INFO:tasks.ceph.osd.1:Started 2023-06-23T18:44:34.535 INFO:tasks.ceph.osd.2:Restarting daemon 2023-06-23T18:44:34.535 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-06-23T18:44:34.536 INFO:tasks.ceph.osd.2:Started 2023-06-23T18:44:34.537 INFO:tasks.ceph.osd.3:Restarting daemon 2023-06-23T18:44:34.537 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-06-23T18:44:34.539 INFO:tasks.ceph.osd.3:Started 2023-06-23T18:44:34.539 INFO:tasks.ceph.osd.4:Restarting daemon 2023-06-23T18:44:34.539 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-06-23T18:44:34.541 INFO:tasks.ceph.osd.4:Started 2023-06-23T18:44:34.541 INFO:tasks.ceph.osd.5:Restarting daemon 2023-06-23T18:44:34.542 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-06-23T18:44:34.543 INFO:tasks.ceph.osd.5:Started 2023-06-23T18:44:34.544 INFO:tasks.ceph.osd.6:Restarting daemon 2023-06-23T18:44:34.544 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-06-23T18:44:34.546 INFO:tasks.ceph.osd.6:Started 2023-06-23T18:44:34.546 INFO:tasks.ceph.osd.7:Restarting daemon 2023-06-23T18:44:34.547 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-06-23T18:44:34.548 INFO:tasks.ceph.osd.7:Started 2023-06-23T18:44:34.549 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:44:34.671 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:34.665+0000 7fc6a58b3200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-23T18:44:34.676 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-06-23T18:44:34.670+0000 7f44ea8a2200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-23T18:44:34.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.703+0000 7f2e5a562700 1 Processor -- start 2023-06-23T18:44:34.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.703+0000 7f2e5a562700 1 -- start start 2023-06-23T18:44:34.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.704+0000 7f2e5a562700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e540b6930 0x7f2e540bc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:34.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.704+0000 7f2e5a562700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e540b64a0 con 0x7f2e5406a0d0 2023-06-23T18:44:34.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.704+0000 7f2e5a562700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e540b7d90 con 0x7f2e540b7540 2023-06-23T18:44:34.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.704+0000 7f2e5a562700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e540b55a0 con 0x7f2e540b6930 2023-06-23T18:44:34.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.704+0000 7f2e53fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2e5406a0d0 0x7f2e5414de60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:34066/0 (socket says 172.21.15.52:34066) 2023-06-23T18:44:34.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.704+0000 7f2e53fff700 1 -- 172.21.15.52:0/290447459 learned_addr learned my addr 172.21.15.52:0/290447459 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:34.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.704+0000 7f2e58aff700 1 --2- 172.21.15.52:0/290447459 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e540b6930 0x7f2e540bc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:34.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.705+0000 7f2e52ffd700 1 -- 172.21.15.52:0/290447459 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 505777602 0 0) 0x7f2e540b64a0 con 0x7f2e5406a0d0 2023-06-23T18:44:34.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.705+0000 7f2e52ffd700 1 -- 172.21.15.52:0/290447459 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e3c0035b0 con 0x7f2e5406a0d0 2023-06-23T18:44:34.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.705+0000 7f2e52ffd700 1 -- 172.21.15.52:0/290447459 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874254296 0 0) 0x7f2e540b7d90 con 0x7f2e540b7540 2023-06-23T18:44:34.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.705+0000 7f2e52ffd700 1 -- 172.21.15.52:0/290447459 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e540b64a0 con 0x7f2e540b7540 2023-06-23T18:44:34.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.705+0000 7f2e58aff700 1 -- 172.21.15.52:0/290447459 >> v1:172.21.15.89:6789/0 conn(0x7f2e540b7540 legacy=0x7f2e54147b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:34.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.705+0000 7f2e58aff700 1 -- 172.21.15.52:0/290447459 >> v1:172.21.15.52:6789/0 conn(0x7f2e5406a0d0 legacy=0x7f2e5414de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:34.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.705+0000 7f2e58aff700 1 -- 172.21.15.52:0/290447459 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e540b5880 con 0x7f2e540b6930 2023-06-23T18:44:34.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.705+0000 7f2e58aff700 1 --2- 172.21.15.52:0/290447459 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e540b6930 0x7f2e540bc980 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c009dc0 tx=0x7f2e4c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c45baecbad1694a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:34.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.705+0000 7f2e52ffd700 1 -- 172.21.15.52:0/290447459 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c00e070 con 0x7f2e540b6930 2023-06-23T18:44:34.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.705+0000 7f2e52ffd700 1 -- 172.21.15.52:0/290447459 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c00bb20 con 0x7f2e540b6930 2023-06-23T18:44:34.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.705+0000 7f2e52ffd700 1 -- 172.21.15.52:0/290447459 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c012430 con 0x7f2e540b6930 2023-06-23T18:44:34.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.706+0000 7f2e5a562700 1 -- 172.21.15.52:0/290447459 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e540b6930 msgr2=0x7f2e540bc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:34.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.706+0000 7f2e5a562700 1 --2- 172.21.15.52:0/290447459 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e540b6930 0x7f2e540bc980 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c009dc0 tx=0x7f2e4c00b330 comp rx=0 tx=0).stop 2023-06-23T18:44:34.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.706+0000 7f2e5a562700 1 -- 172.21.15.52:0/290447459 shutdown_connections 2023-06-23T18:44:34.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.706+0000 7f2e5a562700 1 --2- 172.21.15.52:0/290447459 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e540b6930 0x7f2e540bc980 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:34.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.706+0000 7f2e5a562700 1 -- 172.21.15.52:0/290447459 >> 172.21.15.52:0/290447459 conn(0x7f2e5406bb20 msgr2=0x7f2e5406bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:34.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.706+0000 7f2e5a562700 1 -- 172.21.15.52:0/290447459 shutdown_connections 2023-06-23T18:44:34.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.706+0000 7f2e5a562700 1 -- 172.21.15.52:0/290447459 wait complete. 2023-06-23T18:44:34.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.707+0000 7f2e5a562700 1 Processor -- start 2023-06-23T18:44:34.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.707+0000 7f2e5a562700 1 -- start start 2023-06-23T18:44:34.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.708+0000 7f2e5a562700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e5406a0d0 0x7f2e5414ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:34.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.708+0000 7f2e5a562700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e540b6930 0x7f2e541e02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:34.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.708+0000 7f2e5a562700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e540b7540 0x7f2e541e0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:34.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.708+0000 7f2e5a562700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e541d6a00 con 0x7f2e540b6930 2023-06-23T18:44:34.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.708+0000 7f2e5a562700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e541d3d90 con 0x7f2e540b7540 2023-06-23T18:44:34.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.708+0000 7f2e5a562700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e541d4070 con 0x7f2e5406a0d0 2023-06-23T18:44:34.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.708+0000 7f2e537fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e540b6930 0x7f2e541e02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:34.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.708+0000 7f2e53fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e5406a0d0 0x7f2e5414ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:34.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.708+0000 7f2e537fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e540b6930 0x7f2e541e02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:54810/0 (socket says 172.21.15.52:54810) 2023-06-23T18:44:34.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.708+0000 7f2e58aff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e540b7540 0x7f2e541e0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:34.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.708+0000 7f2e537fe700 1 -- 172.21.15.52:0/702684694 learned_addr learned my addr 172.21.15.52:0/702684694 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:34.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.708+0000 7f2e53fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e5406a0d0 0x7f2e5414ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.52:35664/0 (socket says 172.21.15.52:35664) 2023-06-23T18:44:34.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.708+0000 7f2e537fe700 1 -- 172.21.15.52:0/702684694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e5406a0d0 msgr2=0x7f2e5414ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:34.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.708+0000 7f2e537fe700 1 --2- 172.21.15.52:0/702684694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e5406a0d0 0x7f2e5414ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:34.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.708+0000 7f2e537fe700 1 -- 172.21.15.52:0/702684694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e540b7540 msgr2=0x7f2e541e0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:34.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.708+0000 7f2e537fe700 1 --2- 172.21.15.52:0/702684694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e540b7540 0x7f2e541e0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:34.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.708+0000 7f2e537fe700 1 -- 172.21.15.52:0/702684694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c009a70 con 0x7f2e540b6930 2023-06-23T18:44:34.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.708+0000 7f2e53fff700 1 --2- 172.21.15.52:0/702684694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e5406a0d0 0x7f2e5414ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:34.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.708+0000 7f2e537fe700 1 --2- 172.21.15.52:0/702684694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e540b6930 0x7f2e541e02d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800c450 tx=0x7f2e4800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:34.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.708+0000 7f2e50ff9700 1 -- 172.21.15.52:0/702684694 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e480052d0 con 0x7f2e540b6930 2023-06-23T18:44:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.709+0000 7f2e50ff9700 1 -- 172.21.15.52:0/702684694 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e48005430 con 0x7f2e540b6930 2023-06-23T18:44:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.709+0000 7f2e50ff9700 1 -- 172.21.15.52:0/702684694 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e480038c0 con 0x7f2e540b6930 2023-06-23T18:44:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.709+0000 7f2e5a562700 1 -- 172.21.15.52:0/702684694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e540b5ce0 con 0x7f2e540b6930 2023-06-23T18:44:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.709+0000 7f2e5a562700 1 -- 172.21.15.52:0/702684694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e541d4630 con 0x7f2e540b6930 2023-06-23T18:44:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.709+0000 7f2e50ff9700 1 -- 172.21.15.52:0/702684694 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2e48003d20 con 0x7f2e540b6930 2023-06-23T18:44:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.709+0000 7f2e50ff9700 1 -- 172.21.15.52:0/702684694 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f2e48011db0 con 0x7f2e540b6930 2023-06-23T18:44:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.709+0000 7f2e5a562700 1 -- 172.21.15.52:0/702684694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e541d47c0 con 0x7f2e540b6930 2023-06-23T18:44:34.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.713+0000 7f2e50ff9700 1 -- 172.21.15.52:0/702684694 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f2e48017070 con 0x7f2e540b6930 2023-06-23T18:44:34.741 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:34.736+0000 7fc6a58b3200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-23T18:44:34.753 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-06-23T18:44:34.747+0000 7f44ea8a2200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-23T18:44:34.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.784+0000 7f2e5a562700 1 -- 172.21.15.52:0/702684694 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e540a6800 con 0x7f2e540b6930 2023-06-23T18:44:34.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.784+0000 7f2e50ff9700 1 -- 172.21.15.52:0/702684694 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f2e48011590 con 0x7f2e540b6930 2023-06-23T18:44:34.790 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:44:34.790 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":10,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","created":"2023-06-23T18:44:31.918434+0000","modified":"2023-06-23T18:44:34.510501+0000","last_up_change":"0.000000","last_in_change":"2023-06-23T18:44:34.510501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c371fb28-1b15-4e43-8d5a-43e402920ed9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4a142f04-33eb-47ec-9cc5-b08b44d82658","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d7bb089d-4c55-4370-ba59-7fe88c39512a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4bcdcdc3-6a8f-468e-877e-57f76079ac3a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cac63000-ae94-4b08-93e6-a99119640b63","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"45c53102-18a6-4fd7-9c25-8ea5e1ef6851","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"abee09d1-8eba-484f-a25c-871c1fe2e843","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5acf9e2e-00dd-4f9b-a7d9-3d820f695de3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:44:34.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.785+0000 7f2e5a562700 1 -- 172.21.15.52:0/702684694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e540b6930 msgr2=0x7f2e541e02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:34.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.785+0000 7f2e5a562700 1 --2- 172.21.15.52:0/702684694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e540b6930 0x7f2e541e02d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800c450 tx=0x7f2e4800c760 comp rx=0 tx=0).stop 2023-06-23T18:44:34.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.785+0000 7f2e5a562700 1 -- 172.21.15.52:0/702684694 shutdown_connections 2023-06-23T18:44:34.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.785+0000 7f2e5a562700 1 --2- 172.21.15.52:0/702684694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2e540b7540 0x7f2e541e0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:34.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.785+0000 7f2e5a562700 1 --2- 172.21.15.52:0/702684694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2e5406a0d0 0x7f2e5414ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:34.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.785+0000 7f2e5a562700 1 --2- 172.21.15.52:0/702684694 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2e540b6930 0x7f2e541e02d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:34.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.785+0000 7f2e5a562700 1 -- 172.21.15.52:0/702684694 >> 172.21.15.52:0/702684694 conn(0x7f2e5406bb20 msgr2=0x7f2e540beb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:34.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.785+0000 7f2e5a562700 1 -- 172.21.15.52:0/702684694 shutdown_connections 2023-06-23T18:44:34.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:34.785+0000 7f2e5a562700 1 -- 172.21.15.52:0/702684694 wait complete. 2023-06-23T18:44:34.804 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-06-23T18:44:34.805 INFO:tasks.ceph:Waiting for OSDs to come up 2023-06-23T18:44:34.930 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:34.924+0000 7fc6a58b3200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-23T18:44:34.942 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-06-23T18:44:34.936+0000 7f44ea8a2200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-23T18:44:35.010 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:35.004+0000 7fc6a58b3200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-23T18:44:35.024 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-06-23T18:44:35.019+0000 7f44ea8a2200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-23T18:44:35.088 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:35.082+0000 7fc6a58b3200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-23T18:44:35.105 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-06-23T18:44:35.099+0000 7f44ea8a2200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-23T18:44:35.151 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-23T18:44:35.145+0000 7f23e2e0e640 -1 Falling back to public interface 2023-06-23T18:44:35.153 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-23T18:44:35.147+0000 7f49e69da640 -1 Falling back to public interface 2023-06-23T18:44:35.159 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-23T18:44:35.153+0000 7f6fd1dee640 -1 Falling back to public interface 2023-06-23T18:44:35.166 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-06-23T18:44:35.160+0000 7f91bc896640 -1 Falling back to public interface 2023-06-23T18:44:35.170 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-06-23T18:44:35.165+0000 7fc240fe0640 -1 Falling back to public interface 2023-06-23T18:44:35.170 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-06-23T18:44:35.165+0000 7f0f2f70f640 -1 Falling back to public interface 2023-06-23T18:44:35.171 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-06-23T18:44:35.165+0000 7fca39f6a640 -1 Falling back to public interface 2023-06-23T18:44:35.171 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-06-23T18:44:35.165+0000 7fc238387700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6808/0: (98) Address already in use 2023-06-23T18:44:35.171 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-06-23T18:44:35.166+0000 7fc238387700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6814/0: (98) Address already in use 2023-06-23T18:44:35.174 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-06-23T18:44:35.168+0000 7f0f26ab6700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6827/0: (98) Address already in use 2023-06-23T18:44:35.182 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-23T18:44:35.177+0000 7fd08f93b640 -1 Falling back to public interface 2023-06-23T18:44:35.185 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:35.180+0000 7fc6a58b3200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-23T18:44:35.194 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-06-23T18:44:35.189+0000 7f44ea8a2200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-23T18:44:35.367 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:35.361+0000 7fc6a58b3200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-23T18:44:35.382 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-06-23T18:44:35.377+0000 7f44ea8a2200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-23T18:44:35.448 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:35.442+0000 7fc6a58b3200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-23T18:44:35.467 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-06-23T18:44:35.461+0000 7f44ea8a2200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-23T18:44:35.611 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-23T18:44:35.729 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.723+0000 7fd9bf434700 1 Processor -- start 2023-06-23T18:44:35.729 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.723+0000 7fd9bf434700 1 -- start start 2023-06-23T18:44:35.731 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.724+0000 7fd9bf434700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b80ba7a0 0x7fd9b80b8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:35.731 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.724+0000 7fd9bf434700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd9b80b88d0 0x7fd9b8145730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:35.731 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.724+0000 7fd9bf434700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b80b7fe0 con 0x7fd9b8145c70 2023-06-23T18:44:35.731 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.724+0000 7fd9bf434700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b81460a0 con 0x7fd9b80b88d0 2023-06-23T18:44:35.731 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.724+0000 7fd9bf434700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b80b9ca0 con 0x7fd9b80ba7a0 2023-06-23T18:44:35.731 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.724+0000 7fd9bd9d1700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fd9b8145c70 0x7fd9b80b69b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56046/0 (socket says 172.21.15.52:56046) 2023-06-23T18:44:35.732 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.724+0000 7fd9bd9d1700 1 -- 172.21.15.52:0/328483865 learned_addr learned my addr 172.21.15.52:0/328483865 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:35.732 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.724+0000 7fd9bd1d0700 1 --2- 172.21.15.52:0/328483865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b80ba7a0 0x7fd9b80b8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:35.732 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.724+0000 7fd9bc9cf700 1 --2- 172.21.15.52:0/328483865 >> v2:172.21.15.89:3300/0 conn(0x7fd9b80b88d0 0x7fd9b8145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:35.732 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.724+0000 7fd9affff700 1 -- 172.21.15.52:0/328483865 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46528960 0 0) 0x7fd9b80b7fe0 con 0x7fd9b8145c70 2023-06-23T18:44:35.732 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.724+0000 7fd9affff700 1 -- 172.21.15.52:0/328483865 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9a40035b0 con 0x7fd9b8145c70 2023-06-23T18:44:35.732 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.724+0000 7fd9bd1d0700 1 -- 172.21.15.52:0/328483865 >> v2:172.21.15.89:3300/0 conn(0x7fd9b80b88d0 msgr2=0x7fd9b8145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:35.732 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.724+0000 7fd9bd1d0700 1 --2- 172.21.15.52:0/328483865 >> v2:172.21.15.89:3300/0 conn(0x7fd9b80b88d0 0x7fd9b8145730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:35.733 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.724+0000 7fd9bd1d0700 1 -- 172.21.15.52:0/328483865 >> v1:172.21.15.52:6789/0 conn(0x7fd9b8145c70 legacy=0x7fd9b80b69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:35.733 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.724+0000 7fd9bd1d0700 1 -- 172.21.15.52:0/328483865 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b80704b0 con 0x7fd9b80ba7a0 2023-06-23T18:44:35.733 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.724+0000 7fd9bc9cf700 1 --2- 172.21.15.52:0/328483865 >> v2:172.21.15.89:3300/0 conn(0x7fd9b80b88d0 0x7fd9b8145730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:35.733 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.725+0000 7fd9bd1d0700 1 --2- 172.21.15.52:0/328483865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b80ba7a0 0x7fd9b80b8390 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4009840 tx=0x7fd9b4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c68e0f2516d3abda server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:35.733 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.725+0000 7fd9affff700 1 -- 172.21.15.52:0/328483865 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4011830 con 0x7fd9b80ba7a0 2023-06-23T18:44:35.734 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.725+0000 7fd9affff700 1 -- 172.21.15.52:0/328483865 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b4011990 con 0x7fd9b80ba7a0 2023-06-23T18:44:35.734 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.725+0000 7fd9affff700 1 -- 172.21.15.52:0/328483865 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4011d20 con 0x7fd9b80ba7a0 2023-06-23T18:44:35.736 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.725+0000 7fd9bf434700 1 -- 172.21.15.52:0/328483865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b80ba7a0 msgr2=0x7fd9b80b8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:35.736 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.725+0000 7fd9bf434700 1 --2- 172.21.15.52:0/328483865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b80ba7a0 0x7fd9b80b8390 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4009840 tx=0x7fd9b4009b50 comp rx=0 tx=0).stop 2023-06-23T18:44:35.736 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.725+0000 7fd9bf434700 1 -- 172.21.15.52:0/328483865 shutdown_connections 2023-06-23T18:44:35.736 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.725+0000 7fd9bf434700 1 --2- 172.21.15.52:0/328483865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b80ba7a0 0x7fd9b80b8390 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:35.736 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.725+0000 7fd9bf434700 1 --2- 172.21.15.52:0/328483865 >> v2:172.21.15.89:3300/0 conn(0x7fd9b80b88d0 0x7fd9b8145730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:35.737 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.725+0000 7fd9bf434700 1 -- 172.21.15.52:0/328483865 >> 172.21.15.52:0/328483865 conn(0x7fd9b80bdff0 msgr2=0x7fd9b80b9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:35.737 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.726+0000 7fd9bf434700 1 -- 172.21.15.52:0/328483865 shutdown_connections 2023-06-23T18:44:35.737 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.726+0000 7fd9bf434700 1 -- 172.21.15.52:0/328483865 wait complete. 2023-06-23T18:44:35.737 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.727+0000 7fd9bf434700 1 Processor -- start 2023-06-23T18:44:35.737 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.727+0000 7fd9bf434700 1 -- start start 2023-06-23T18:44:35.737 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.729+0000 7fd9bf434700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b80b88d0 0x7fd9b80bc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:35.737 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.729+0000 7fd9bf434700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b80ba7a0 0x7fd9b81e0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:35.737 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.729+0000 7fd9bf434700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9b8145c70 0x7fd9b81e1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:35.738 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.729+0000 7fd9bf434700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b813e710 con 0x7fd9b8145c70 2023-06-23T18:44:35.738 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.729+0000 7fd9bf434700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b80bc6a0 con 0x7fd9b80ba7a0 2023-06-23T18:44:35.738 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.729+0000 7fd9bf434700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b81482b0 con 0x7fd9b80b88d0 2023-06-23T18:44:35.738 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.729+0000 7fd9bd9d1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9b8145c70 0x7fd9b81e1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:35.738 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.729+0000 7fd9bd1d0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b80b88d0 0x7fd9b80bc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:35.738 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.729+0000 7fd9bd9d1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9b8145c70 0x7fd9b81e1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51684/0 (socket says 172.21.15.52:51684) 2023-06-23T18:44:35.738 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.729+0000 7fd9bd9d1700 1 -- 172.21.15.52:0/151870670 learned_addr learned my addr 172.21.15.52:0/151870670 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:35.739 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.729+0000 7fd9bc9cf700 1 --2- 172.21.15.52:0/151870670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b80ba7a0 0x7fd9b81e0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:35.739 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.729+0000 7fd9bd1d0700 1 -- 172.21.15.52:0/151870670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b80ba7a0 msgr2=0x7fd9b81e0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:35.739 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.729+0000 7fd9bd1d0700 1 --2- 172.21.15.52:0/151870670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b80ba7a0 0x7fd9b81e0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:35.739 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.729+0000 7fd9bd1d0700 1 -- 172.21.15.52:0/151870670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9b8145c70 msgr2=0x7fd9b81e1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:35.739 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.729+0000 7fd9bd1d0700 1 --2- 172.21.15.52:0/151870670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9b8145c70 0x7fd9b81e1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:35.739 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.729+0000 7fd9bd1d0700 1 -- 172.21.15.52:0/151870670 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a80094a0 con 0x7fd9b80b88d0 2023-06-23T18:44:35.739 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.729+0000 7fd9bd1d0700 1 --2- 172.21.15.52:0/151870670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b80b88d0 0x7fd9b80bc160 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4009840 tx=0x7fd9b4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:35.739 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.729+0000 7fd9adffb700 1 -- 172.21.15.52:0/151870670 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4004590 con 0x7fd9b80b88d0 2023-06-23T18:44:35.740 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.729+0000 7fd9adffb700 1 -- 172.21.15.52:0/151870670 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b401f070 con 0x7fd9b80b88d0 2023-06-23T18:44:35.740 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.729+0000 7fd9adffb700 1 -- 172.21.15.52:0/151870670 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b40038e0 con 0x7fd9b80b88d0 2023-06-23T18:44:35.740 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.729+0000 7fd9bf434700 1 -- 172.21.15.52:0/151870670 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b40094a0 con 0x7fd9b80b88d0 2023-06-23T18:44:35.740 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.729+0000 7fd9bf434700 1 -- 172.21.15.52:0/151870670 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b8148b10 con 0x7fd9b80b88d0 2023-06-23T18:44:35.740 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.729+0000 7fd9adffb700 1 -- 172.21.15.52:0/151870670 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd9b4003d40 con 0x7fd9b80b88d0 2023-06-23T18:44:35.740 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.729+0000 7fd9adffb700 1 -- 172.21.15.52:0/151870670 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fd9b4021070 con 0x7fd9b80b88d0 2023-06-23T18:44:35.740 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.730+0000 7fd9bf434700 1 -- 172.21.15.52:0/151870670 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b8148e80 con 0x7fd9b80b88d0 2023-06-23T18:44:35.741 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:35.732+0000 7fc6a58b3200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-23T18:44:35.741 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.733+0000 7fd9adffb700 1 -- 172.21.15.52:0/151870670 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fd9b402b020 con 0x7fd9b80b88d0 2023-06-23T18:44:35.771 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-06-23T18:44:35.765+0000 7f44ea8a2200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-23T18:44:35.808 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.802+0000 7fd9bf434700 1 -- 172.21.15.52:0/151870670 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9b8074360 con 0x7fd9b80b88d0 2023-06-23T18:44:35.808 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.803+0000 7fd9adffb700 1 -- 172.21.15.52:0/151870670 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fd9b4015020 con 0x7fd9b80b88d0 2023-06-23T18:44:35.809 INFO:teuthology.misc.health.smithi052.stdout: 2023-06-23T18:44:35.809 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":10,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","created":"2023-06-23T18:44:31.918434+0000","modified":"2023-06-23T18:44:34.510501+0000","last_up_change":"0.000000","last_in_change":"2023-06-23T18:44:34.510501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c371fb28-1b15-4e43-8d5a-43e402920ed9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4a142f04-33eb-47ec-9cc5-b08b44d82658","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d7bb089d-4c55-4370-ba59-7fe88c39512a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"4bcdcdc3-6a8f-468e-877e-57f76079ac3a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"cac63000-ae94-4b08-93e6-a99119640b63","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"45c53102-18a6-4fd7-9c25-8ea5e1ef6851","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"abee09d1-8eba-484f-a25c-871c1fe2e843","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5acf9e2e-00dd-4f9b-a7d9-3d820f695de3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:44:35.810 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.803+0000 7fd9bf434700 1 -- 172.21.15.52:0/151870670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b80b88d0 msgr2=0x7fd9b80bc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:35.810 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.804+0000 7fd9bf434700 1 --2- 172.21.15.52:0/151870670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b80b88d0 0x7fd9b80bc160 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4009840 tx=0x7fd9b4004750 comp rx=0 tx=0).stop 2023-06-23T18:44:35.810 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.804+0000 7fd9bf434700 1 -- 172.21.15.52:0/151870670 shutdown_connections 2023-06-23T18:44:35.810 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.804+0000 7fd9bf434700 1 --2- 172.21.15.52:0/151870670 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd9b8145c70 0x7fd9b81e1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:35.810 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.804+0000 7fd9bf434700 1 --2- 172.21.15.52:0/151870670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9b80b88d0 0x7fd9b80bc160 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:35.811 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.804+0000 7fd9bf434700 1 --2- 172.21.15.52:0/151870670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9b80ba7a0 0x7fd9b81e0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:35.811 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.804+0000 7fd9bf434700 1 -- 172.21.15.52:0/151870670 >> 172.21.15.52:0/151870670 conn(0x7fd9b80bdff0 msgr2=0x7fd9b806b870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:35.811 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.804+0000 7fd9bf434700 1 -- 172.21.15.52:0/151870670 shutdown_connections 2023-06-23T18:44:35.811 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:35.804+0000 7fd9bf434700 1 -- 172.21.15.52:0/151870670 wait complete. 2023-06-23T18:44:35.812 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:35.804+0000 7fc6a58b3200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-23T18:44:35.820 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-06-23T18:44:35.846 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-06-23T18:44:35.840+0000 7f44ea8a2200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-23T18:44:36.327 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:36.322+0000 7fc6a58b3200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-23T18:44:36.388 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-06-23T18:44:36.382+0000 7f44ea8a2200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-23T18:44:36.642 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:36.638+0000 7fc6a58b3200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-23T18:44:36.716 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-06-23T18:44:36.711+0000 7f44ea8a2200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-23T18:44:36.786 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:36.781+0000 7fc6a58b3200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-23T18:44:36.865 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-06-23T18:44:36.860+0000 7f44ea8a2200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-23T18:44:37.146 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:37.141+0000 7fc6a58b3200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-23T18:44:37.241 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-06-23T18:44:37.237+0000 7f44ea8a2200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-23T18:44:37.291 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:37.287+0000 7fc6a58b3200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-23T18:44:37.394 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-06-23T18:44:37.389+0000 7f44ea8a2200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-23T18:44:37.443 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:37.438+0000 7fc6a58b3200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-23T18:44:37.551 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-06-23T18:44:37.546+0000 7f44ea8a2200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-23T18:44:37.759 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:37.754+0000 7fc6a58b3200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-23T18:44:37.886 INFO:tasks.ceph.mgr.y.smithi052.stderr:2023-06-23T18:44:37.881+0000 7f44ea8a2200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-23T18:44:38.669 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-06-23T18:44:38.664+0000 7f91bc896640 -1 osd.2 0 log_to_monitors true 2023-06-23T18:44:38.674 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-06-23T18:44:38.669+0000 7fca39f6a640 -1 osd.1 0 log_to_monitors true 2023-06-23T18:44:38.680 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-23T18:44:38.675+0000 7f6fd1dee640 -1 osd.6 0 log_to_monitors true 2023-06-23T18:44:38.695 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-23T18:44:38.691+0000 7f49e69da640 -1 osd.4 0 log_to_monitors true 2023-06-23T18:44:38.701 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-06-23T18:44:38.696+0000 7f0f2f70f640 -1 osd.3 0 log_to_monitors true 2023-06-23T18:44:38.701 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-06-23T18:44:38.696+0000 7fc240fe0640 -1 osd.0 0 log_to_monitors true 2023-06-23T18:44:38.702 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-23T18:44:38.698+0000 7f23e2e0e640 -1 osd.5 0 log_to_monitors true 2023-06-23T18:44:38.703 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-23T18:44:38.699+0000 7fd08f93b640 -1 osd.7 0 log_to_monitors true 2023-06-23T18:44:38.784 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:38.779+0000 7fc666cce700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-06-23T18:44:38.784 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-23T18:44:38.779+0000 7fc666cce700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-06-23T18:44:41.142 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-06-23T18:44:41.137+0000 7f91b0436700 -1 osd.2 0 waiting for initial osdmap 2023-06-23T18:44:41.152 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-06-23T18:44:41.148+0000 7f91a8811700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T18:44:41.164 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-06-23T18:44:41.159+0000 7fca2db0a700 -1 osd.1 0 waiting for initial osdmap 2023-06-23T18:44:41.177 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-06-23T18:44:41.173+0000 7fca25ee5700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T18:44:41.191 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-06-23T18:44:41.187+0000 7fc234b80700 -1 osd.0 0 waiting for initial osdmap 2023-06-23T18:44:41.201 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-06-23T18:44:41.197+0000 7fc22cf5b700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T18:44:41.213 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-06-23T18:44:41.209+0000 7f0f232af700 -1 osd.3 0 waiting for initial osdmap 2023-06-23T18:44:41.239 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-06-23T18:44:41.235+0000 7f0f1b68a700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T18:44:41.874 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-23T18:44:41.869+0000 7f6fc598e700 -1 osd.6 0 waiting for initial osdmap 2023-06-23T18:44:41.874 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-23T18:44:41.870+0000 7f49da57a700 -1 osd.4 0 waiting for initial osdmap 2023-06-23T18:44:41.881 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-23T18:44:41.876+0000 7fd0834db700 -1 osd.7 0 waiting for initial osdmap 2023-06-23T18:44:41.885 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-23T18:44:41.881+0000 7f23d69ae700 -1 osd.5 0 waiting for initial osdmap 2023-06-23T18:44:41.888 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-23T18:44:41.884+0000 7f49d2955700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T18:44:41.895 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-23T18:44:41.891+0000 7f6fbdd69700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T18:44:41.897 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-23T18:44:41.893+0000 7fd07b8b6700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T18:44:41.902 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-23T18:44:41.898+0000 7f23ced89700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T18:44:42.628 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-23T18:44:42.759 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.754+0000 7feefbda1700 1 Processor -- start 2023-06-23T18:44:42.759 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.754+0000 7feefbda1700 1 -- start start 2023-06-23T18:44:42.762 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.755+0000 7feefbda1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feef40bdab0 0x7feef40a5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:42.763 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.755+0000 7feefbda1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feef40bc140 0x7feef40b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:42.763 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.755+0000 7feefbda1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef40b5db0 con 0x7feef4144490 2023-06-23T18:44:42.763 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.755+0000 7feefbda1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef40b6d40 con 0x7feef40bc140 2023-06-23T18:44:42.763 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.755+0000 7feefbda1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef40bc880 con 0x7feef40bdab0 2023-06-23T18:44:42.763 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.755+0000 7feefa33e700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7feef4144490 0x7feef40bb010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56062/0 (socket says 172.21.15.52:56062) 2023-06-23T18:44:42.763 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.755+0000 7feefa33e700 1 -- 172.21.15.52:0/615552001 learned_addr learned my addr 172.21.15.52:0/615552001 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:42.764 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.755+0000 7feef9b3d700 1 --2- 172.21.15.52:0/615552001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feef40bdab0 0x7feef40a5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:42.764 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.755+0000 7feef933c700 1 --2- 172.21.15.52:0/615552001 >> v2:172.21.15.89:3300/0 conn(0x7feef40bc140 0x7feef40b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:42.764 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feef8b3b700 1 -- 172.21.15.52:0/615552001 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028883804 0 0) 0x7feef40b5db0 con 0x7feef4144490 2023-06-23T18:44:42.764 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feef8b3b700 1 -- 172.21.15.52:0/615552001 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feee00035b0 con 0x7feef4144490 2023-06-23T18:44:42.764 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feef8b3b700 1 -- 172.21.15.52:0/615552001 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 669882842 0 0) 0x7feee00035b0 con 0x7feef4144490 2023-06-23T18:44:42.764 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feef8b3b700 1 -- 172.21.15.52:0/615552001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feef40bdab0 msgr2=0x7feef40a5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:42.765 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feef8b3b700 1 --2- 172.21.15.52:0/615552001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feef40bdab0 0x7feef40a5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:42.765 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feef8b3b700 1 -- 172.21.15.52:0/615552001 >> v2:172.21.15.89:3300/0 conn(0x7feef40bc140 msgr2=0x7feef40b62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:42.765 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feef8b3b700 1 --2- 172.21.15.52:0/615552001 >> v2:172.21.15.89:3300/0 conn(0x7feef40bc140 0x7feef40b62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:42.765 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feef8b3b700 1 -- 172.21.15.52:0/615552001 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef40b56f0 con 0x7feef4144490 2023-06-23T18:44:42.765 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feef8b3b700 1 -- 172.21.15.52:0/615552001 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7feeec0019f0 con 0x7feef4144490 2023-06-23T18:44:42.765 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feef9b3d700 1 --2- 172.21.15.52:0/615552001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feef40bdab0 0x7feef40a5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:42.765 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feef933c700 1 --2- 172.21.15.52:0/615552001 >> v2:172.21.15.89:3300/0 conn(0x7feef40bc140 0x7feef40b62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:42.766 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feef8b3b700 1 -- 172.21.15.52:0/615552001 >> v1:172.21.15.52:6789/0 conn(0x7feef4144490 legacy=0x7feef40bb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:42.766 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feef8b3b700 1 --2- 172.21.15.52:0/615552001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feef40bdab0 0x7feee0003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:42.766 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feef8b3b700 1 --2- 172.21.15.52:0/615552001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feee0003f90 0x7feee0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:42.766 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feef8b3b700 1 --2- 172.21.15.52:0/615552001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feee0004d90 0x7feee0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:42.766 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feef8b3b700 1 -- 172.21.15.52:0/615552001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef40b6d40 con 0x7feee0003f90 2023-06-23T18:44:42.766 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feef8b3b700 1 -- 172.21.15.52:0/615552001 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee000ba10 con 0x7feee0004d90 2023-06-23T18:44:42.766 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feef8b3b700 1 -- 172.21.15.52:0/615552001 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee000bb50 con 0x7feef40bdab0 2023-06-23T18:44:42.767 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feef933c700 1 --2- 172.21.15.52:0/615552001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feee0003f90 0x7feee0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:42.767 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feef9b3d700 1 --2- 172.21.15.52:0/615552001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feef40bdab0 0x7feee0003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:42.767 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feefa33e700 1 --2- 172.21.15.52:0/615552001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feee0004d90 0x7feee0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:42.767 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feef933c700 1 -- 172.21.15.52:0/615552001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feef40bdab0 msgr2=0x7feee0003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:42.767 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feef933c700 1 --2- 172.21.15.52:0/615552001 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feef40bdab0 0x7feee0003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:42.767 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feef933c700 1 -- 172.21.15.52:0/615552001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feee0004d90 msgr2=0x7feee0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:42.767 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feef933c700 1 --2- 172.21.15.52:0/615552001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feee0004d90 0x7feee0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:42.768 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feef933c700 1 -- 172.21.15.52:0/615552001 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee4009430 con 0x7feee0003f90 2023-06-23T18:44:42.768 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.756+0000 7feefa33e700 1 --2- 172.21.15.52:0/615552001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feee0004d90 0x7feee0005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:44:42.768 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.757+0000 7feef933c700 1 --2- 172.21.15.52:0/615552001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feee0003f90 0x7feee0004850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feef0009d30 tx=0x7feee0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5978b458a16a0a4 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:42.768 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.757+0000 7feef8b3b700 1 -- 172.21.15.52:0/615552001 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0009e80 con 0x7feee0003f90 2023-06-23T18:44:42.768 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.757+0000 7feef8b3b700 1 -- 172.21.15.52:0/615552001 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef000e9a0 con 0x7feee0003f90 2023-06-23T18:44:42.768 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.757+0000 7feef8b3b700 1 -- 172.21.15.52:0/615552001 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef000ed30 con 0x7feee0003f90 2023-06-23T18:44:42.768 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.757+0000 7feefbda1700 1 -- 172.21.15.52:0/615552001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feee0003f90 msgr2=0x7feee0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:42.768 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.757+0000 7feefbda1700 1 --2- 172.21.15.52:0/615552001 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feee0003f90 0x7feee0004850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feef0009d30 tx=0x7feee0005880 comp rx=0 tx=0).stop 2023-06-23T18:44:42.769 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.757+0000 7feefa33e700 1 -- 172.21.15.52:0/615552001 reap_dead start 2023-06-23T18:44:42.769 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.757+0000 7feefbda1700 1 -- 172.21.15.52:0/615552001 shutdown_connections 2023-06-23T18:44:42.769 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.757+0000 7feefbda1700 1 -- 172.21.15.52:0/615552001 >> 172.21.15.52:0/615552001 conn(0x7feef40c1320 msgr2=0x7feef40bd130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:42.769 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.757+0000 7feefbda1700 1 -- 172.21.15.52:0/615552001 shutdown_connections 2023-06-23T18:44:42.769 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.757+0000 7feefbda1700 1 -- 172.21.15.52:0/615552001 wait complete. 2023-06-23T18:44:42.771 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.759+0000 7feefbda1700 1 Processor -- start 2023-06-23T18:44:42.771 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.759+0000 7feefbda1700 1 -- start start 2023-06-23T18:44:42.772 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.759+0000 7feefbda1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feee0003f90 0x7feef4149110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:42.772 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.759+0000 7feefbda1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feef414d8a0 0x7feef414a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:42.772 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.759+0000 7feefbda1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feef413f9c0 0x7feef413fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:42.772 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.759+0000 7feefbda1700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef4140380 con 0x7feef413f9c0 2023-06-23T18:44:42.772 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.759+0000 7feefbda1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef414dd10 con 0x7feee0003f90 2023-06-23T18:44:42.772 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.759+0000 7feefbda1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef414a720 con 0x7feef414d8a0 2023-06-23T18:44:42.772 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.759+0000 7feefa33e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feef413f9c0 0x7feef413fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:42.773 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.759+0000 7feefa33e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feef413f9c0 0x7feef413fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51732/0 (socket says 172.21.15.52:51732) 2023-06-23T18:44:42.773 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.759+0000 7feefa33e700 1 -- 172.21.15.52:0/2717373862 learned_addr learned my addr 172.21.15.52:0/2717373862 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:42.773 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.759+0000 7feef933c700 1 --2- 172.21.15.52:0/2717373862 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feef414d8a0 0x7feef414a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:42.773 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.759+0000 7feef9b3d700 1 --2- 172.21.15.52:0/2717373862 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feee0003f90 0x7feef4149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:42.773 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.760+0000 7feefa33e700 1 -- 172.21.15.52:0/2717373862 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feef414d8a0 msgr2=0x7feef414a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:42.773 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.760+0000 7feefa33e700 1 --2- 172.21.15.52:0/2717373862 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feef414d8a0 0x7feef414a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:42.773 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.760+0000 7feefa33e700 1 -- 172.21.15.52:0/2717373862 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feee0003f90 msgr2=0x7feef4149110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:42.774 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.760+0000 7feefa33e700 1 --2- 172.21.15.52:0/2717373862 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feee0003f90 0x7feef4149110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:42.774 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.760+0000 7feefa33e700 1 -- 172.21.15.52:0/2717373862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef4147bf0 con 0x7feef413f9c0 2023-06-23T18:44:42.774 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.760+0000 7feefa33e700 1 --2- 172.21.15.52:0/2717373862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feef413f9c0 0x7feef413fe40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feef4073ed0 tx=0x7feeec007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:42.774 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.760+0000 7feeea7fc700 1 -- 172.21.15.52:0/2717373862 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec00eb50 con 0x7feef413f9c0 2023-06-23T18:44:42.774 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.760+0000 7feeea7fc700 1 -- 172.21.15.52:0/2717373862 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeec00ecb0 con 0x7feef413f9c0 2023-06-23T18:44:42.774 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.760+0000 7feefbda1700 1 -- 172.21.15.52:0/2717373862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef4147ed0 con 0x7feef413f9c0 2023-06-23T18:44:42.774 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.760+0000 7feeea7fc700 1 -- 172.21.15.52:0/2717373862 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeec013620 con 0x7feef413f9c0 2023-06-23T18:44:42.775 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.760+0000 7feefbda1700 1 -- 172.21.15.52:0/2717373862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef4148490 con 0x7feef413f9c0 2023-06-23T18:44:42.775 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.761+0000 7feefbda1700 1 -- 172.21.15.52:0/2717373862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef4148650 con 0x7feef413f9c0 2023-06-23T18:44:42.775 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.762+0000 7feeea7fc700 1 -- 172.21.15.52:0/2717373862 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7feeec013780 con 0x7feef413f9c0 2023-06-23T18:44:42.775 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.762+0000 7feeea7fc700 1 --2- 172.21.15.52:0/2717373862 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7feed806ac50 0x7feed806d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:42.775 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.762+0000 7feeea7fc700 1 -- 172.21.15.52:0/2717373862 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7feeec0891c0 con 0x7feef413f9c0 2023-06-23T18:44:42.775 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.762+0000 7feef9b3d700 1 --2- 172.21.15.52:0/2717373862 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7feed806ac50 0x7feed806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:42.775 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.763+0000 7feef9b3d700 1 --2- 172.21.15.52:0/2717373862 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7feed806ac50 0x7feed806d100 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7feee4009ce0 tx=0x7feee40091c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:42.776 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.767+0000 7feeea7fc700 1 -- 172.21.15.52:0/2717373862 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feeec054a10 con 0x7feef413f9c0 2023-06-23T18:44:42.972 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.967+0000 7feefbda1700 1 -- 172.21.15.52:0/2717373862 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feef4148650 con 0x7feef413f9c0 2023-06-23T18:44:42.972 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.967+0000 7feeea7fc700 1 -- 172.21.15.52:0/2717373862 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10860 (secure 0 0 0) 0x7feeec058030 con 0x7feef413f9c0 2023-06-23T18:44:42.973 INFO:teuthology.misc.health.smithi052.stdout: 2023-06-23T18:44:42.973 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":13,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","created":"2023-06-23T18:44:31.918434+0000","modified":"2023-06-23T18:44:42.169624+0000","last_up_change":"2023-06-23T18:44:42.169624+0000","last_in_change":"2023-06-23T18:44:34.510501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c371fb28-1b15-4e43-8d5a-43e402920ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6812","nonce":1066999520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6815","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6818","nonce":1066999520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6829","nonce":1066999520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6823","nonce":1066999520}]},"public_addr":"172.21.15.52:6812/1066999520","cluster_addr":"172.21.15.52:6818/1066999520","heartbeat_back_addr":"172.21.15.52:6829/1066999520","heartbeat_front_addr":"172.21.15.52:6823/1066999520","state":["exists","up"]},{"osd":1,"uuid":"4a142f04-33eb-47ec-9cc5-b08b44d82658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6813","nonce":2360219751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6819","nonce":2360219751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6830","nonce":2360219751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6825","nonce":2360219751}]},"public_addr":"172.21.15.52:6813/2360219751","cluster_addr":"172.21.15.52:6819/2360219751","heartbeat_back_addr":"172.21.15.52:6830/2360219751","heartbeat_front_addr":"172.21.15.52:6825/2360219751","state":["exists","up"]},{"osd":2,"uuid":"d7bb089d-4c55-4370-ba59-7fe88c39512a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6801","nonce":835073005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6803","nonce":835073005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6807","nonce":835073005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6805","nonce":835073005}]},"public_addr":"172.21.15.52:6801/835073005","cluster_addr":"172.21.15.52:6803/835073005","heartbeat_back_addr":"172.21.15.52:6807/835073005","heartbeat_front_addr":"172.21.15.52:6805/835073005","state":["exists","up"]},{"osd":3,"uuid":"4bcdcdc3-6a8f-468e-877e-57f76079ac3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6811","nonce":2852700864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6817","nonce":2852700864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6831","nonce":2852700864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6824","nonce":2852700864}]},"public_addr":"172.21.15.52:6811/2852700864","cluster_addr":"172.21.15.52:6817/2852700864","heartbeat_back_addr":"172.21.15.52:6831/2852700864","heartbeat_front_addr":"172.21.15.52:6824/2852700864","state":["exists","up"]},{"osd":4,"uuid":"cac63000-ae94-4b08-93e6-a99119640b63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6809","nonce":2538664679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6811","nonce":2538664679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6815","nonce":2538664679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6813","nonce":2538664679}]},"public_addr":"172.21.15.89:6809/2538664679","cluster_addr":"172.21.15.89:6811/2538664679","heartbeat_back_addr":"172.21.15.89:6815/2538664679","heartbeat_front_addr":"172.21.15.89:6813/2538664679","state":["exists","up"]},{"osd":5,"uuid":"45c53102-18a6-4fd7-9c25-8ea5e1ef6851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6801","nonce":1683710352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6803","nonce":1683710352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6807","nonce":1683710352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6805","nonce":1683710352}]},"public_addr":"172.21.15.89:6801/1683710352","cluster_addr":"172.21.15.89:6803/1683710352","heartbeat_back_addr":"172.21.15.89:6807/1683710352","heartbeat_front_addr":"172.21.15.89:6805/1683710352","state":["exists","up"]},{"osd":6,"uuid":"abee09d1-8eba-484f-a25c-871c1fe2e843","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6817","nonce":3890899288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6819","nonce":3890899288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6823","nonce":3890899288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6821","nonce":3890899288}]},"public_addr":"172.21.15.89:6817/3890899288","cluster_addr":"172.21.15.89:6819/3890899288","heartbeat_back_addr":"172.21.15.89:6823/3890899288","heartbeat_front_addr":"172.21.15.89:6821/3890899288","state":["exists","up"]},{"osd":7,"uuid":"5acf9e2e-00dd-4f9b-a7d9-3d820f695de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6825","nonce":2989085420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6827","nonce":2989085420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6831","nonce":2989085420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6829","nonce":2989085420}]},"public_addr":"172.21.15.89:6825/2989085420","cluster_addr":"172.21.15.89:6827/2989085420","heartbeat_back_addr":"172.21.15.89:6831/2989085420","heartbeat_front_addr":"172.21.15.89:6829/2989085420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:44:42.975 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.969+0000 7feefbda1700 1 -- 172.21.15.52:0/2717373862 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7feed806ac50 msgr2=0x7feed806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:42.976 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.969+0000 7feefbda1700 1 --2- 172.21.15.52:0/2717373862 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7feed806ac50 0x7feed806d100 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7feee4009ce0 tx=0x7feee40091c0 comp rx=0 tx=0).stop 2023-06-23T18:44:42.976 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.969+0000 7feefbda1700 1 -- 172.21.15.52:0/2717373862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feef413f9c0 msgr2=0x7feef413fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:42.976 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.969+0000 7feefbda1700 1 --2- 172.21.15.52:0/2717373862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feef413f9c0 0x7feef413fe40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feef4073ed0 tx=0x7feeec007c90 comp rx=0 tx=0).stop 2023-06-23T18:44:42.976 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.969+0000 7feefbda1700 1 -- 172.21.15.52:0/2717373862 shutdown_connections 2023-06-23T18:44:42.977 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.969+0000 7feefbda1700 1 --2- 172.21.15.52:0/2717373862 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7feed806ac50 0x7feed806d100 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:42.977 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.969+0000 7feefbda1700 1 --2- 172.21.15.52:0/2717373862 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feef413f9c0 0x7feef413fe40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:42.977 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.969+0000 7feefbda1700 1 --2- 172.21.15.52:0/2717373862 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feee0003f90 0x7feef4149110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:42.977 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.969+0000 7feefbda1700 1 --2- 172.21.15.52:0/2717373862 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feef414d8a0 0x7feef414a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:42.978 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.969+0000 7feefbda1700 1 -- 172.21.15.52:0/2717373862 >> 172.21.15.52:0/2717373862 conn(0x7feef40c1320 msgr2=0x7feef40bd130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:42.978 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.969+0000 7feefbda1700 1 -- 172.21.15.52:0/2717373862 shutdown_connections 2023-06-23T18:44:42.978 INFO:teuthology.misc.health.smithi052.stderr:2023-06-23T18:44:42.969+0000 7feefbda1700 1 -- 172.21.15.52:0/2717373862 wait complete. 2023-06-23T18:44:42.985 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-06-23T18:44:42.986 INFO:tasks.ceph:Creating RBD pool 2023-06-23T18:44:42.986 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd pool create rbd 8 2023-06-23T18:44:43.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.106+0000 7fc42e59d700 1 Processor -- start 2023-06-23T18:44:43.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.106+0000 7fc42e59d700 1 -- start start 2023-06-23T18:44:43.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.107+0000 7fc42e59d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc4280ba680 0x7fc428144250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:43.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.107+0000 7fc42e59d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4280bc370 con 0x7fc428144790 2023-06-23T18:44:43.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.107+0000 7fc42e59d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc428144bd0 con 0x7fc4280c0fc0 2023-06-23T18:44:43.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.107+0000 7fc42e59d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4280bc5c0 con 0x7fc4280ba680 2023-06-23T18:44:43.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.107+0000 7fc42cb3a700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc428144790 0x7fc428154e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56068/0 (socket says 172.21.15.52:56068) 2023-06-23T18:44:43.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.107+0000 7fc42cb3a700 1 -- 172.21.15.52:0/2056519510 learned_addr learned my addr 172.21.15.52:0/2056519510 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:43.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.107+0000 7fc4277fe700 1 --2- 172.21.15.52:0/2056519510 >> v2:172.21.15.89:3300/0 conn(0x7fc4280ba680 0x7fc428144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:43.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.107+0000 7fc426ffd700 1 -- 172.21.15.52:0/2056519510 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1750683764 0 0) 0x7fc4280bc370 con 0x7fc428144790 2023-06-23T18:44:43.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.107+0000 7fc426ffd700 1 -- 172.21.15.52:0/2056519510 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4140035b0 con 0x7fc428144790 2023-06-23T18:44:43.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.107+0000 7fc426ffd700 1 -- 172.21.15.52:0/2056519510 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2467483975 0 0) 0x7fc428144bd0 con 0x7fc4280c0fc0 2023-06-23T18:44:43.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.107+0000 7fc426ffd700 1 -- 172.21.15.52:0/2056519510 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4280bc370 con 0x7fc4280c0fc0 2023-06-23T18:44:43.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.107+0000 7fc4277fe700 1 -- 172.21.15.52:0/2056519510 >> v1:172.21.15.89:6789/0 conn(0x7fc4280c0fc0 legacy=0x7fc4280b9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:43.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.107+0000 7fc4277fe700 1 -- 172.21.15.52:0/2056519510 >> v1:172.21.15.52:6789/0 conn(0x7fc428144790 legacy=0x7fc428154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:43.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.107+0000 7fc4277fe700 1 -- 172.21.15.52:0/2056519510 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4280b8030 con 0x7fc4280ba680 2023-06-23T18:44:43.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.108+0000 7fc4277fe700 1 --2- 172.21.15.52:0/2056519510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4280ba680 0x7fc428144250 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc418009840 tx=0x7fc418009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec6f4848ca2bc31d server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:43.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.108+0000 7fc426ffd700 1 -- 172.21.15.52:0/2056519510 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc418011830 con 0x7fc4280ba680 2023-06-23T18:44:43.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.108+0000 7fc426ffd700 1 -- 172.21.15.52:0/2056519510 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc418011990 con 0x7fc4280ba680 2023-06-23T18:44:43.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.108+0000 7fc426ffd700 1 -- 172.21.15.52:0/2056519510 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc418011d20 con 0x7fc4280ba680 2023-06-23T18:44:43.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.108+0000 7fc42e59d700 1 -- 172.21.15.52:0/2056519510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4280ba680 msgr2=0x7fc428144250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:43.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.108+0000 7fc42e59d700 1 --2- 172.21.15.52:0/2056519510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4280ba680 0x7fc428144250 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc418009840 tx=0x7fc418009b50 comp rx=0 tx=0).stop 2023-06-23T18:44:43.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.108+0000 7fc42e59d700 1 -- 172.21.15.52:0/2056519510 shutdown_connections 2023-06-23T18:44:43.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.108+0000 7fc42e59d700 1 --2- 172.21.15.52:0/2056519510 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4280ba680 0x7fc428144250 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:43.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.108+0000 7fc42e59d700 1 -- 172.21.15.52:0/2056519510 >> 172.21.15.52:0/2056519510 conn(0x7fc42806c7f0 msgr2=0x7fc4280c0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:43.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.108+0000 7fc42e59d700 1 -- 172.21.15.52:0/2056519510 shutdown_connections 2023-06-23T18:44:43.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.108+0000 7fc42e59d700 1 -- 172.21.15.52:0/2056519510 wait complete. 2023-06-23T18:44:43.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.109+0000 7fc42e59d700 1 Processor -- start 2023-06-23T18:44:43.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.110+0000 7fc42e59d700 1 -- start start 2023-06-23T18:44:43.124 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.110+0000 7fc42e59d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4280ba680 0x7fc42813ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:43.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.110+0000 7fc42e59d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4280c0fc0 0x7fc4281e3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:43.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.110+0000 7fc42e59d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc428144790 0x7fc4281e3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:43.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.110+0000 7fc42e59d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4281404c0 con 0x7fc4280ba680 2023-06-23T18:44:43.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.110+0000 7fc42e59d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc428138f00 con 0x7fc4280c0fc0 2023-06-23T18:44:43.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.110+0000 7fc42e59d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc428139a50 con 0x7fc428144790 2023-06-23T18:44:43.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.110+0000 7fc427fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4280ba680 0x7fc42813ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:43.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.110+0000 7fc427fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4280ba680 0x7fc42813ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51736/0 (socket says 172.21.15.52:51736) 2023-06-23T18:44:43.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.110+0000 7fc427fff700 1 -- 172.21.15.52:0/854416392 learned_addr learned my addr 172.21.15.52:0/854416392 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:43.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.111+0000 7fc4277fe700 1 --2- 172.21.15.52:0/854416392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4280c0fc0 0x7fc4281e3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:43.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.111+0000 7fc42cb3a700 1 --2- 172.21.15.52:0/854416392 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc428144790 0x7fc4281e3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:43.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.111+0000 7fc427fff700 1 -- 172.21.15.52:0/854416392 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc428144790 msgr2=0x7fc4281e3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:43.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.111+0000 7fc427fff700 1 --2- 172.21.15.52:0/854416392 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc428144790 0x7fc4281e3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:43.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.111+0000 7fc427fff700 1 -- 172.21.15.52:0/854416392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4280c0fc0 msgr2=0x7fc4281e3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:43.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.111+0000 7fc427fff700 1 --2- 172.21.15.52:0/854416392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4280c0fc0 0x7fc4281e3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:43.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.111+0000 7fc427fff700 1 -- 172.21.15.52:0/854416392 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4180094a0 con 0x7fc4280ba680 2023-06-23T18:44:43.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.111+0000 7fc427fff700 1 --2- 172.21.15.52:0/854416392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4280ba680 0x7fc42813ff80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc41000c550 tx=0x7fc41000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:43.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.111+0000 7fc424ff9700 1 -- 172.21.15.52:0/854416392 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4100052d0 con 0x7fc4280ba680 2023-06-23T18:44:43.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.111+0000 7fc424ff9700 1 -- 172.21.15.52:0/854416392 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc410005430 con 0x7fc4280ba680 2023-06-23T18:44:43.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.111+0000 7fc42e59d700 1 -- 172.21.15.52:0/854416392 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc428138560 con 0x7fc4280ba680 2023-06-23T18:44:43.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.111+0000 7fc424ff9700 1 -- 172.21.15.52:0/854416392 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4100038c0 con 0x7fc4280ba680 2023-06-23T18:44:43.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.111+0000 7fc42e59d700 1 -- 172.21.15.52:0/854416392 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc428138b20 con 0x7fc4280ba680 2023-06-23T18:44:43.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.112+0000 7fc42e59d700 1 -- 172.21.15.52:0/854416392 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4281e3d80 con 0x7fc4280ba680 2023-06-23T18:44:43.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.113+0000 7fc424ff9700 1 -- 172.21.15.52:0/854416392 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fc410003a20 con 0x7fc4280ba680 2023-06-23T18:44:43.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.113+0000 7fc424ff9700 1 --2- 172.21.15.52:0/854416392 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc40806ac50 0x7fc40806d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:43.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.113+0000 7fc424ff9700 1 -- 172.21.15.52:0/854416392 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fc4100880f0 con 0x7fc4280ba680 2023-06-23T18:44:43.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.113+0000 7fc4277fe700 1 --2- 172.21.15.52:0/854416392 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc40806ac50 0x7fc40806d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:43.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.114+0000 7fc4277fe700 1 --2- 172.21.15.52:0/854416392 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc40806ac50 0x7fc40806d100 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc418009fd0 tx=0x7fc41801c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:43.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.118+0000 7fc424ff9700 1 -- 172.21.15.52:0/854416392 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc410053940 con 0x7fc4280ba680 2023-06-23T18:44:43.320 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:43.316+0000 7fc42e59d700 1 -- 172.21.15.52:0/854416392 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fc4281e3020 con 0x7fc4280ba680 2023-06-23T18:44:44.185 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.181+0000 7fc424ff9700 1 -- 172.21.15.52:0/854416392 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7fc4281e3020 con 0x7fc4280ba680 2023-06-23T18:44:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.184+0000 7fc42e59d700 1 -- 172.21.15.52:0/854416392 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc40806ac50 msgr2=0x7fc40806d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.184+0000 7fc42e59d700 1 --2- 172.21.15.52:0/854416392 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc40806ac50 0x7fc40806d100 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc418009fd0 tx=0x7fc41801c040 comp rx=0 tx=0).stop 2023-06-23T18:44:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.184+0000 7fc42e59d700 1 -- 172.21.15.52:0/854416392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4280ba680 msgr2=0x7fc42813ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.184+0000 7fc42e59d700 1 --2- 172.21.15.52:0/854416392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4280ba680 0x7fc42813ff80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc41000c550 tx=0x7fc41000c860 comp rx=0 tx=0).stop 2023-06-23T18:44:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.184+0000 7fc42e59d700 1 -- 172.21.15.52:0/854416392 shutdown_connections 2023-06-23T18:44:44.189 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.184+0000 7fc42e59d700 1 --2- 172.21.15.52:0/854416392 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc40806ac50 0x7fc40806d100 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:44.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.184+0000 7fc42e59d700 1 --2- 172.21.15.52:0/854416392 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc428144790 0x7fc4281e3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:44.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.184+0000 7fc42e59d700 1 --2- 172.21.15.52:0/854416392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4280ba680 0x7fc42813ff80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:44.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.184+0000 7fc42e59d700 1 --2- 172.21.15.52:0/854416392 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4280c0fc0 0x7fc4281e3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:44.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.184+0000 7fc42e59d700 1 -- 172.21.15.52:0/854416392 >> 172.21.15.52:0/854416392 conn(0x7fc42806c7f0 msgr2=0x7fc428140e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:44.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.184+0000 7fc42e59d700 1 -- 172.21.15.52:0/854416392 shutdown_connections 2023-06-23T18:44:44.190 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.184+0000 7fc42e59d700 1 -- 172.21.15.52:0/854416392 wait complete. 2023-06-23T18:44:44.191 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'rbd' created 2023-06-23T18:44:44.204 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-06-23T18:44:44.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.333+0000 7fc2149ea700 1 Processor -- start 2023-06-23T18:44:44.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.333+0000 7fc2149ea700 1 -- start start 2023-06-23T18:44:44.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.334+0000 7fc2149ea700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc210070930 0x7fc21006fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:44.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.334+0000 7fc2149ea700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc2100afe00 0x7fc2100b0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:44.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.334+0000 7fc2149ea700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2100b6fe0 con 0x7fc21006b0e0 2023-06-23T18:44:44.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.334+0000 7fc2149ea700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2100b0740 con 0x7fc210070930 2023-06-23T18:44:44.340 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.334+0000 7fc2149ea700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc210071c00 con 0x7fc2100afe00 2023-06-23T18:44:44.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.334+0000 7fc20dd9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc210070930 0x7fc21006fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:44.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.334+0000 7fc20dd9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc210070930 0x7fc21006fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51744/0 (socket says 172.21.15.52:51744) 2023-06-23T18:44:44.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.334+0000 7fc20e59c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc21006b0e0 0x7fc2100b73c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:56080/0 (socket says 172.21.15.52:56080) 2023-06-23T18:44:44.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.334+0000 7fc20dd9b700 1 -- 172.21.15.52:0/901823898 learned_addr learned my addr 172.21.15.52:0/901823898 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:44.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.335+0000 7fc20ed9d700 1 --2- 172.21.15.52:0/901823898 >> v2:172.21.15.89:3300/0 conn(0x7fc2100afe00 0x7fc2100b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:44.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.335+0000 7fc20dd9b700 1 -- 172.21.15.52:0/901823898 >> v2:172.21.15.89:3300/0 conn(0x7fc2100afe00 msgr2=0x7fc2100b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:44.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.335+0000 7fc20dd9b700 1 --2- 172.21.15.52:0/901823898 >> v2:172.21.15.89:3300/0 conn(0x7fc2100afe00 0x7fc2100b0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:44.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.335+0000 7fc20dd9b700 1 -- 172.21.15.52:0/901823898 >> v1:172.21.15.52:6789/0 conn(0x7fc21006b0e0 legacy=0x7fc2100b73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:44.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.335+0000 7fc20dd9b700 1 -- 172.21.15.52:0/901823898 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2100b6a20 con 0x7fc210070930 2023-06-23T18:44:44.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.335+0000 7fc20d59a700 1 -- 172.21.15.52:0/901823898 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 708602007 0 0) 0x7fc2100b6fe0 con 0x7fc21006b0e0 2023-06-23T18:44:44.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.335+0000 7fc20dd9b700 1 --2- 172.21.15.52:0/901823898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc210070930 0x7fc21006fab0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc2100b89d0 tx=0x7fc200009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5bbf80a9846d052 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:44.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.335+0000 7fc20d59a700 1 -- 172.21.15.52:0/901823898 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20000b870 con 0x7fc210070930 2023-06-23T18:44:44.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.335+0000 7fc20d59a700 1 -- 172.21.15.52:0/901823898 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20000b9d0 con 0x7fc210070930 2023-06-23T18:44:44.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.335+0000 7fc20d59a700 1 -- 172.21.15.52:0/901823898 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20000bd60 con 0x7fc210070930 2023-06-23T18:44:44.344 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.335+0000 7fc2149ea700 1 -- 172.21.15.52:0/901823898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc210070930 msgr2=0x7fc21006fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:44.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.335+0000 7fc2149ea700 1 --2- 172.21.15.52:0/901823898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc210070930 0x7fc21006fab0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc2100b89d0 tx=0x7fc200009bd0 comp rx=0 tx=0).stop 2023-06-23T18:44:44.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.336+0000 7fc2149ea700 1 -- 172.21.15.52:0/901823898 shutdown_connections 2023-06-23T18:44:44.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.336+0000 7fc2149ea700 1 --2- 172.21.15.52:0/901823898 >> v2:172.21.15.89:3300/0 conn(0x7fc2100afe00 0x7fc2100b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:44.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.336+0000 7fc2149ea700 1 --2- 172.21.15.52:0/901823898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc210070930 0x7fc21006fab0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:44.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.336+0000 7fc2149ea700 1 -- 172.21.15.52:0/901823898 >> 172.21.15.52:0/901823898 conn(0x7fc2100b95c0 msgr2=0x7fc2100b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:44.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.336+0000 7fc2149ea700 1 -- 172.21.15.52:0/901823898 shutdown_connections 2023-06-23T18:44:44.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.336+0000 7fc2149ea700 1 -- 172.21.15.52:0/901823898 wait complete. 2023-06-23T18:44:44.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.337+0000 7fc2149ea700 1 Processor -- start 2023-06-23T18:44:44.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.337+0000 7fc2149ea700 1 -- start start 2023-06-23T18:44:44.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.337+0000 7fc2149ea700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc21006b0e0 0x7fc2100acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:44.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.337+0000 7fc2149ea700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc210070930 0x7fc2101e30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:44.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.337+0000 7fc2149ea700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2100afe00 0x7fc2101e3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:44.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.338+0000 7fc2149ea700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc210143f10 con 0x7fc21006b0e0 2023-06-23T18:44:44.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.338+0000 7fc2149ea700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2101e3620 con 0x7fc210070930 2023-06-23T18:44:44.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.338+0000 7fc2149ea700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2100b56e0 con 0x7fc2100afe00 2023-06-23T18:44:44.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.338+0000 7fc20e59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc21006b0e0 0x7fc2100acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:44.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.338+0000 7fc20e59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc21006b0e0 0x7fc2100acc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51748/0 (socket says 172.21.15.52:51748) 2023-06-23T18:44:44.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.338+0000 7fc20e59c700 1 -- 172.21.15.52:0/1502835340 learned_addr learned my addr 172.21.15.52:0/1502835340 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:44.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.338+0000 7fc20dd9b700 1 --2- 172.21.15.52:0/1502835340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc210070930 0x7fc2101e30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:44.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.338+0000 7fc20ed9d700 1 --2- 172.21.15.52:0/1502835340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2100afe00 0x7fc2101e3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:44.347 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.338+0000 7fc20e59c700 1 -- 172.21.15.52:0/1502835340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2100afe00 msgr2=0x7fc2101e3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:44.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.338+0000 7fc20e59c700 1 --2- 172.21.15.52:0/1502835340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2100afe00 0x7fc2101e3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:44.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.338+0000 7fc20e59c700 1 -- 172.21.15.52:0/1502835340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc210070930 msgr2=0x7fc2101e30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:44.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.338+0000 7fc20e59c700 1 --2- 172.21.15.52:0/1502835340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc210070930 0x7fc2101e30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:44.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.338+0000 7fc20e59c700 1 -- 172.21.15.52:0/1502835340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc200009550 con 0x7fc21006b0e0 2023-06-23T18:44:44.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.338+0000 7fc20e59c700 1 --2- 172.21.15.52:0/1502835340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc21006b0e0 0x7fc2100acc80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc20400c750 tx=0x7fc20400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:44.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.338+0000 7fc1feffd700 1 -- 172.21.15.52:0/1502835340 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc204004c80 con 0x7fc21006b0e0 2023-06-23T18:44:44.348 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.338+0000 7fc1feffd700 1 -- 172.21.15.52:0/1502835340 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc204004e00 con 0x7fc21006b0e0 2023-06-23T18:44:44.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.338+0000 7fc2149ea700 1 -- 172.21.15.52:0/1502835340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2100b59e0 con 0x7fc21006b0e0 2023-06-23T18:44:44.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.338+0000 7fc1feffd700 1 -- 172.21.15.52:0/1502835340 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc204007310 con 0x7fc21006b0e0 2023-06-23T18:44:44.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.338+0000 7fc2149ea700 1 -- 172.21.15.52:0/1502835340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2101d2bb0 con 0x7fc21006b0e0 2023-06-23T18:44:44.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.339+0000 7fc2149ea700 1 -- 172.21.15.52:0/1502835340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2100ac9a0 con 0x7fc21006b0e0 2023-06-23T18:44:44.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.340+0000 7fc1feffd700 1 -- 172.21.15.52:0/1502835340 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fc204007470 con 0x7fc21006b0e0 2023-06-23T18:44:44.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.340+0000 7fc1feffd700 1 --2- 172.21.15.52:0/1502835340 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc1f006ac80 0x7fc1f006d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:44.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.340+0000 7fc1feffd700 1 -- 172.21.15.52:0/1502835340 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5188+0+0 (secure 0 0 0) 0x7fc204088bc0 con 0x7fc21006b0e0 2023-06-23T18:44:44.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.340+0000 7fc20dd9b700 1 --2- 172.21.15.52:0/1502835340 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc1f006ac80 0x7fc1f006d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:44.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.341+0000 7fc20dd9b700 1 --2- 172.21.15.52:0/1502835340 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc1f006ac80 0x7fc1f006d130 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc200000c00 tx=0x7fc200008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:44.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.345+0000 7fc1feffd700 1 -- 172.21.15.52:0/1502835340 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc2100ac9a0 con 0x7fc21006b0e0 2023-06-23T18:44:44.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:44.543+0000 7fc2149ea700 1 -- 172.21.15.52:0/1502835340 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc2100ac9a0 con 0x7fc21006b0e0 2023-06-23T18:44:45.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.183+0000 7fc1feffd700 1 -- 172.21.15.52:0/1502835340 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7fc204054140 con 0x7fc21006b0e0 2023-06-23T18:44:45.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.186+0000 7fc2149ea700 1 -- 172.21.15.52:0/1502835340 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc1f006ac80 msgr2=0x7fc1f006d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:45.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.186+0000 7fc2149ea700 1 --2- 172.21.15.52:0/1502835340 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc1f006ac80 0x7fc1f006d130 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc200000c00 tx=0x7fc200008030 comp rx=0 tx=0).stop 2023-06-23T18:44:45.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.186+0000 7fc2149ea700 1 -- 172.21.15.52:0/1502835340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc21006b0e0 msgr2=0x7fc2100acc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:45.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.186+0000 7fc2149ea700 1 --2- 172.21.15.52:0/1502835340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc21006b0e0 0x7fc2100acc80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc20400c750 tx=0x7fc20400ca60 comp rx=0 tx=0).stop 2023-06-23T18:44:45.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.186+0000 7fc2149ea700 1 -- 172.21.15.52:0/1502835340 shutdown_connections 2023-06-23T18:44:45.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.186+0000 7fc2149ea700 1 --2- 172.21.15.52:0/1502835340 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc1f006ac80 0x7fc1f006d130 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:45.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.186+0000 7fc2149ea700 1 --2- 172.21.15.52:0/1502835340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2100afe00 0x7fc2101e3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:45.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.186+0000 7fc2149ea700 1 --2- 172.21.15.52:0/1502835340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc21006b0e0 0x7fc2100acc80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:45.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.186+0000 7fc2149ea700 1 --2- 172.21.15.52:0/1502835340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc210070930 0x7fc2101e30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:45.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.186+0000 7fc2149ea700 1 -- 172.21.15.52:0/1502835340 >> 172.21.15.52:0/1502835340 conn(0x7fc2100b95c0 msgr2=0x7fc2100bc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:45.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.186+0000 7fc2149ea700 1 -- 172.21.15.52:0/1502835340 shutdown_connections 2023-06-23T18:44:45.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.186+0000 7fc2149ea700 1 -- 172.21.15.52:0/1502835340 wait complete. 2023-06-23T18:44:45.193 INFO:teuthology.orchestra.run.smithi052.stderr:enabled application 'rbd' on pool 'rbd' 2023-06-23T18:44:45.207 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-06-23T18:44:45.207 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-23T18:44:45.208 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-23T18:44:45.210 INFO:tasks.ceph.mds.a:Started 2023-06-23T18:44:45.210 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-23T18:44:45.210 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-23T18:44:45.213 INFO:tasks.ceph.mds.c:Started 2023-06-23T18:44:45.213 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-23T18:44:45.214 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-23T18:44:45.217 INFO:tasks.ceph.mds.b:Started 2023-06-23T18:44:45.217 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-06-23T18:44:45.218 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:44:45.304 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2023-06-23T18:44:45.305 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2023-06-23T18:44:45.310 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-06-23T18:44:45.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.360+0000 7f81a0d6b700 1 Processor -- start 2023-06-23T18:44:45.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.360+0000 7f81a0d6b700 1 -- start start 2023-06-23T18:44:45.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.361+0000 7f81a0d6b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f819c14da40 0x7f819c0b8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:45.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.361+0000 7f81a0d6b700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819c0b98a0 con 0x7f819c06c1f0 2023-06-23T18:44:45.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.361+0000 7f81a0d6b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819c14a6a0 con 0x7f819c0b9310 2023-06-23T18:44:45.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.361+0000 7f81a0d6b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f819c14a980 con 0x7f819c14da40 2023-06-23T18:44:45.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.361+0000 7f819a59c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f819c06c1f0 0x7f819c14aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48404/0 (socket says 172.21.15.52:48404) 2023-06-23T18:44:45.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.361+0000 7f819a59c700 1 -- 172.21.15.52:0/348606169 learned_addr learned my addr 172.21.15.52:0/348606169 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:45.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.361+0000 7f8199d9b700 1 --2- 172.21.15.52:0/348606169 >> v2:172.21.15.89:3300/0 conn(0x7f819c14da40 0x7f819c0b8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:45.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.361+0000 7f819959a700 1 -- 172.21.15.52:0/348606169 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2582419680 0 0) 0x7f819c0b98a0 con 0x7f819c06c1f0 2023-06-23T18:44:45.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.361+0000 7f819959a700 1 -- 172.21.15.52:0/348606169 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81840035b0 con 0x7f819c06c1f0 2023-06-23T18:44:45.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.361+0000 7f8199d9b700 1 -- 172.21.15.52:0/348606169 >> v1:172.21.15.89:6789/0 conn(0x7f819c0b9310 legacy=0x7f819c1443e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:45.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.361+0000 7f819959a700 1 -- 172.21.15.52:0/348606169 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695085004 0 0) 0x7f819c14a6a0 con 0x7f819c0b9310 2023-06-23T18:44:45.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.361+0000 7f8199d9b700 1 -- 172.21.15.52:0/348606169 >> v1:172.21.15.52:6789/0 conn(0x7f819c06c1f0 legacy=0x7f819c14aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:45.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.361+0000 7f8199d9b700 1 -- 172.21.15.52:0/348606169 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c144af0 con 0x7f819c14da40 2023-06-23T18:44:45.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.361+0000 7f8199d9b700 1 --2- 172.21.15.52:0/348606169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f819c14da40 0x7f819c0b8870 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8190009840 tx=0x7f8190009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e01e1ff6331d542 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:45.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.362+0000 7f819959a700 1 -- 172.21.15.52:0/348606169 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8190011830 con 0x7f819c14da40 2023-06-23T18:44:45.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.362+0000 7f819959a700 1 -- 172.21.15.52:0/348606169 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8190011990 con 0x7f819c14da40 2023-06-23T18:44:45.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.362+0000 7f819959a700 1 -- 172.21.15.52:0/348606169 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8190011d20 con 0x7f819c14da40 2023-06-23T18:44:45.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.362+0000 7f81a0d6b700 1 -- 172.21.15.52:0/348606169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f819c14da40 msgr2=0x7f819c0b8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:45.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.362+0000 7f81a0d6b700 1 --2- 172.21.15.52:0/348606169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f819c14da40 0x7f819c0b8870 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8190009840 tx=0x7f8190009b50 comp rx=0 tx=0).stop 2023-06-23T18:44:45.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.362+0000 7f81a0d6b700 1 -- 172.21.15.52:0/348606169 shutdown_connections 2023-06-23T18:44:45.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.362+0000 7f81a0d6b700 1 --2- 172.21.15.52:0/348606169 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f819c14da40 0x7f819c0b8870 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:45.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.362+0000 7f81a0d6b700 1 -- 172.21.15.52:0/348606169 >> 172.21.15.52:0/348606169 conn(0x7f819c0bdf30 msgr2=0x7f819c0b9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:45.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.362+0000 7f81a0d6b700 1 -- 172.21.15.52:0/348606169 shutdown_connections 2023-06-23T18:44:45.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.362+0000 7f81a0d6b700 1 -- 172.21.15.52:0/348606169 wait complete. 2023-06-23T18:44:45.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.363+0000 7f81a0d6b700 1 Processor -- start 2023-06-23T18:44:45.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.364+0000 7f81a0d6b700 1 -- start start 2023-06-23T18:44:45.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.364+0000 7f81a0d6b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f819c06c1f0 0x7f819c0b7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:45.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.364+0000 7f81a0d6b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f819c0b9310 0x7f819c1d46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:45.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.364+0000 7f81a0d6b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f819c14da40 0x7f819c1424e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:45.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.364+0000 7f81a0d6b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819c1d55f0 con 0x7f819c14da40 2023-06-23T18:44:45.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.364+0000 7f81a0d6b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819c0b7560 con 0x7f819c06c1f0 2023-06-23T18:44:45.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.364+0000 7f81a0d6b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819c1d3d60 con 0x7f819c0b9310 2023-06-23T18:44:45.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.364+0000 7f819ad9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f819c14da40 0x7f819c1424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:45.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.364+0000 7f819ad9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f819c14da40 0x7f819c1424e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47242/0 (socket says 172.21.15.52:47242) 2023-06-23T18:44:45.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.364+0000 7f819ad9d700 1 -- 172.21.15.52:0/145914423 learned_addr learned my addr 172.21.15.52:0/145914423 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:45.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.364+0000 7f819a59c700 1 --2- 172.21.15.52:0/145914423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f819c06c1f0 0x7f819c0b7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:45.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.364+0000 7f8199d9b700 1 --2- 172.21.15.52:0/145914423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f819c0b9310 0x7f819c1d46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:45.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.365+0000 7f819ad9d700 1 -- 172.21.15.52:0/145914423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f819c0b9310 msgr2=0x7f819c1d46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:45.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.365+0000 7f819ad9d700 1 --2- 172.21.15.52:0/145914423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f819c0b9310 0x7f819c1d46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:45.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.365+0000 7f819ad9d700 1 -- 172.21.15.52:0/145914423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f819c06c1f0 msgr2=0x7f819c0b7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:45.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.365+0000 7f819ad9d700 1 --2- 172.21.15.52:0/145914423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f819c06c1f0 0x7f819c0b7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:45.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.365+0000 7f819ad9d700 1 -- 172.21.15.52:0/145914423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81900094a0 con 0x7f819c14da40 2023-06-23T18:44:45.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.365+0000 7f8199d9b700 1 --2- 172.21.15.52:0/145914423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f819c0b9310 0x7f819c1d46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:45.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.365+0000 7f819ad9d700 1 --2- 172.21.15.52:0/145914423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f819c14da40 0x7f819c1424e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8194001560 tx=0x7f819400cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:45.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.365+0000 7f818affd700 1 -- 172.21.15.52:0/145914423 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8194003e30 con 0x7f819c14da40 2023-06-23T18:44:45.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.365+0000 7f818affd700 1 -- 172.21.15.52:0/145914423 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8194005070 con 0x7f819c14da40 2023-06-23T18:44:45.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.365+0000 7f81a0d6b700 1 -- 172.21.15.52:0/145914423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819c1d6c90 con 0x7f819c14da40 2023-06-23T18:44:45.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.365+0000 7f818affd700 1 -- 172.21.15.52:0/145914423 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8194005420 con 0x7f819c14da40 2023-06-23T18:44:45.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.365+0000 7f81a0d6b700 1 -- 172.21.15.52:0/145914423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f819c1d6520 con 0x7f819c14da40 2023-06-23T18:44:45.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.366+0000 7f81a0d6b700 1 -- 172.21.15.52:0/145914423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f819c04e1d0 con 0x7f819c14da40 2023-06-23T18:44:45.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.367+0000 7f818affd700 1 -- 172.21.15.52:0/145914423 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f8194005580 con 0x7f819c14da40 2023-06-23T18:44:45.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.367+0000 7f818affd700 1 --2- 172.21.15.52:0/145914423 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f817c06ac50 0x7f817c06d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:45.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.367+0000 7f818affd700 1 -- 172.21.15.52:0/145914423 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f81940885f0 con 0x7f819c14da40 2023-06-23T18:44:45.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.367+0000 7f819a59c700 1 --2- 172.21.15.52:0/145914423 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f817c06ac50 0x7f817c06d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:45.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.368+0000 7f819a59c700 1 --2- 172.21.15.52:0/145914423 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f817c06ac50 0x7f817c06d100 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f818c007fd0 tx=0x7f818c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:45.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.372+0000 7f818affd700 1 -- 172.21.15.52:0/145914423 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8194053b60 con 0x7f819c14da40 2023-06-23T18:44:45.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.582+0000 7f81a0d6b700 1 -- 172.21.15.52:0/145914423 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f819c1d3fe0 con 0x7f819c14da40 2023-06-23T18:44:45.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.583+0000 7f818affd700 1 -- 172.21.15.52:0/145914423 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+14557 (secure 0 0 0) 0x7f8194017090 con 0x7f819c14da40 2023-06-23T18:44:45.588 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:44:45.588 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":16,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","created":"2023-06-23T18:44:31.918434+0000","modified":"2023-06-23T18:44:45.179864+0000","last_up_change":"2023-06-23T18:44:42.169624+0000","last_in_change":"2023-06-23T18:44:34.510501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-23T18:44:43.346578+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-23T18:44:43.829719+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c371fb28-1b15-4e43-8d5a-43e402920ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6812","nonce":1066999520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6815","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6818","nonce":1066999520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6829","nonce":1066999520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6823","nonce":1066999520}]},"public_addr":"172.21.15.52:6812/1066999520","cluster_addr":"172.21.15.52:6818/1066999520","heartbeat_back_addr":"172.21.15.52:6829/1066999520","heartbeat_front_addr":"172.21.15.52:6823/1066999520","state":["exists","up"]},{"osd":1,"uuid":"4a142f04-33eb-47ec-9cc5-b08b44d82658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6813","nonce":2360219751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6819","nonce":2360219751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6830","nonce":2360219751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6825","nonce":2360219751}]},"public_addr":"172.21.15.52:6813/2360219751","cluster_addr":"172.21.15.52:6819/2360219751","heartbeat_back_addr":"172.21.15.52:6830/2360219751","heartbeat_front_addr":"172.21.15.52:6825/2360219751","state":["exists","up"]},{"osd":2,"uuid":"d7bb089d-4c55-4370-ba59-7fe88c39512a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6801","nonce":835073005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6803","nonce":835073005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6807","nonce":835073005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6805","nonce":835073005}]},"public_addr":"172.21.15.52:6801/835073005","cluster_addr":"172.21.15.52:6803/835073005","heartbeat_back_addr":"172.21.15.52:6807/835073005","heartbeat_front_addr":"172.21.15.52:6805/835073005","state":["exists","up"]},{"osd":3,"uuid":"4bcdcdc3-6a8f-468e-877e-57f76079ac3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6811","nonce":2852700864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6817","nonce":2852700864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6831","nonce":2852700864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6824","nonce":2852700864}]},"public_addr":"172.21.15.52:6811/2852700864","cluster_addr":"172.21.15.52:6817/2852700864","heartbeat_back_addr":"172.21.15.52:6831/2852700864","heartbeat_front_addr":"172.21.15.52:6824/2852700864","state":["exists","up"]},{"osd":4,"uuid":"cac63000-ae94-4b08-93e6-a99119640b63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6809","nonce":2538664679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6811","nonce":2538664679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6815","nonce":2538664679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6813","nonce":2538664679}]},"public_addr":"172.21.15.89:6809/2538664679","cluster_addr":"172.21.15.89:6811/2538664679","heartbeat_back_addr":"172.21.15.89:6815/2538664679","heartbeat_front_addr":"172.21.15.89:6813/2538664679","state":["exists","up"]},{"osd":5,"uuid":"45c53102-18a6-4fd7-9c25-8ea5e1ef6851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6801","nonce":1683710352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6803","nonce":1683710352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6807","nonce":1683710352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6805","nonce":1683710352}]},"public_addr":"172.21.15.89:6801/1683710352","cluster_addr":"172.21.15.89:6803/1683710352","heartbeat_back_addr":"172.21.15.89:6807/1683710352","heartbeat_front_addr":"172.21.15.89:6805/1683710352","state":["exists","up"]},{"osd":6,"uuid":"abee09d1-8eba-484f-a25c-871c1fe2e843","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6817","nonce":3890899288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6819","nonce":3890899288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6823","nonce":3890899288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6821","nonce":3890899288}]},"public_addr":"172.21.15.89:6817/3890899288","cluster_addr":"172.21.15.89:6819/3890899288","heartbeat_back_addr":"172.21.15.89:6823/3890899288","heartbeat_front_addr":"172.21.15.89:6821/3890899288","state":["exists","up"]},{"osd":7,"uuid":"5acf9e2e-00dd-4f9b-a7d9-3d820f695de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6825","nonce":2989085420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6827","nonce":2989085420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6831","nonce":2989085420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6829","nonce":2989085420}]},"public_addr":"172.21.15.89:6825/2989085420","cluster_addr":"172.21.15.89:6827/2989085420","heartbeat_back_addr":"172.21.15.89:6831/2989085420","heartbeat_front_addr":"172.21.15.89:6829/2989085420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.663866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.710904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.619347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.660102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.686933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.724635+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.669111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.678740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:44:45.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.585+0000 7f81a0d6b700 1 -- 172.21.15.52:0/145914423 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f817c06ac50 msgr2=0x7f817c06d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:45.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.585+0000 7f81a0d6b700 1 --2- 172.21.15.52:0/145914423 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f817c06ac50 0x7f817c06d100 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f818c007fd0 tx=0x7f818c009040 comp rx=0 tx=0).stop 2023-06-23T18:44:45.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.585+0000 7f81a0d6b700 1 -- 172.21.15.52:0/145914423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f819c14da40 msgr2=0x7f819c1424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:45.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.585+0000 7f81a0d6b700 1 --2- 172.21.15.52:0/145914423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f819c14da40 0x7f819c1424e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8194001560 tx=0x7f819400cb50 comp rx=0 tx=0).stop 2023-06-23T18:44:45.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.585+0000 7f81a0d6b700 1 -- 172.21.15.52:0/145914423 shutdown_connections 2023-06-23T18:44:45.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.585+0000 7f81a0d6b700 1 --2- 172.21.15.52:0/145914423 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f817c06ac50 0x7f817c06d100 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:45.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.585+0000 7f81a0d6b700 1 --2- 172.21.15.52:0/145914423 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f819c14da40 0x7f819c1424e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:45.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.585+0000 7f81a0d6b700 1 --2- 172.21.15.52:0/145914423 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f819c06c1f0 0x7f819c0b7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:45.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.585+0000 7f81a0d6b700 1 --2- 172.21.15.52:0/145914423 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f819c0b9310 0x7f819c1d46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:45.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.585+0000 7f81a0d6b700 1 -- 172.21.15.52:0/145914423 >> 172.21.15.52:0/145914423 conn(0x7f819c0bdf30 msgr2=0x7f819c070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:45.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.585+0000 7f81a0d6b700 1 -- 172.21.15.52:0/145914423 shutdown_connections 2023-06-23T18:44:45.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.585+0000 7f81a0d6b700 1 -- 172.21.15.52:0/145914423 wait complete. 2023-06-23T18:44:45.603 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-23T18:44:43.346578+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-23T18:44:43.829719+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-23T18:44:45.604 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T18:44:45.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.730+0000 7fcca4d71700 1 Processor -- start 2023-06-23T18:44:45.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.730+0000 7fcca4d71700 1 -- start start 2023-06-23T18:44:45.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.731+0000 7fcca4d71700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcca0142890 0x7fcca006af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:45.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.731+0000 7fcca4d71700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcca0149110 0x7fcca0152e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:45.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.731+0000 7fcca4d71700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca0148570 con 0x7fcca00b8e60 2023-06-23T18:44:45.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.731+0000 7fcca4d71700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca00b49b0 con 0x7fcca0149110 2023-06-23T18:44:45.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.731+0000 7fcca4d71700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00b5610 con 0x7fcca0142890 2023-06-23T18:44:45.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.731+0000 7fcc9dd9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcca00b8e60 0x7fcca0148a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48420/0 (socket says 172.21.15.52:48420) 2023-06-23T18:44:45.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.731+0000 7fcc9dd9b700 1 -- 172.21.15.52:0/3060068448 learned_addr learned my addr 172.21.15.52:0/3060068448 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:45.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.731+0000 7fcc9e59c700 1 --2- 172.21.15.52:0/3060068448 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcca0142890 0x7fcca006af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:45.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.731+0000 7fcc9ed9d700 1 --2- 172.21.15.52:0/3060068448 >> v2:172.21.15.89:3300/0 conn(0x7fcca0149110 0x7fcca0152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:45.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.732+0000 7fcc9d59a700 1 -- 172.21.15.52:0/3060068448 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3906003308 0 0) 0x7fcca0148570 con 0x7fcca00b8e60 2023-06-23T18:44:45.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.732+0000 7fcc9d59a700 1 -- 172.21.15.52:0/3060068448 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc880035b0 con 0x7fcca00b8e60 2023-06-23T18:44:45.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.732+0000 7fcc9e59c700 1 -- 172.21.15.52:0/3060068448 >> v2:172.21.15.89:3300/0 conn(0x7fcca0149110 msgr2=0x7fcca0152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:45.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.732+0000 7fcc9e59c700 1 --2- 172.21.15.52:0/3060068448 >> v2:172.21.15.89:3300/0 conn(0x7fcca0149110 0x7fcca0152e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:45.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.732+0000 7fcc9e59c700 1 -- 172.21.15.52:0/3060068448 >> v1:172.21.15.52:6789/0 conn(0x7fcca00b8e60 legacy=0x7fcca0148a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:45.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.732+0000 7fcc9e59c700 1 -- 172.21.15.52:0/3060068448 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca0142c60 con 0x7fcca0142890 2023-06-23T18:44:45.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.732+0000 7fcc9ed9d700 1 --2- 172.21.15.52:0/3060068448 >> v2:172.21.15.89:3300/0 conn(0x7fcca0149110 0x7fcca0152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:45.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.732+0000 7fcc9e59c700 1 --2- 172.21.15.52:0/3060068448 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcca0142890 0x7fcca006af00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcc94009840 tx=0x7fcc94009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bb3ec94d4146934 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:45.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.732+0000 7fcc9d59a700 1 -- 172.21.15.52:0/3060068448 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc94011830 con 0x7fcca0142890 2023-06-23T18:44:45.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.732+0000 7fcc9d59a700 1 -- 172.21.15.52:0/3060068448 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc94011990 con 0x7fcca0142890 2023-06-23T18:44:45.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.732+0000 7fcc9d59a700 1 -- 172.21.15.52:0/3060068448 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc94011d20 con 0x7fcca0142890 2023-06-23T18:44:45.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.733+0000 7fcca4d71700 1 -- 172.21.15.52:0/3060068448 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcca0142890 msgr2=0x7fcca006af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:45.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.733+0000 7fcca4d71700 1 --2- 172.21.15.52:0/3060068448 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcca0142890 0x7fcca006af00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcc94009840 tx=0x7fcc94009b50 comp rx=0 tx=0).stop 2023-06-23T18:44:45.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.733+0000 7fcca4d71700 1 -- 172.21.15.52:0/3060068448 shutdown_connections 2023-06-23T18:44:45.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.733+0000 7fcca4d71700 1 --2- 172.21.15.52:0/3060068448 >> v2:172.21.15.89:3300/0 conn(0x7fcca0149110 0x7fcca0152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:45.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.733+0000 7fcca4d71700 1 --2- 172.21.15.52:0/3060068448 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcca0142890 0x7fcca006af00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:45.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.733+0000 7fcca4d71700 1 -- 172.21.15.52:0/3060068448 >> 172.21.15.52:0/3060068448 conn(0x7fcca00b95c0 msgr2=0x7fcca00b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:45.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.733+0000 7fcca4d71700 1 -- 172.21.15.52:0/3060068448 shutdown_connections 2023-06-23T18:44:45.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.733+0000 7fcca4d71700 1 -- 172.21.15.52:0/3060068448 wait complete. 2023-06-23T18:44:45.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.734+0000 7fcca4d71700 1 Processor -- start 2023-06-23T18:44:45.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.734+0000 7fcca4d71700 1 -- start start 2023-06-23T18:44:45.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.735+0000 7fcca4d71700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcca00b8e60 0x7fcca0145380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:45.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.735+0000 7fcca4d71700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcca0142890 0x7fcca01437b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:45.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.735+0000 7fcca4d71700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcca0149110 0x7fcca013f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:45.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.735+0000 7fcca4d71700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca01deff0 con 0x7fcca0149110 2023-06-23T18:44:45.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.735+0000 7fcca4d71700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca01deb60 con 0x7fcca0142890 2023-06-23T18:44:45.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.735+0000 7fcca4d71700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca01de250 con 0x7fcca00b8e60 2023-06-23T18:44:45.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.735+0000 7fcc9ed9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcca0149110 0x7fcca013f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:45.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.735+0000 7fcc9e59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcca00b8e60 0x7fcca0145380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:45.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.735+0000 7fcc9ed9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcca0149110 0x7fcca013f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47252/0 (socket says 172.21.15.52:47252) 2023-06-23T18:44:45.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.735+0000 7fcc9ed9d700 1 -- 172.21.15.52:0/2841291197 learned_addr learned my addr 172.21.15.52:0/2841291197 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:45.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.735+0000 7fcc9dd9b700 1 --2- 172.21.15.52:0/2841291197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcca0142890 0x7fcca01437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:45.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.736+0000 7fcc9e59c700 1 -- 172.21.15.52:0/2841291197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcca0142890 msgr2=0x7fcca01437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:45.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.736+0000 7fcc9e59c700 1 --2- 172.21.15.52:0/2841291197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcca0142890 0x7fcca01437b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:45.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.736+0000 7fcc9e59c700 1 -- 172.21.15.52:0/2841291197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcca0149110 msgr2=0x7fcca013f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:45.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.736+0000 7fcc9e59c700 1 --2- 172.21.15.52:0/2841291197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcca0149110 0x7fcca013f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:45.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.736+0000 7fcc9e59c700 1 -- 172.21.15.52:0/2841291197 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc98009a70 con 0x7fcca00b8e60 2023-06-23T18:44:45.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.736+0000 7fcc9ed9d700 1 --2- 172.21.15.52:0/2841291197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcca0149110 0x7fcca013f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:45.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.736+0000 7fcc9e59c700 1 --2- 172.21.15.52:0/2841291197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcca00b8e60 0x7fcca0145380 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcc94016000 tx=0x7fcc94004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:45.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.736+0000 7fcc8effd700 1 -- 172.21.15.52:0/2841291197 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc94004590 con 0x7fcca00b8e60 2023-06-23T18:44:45.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.736+0000 7fcc8effd700 1 -- 172.21.15.52:0/2841291197 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9401f070 con 0x7fcca00b8e60 2023-06-23T18:44:45.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.736+0000 7fcca4d71700 1 -- 172.21.15.52:0/2841291197 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc940094a0 con 0x7fcca00b8e60 2023-06-23T18:44:45.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.736+0000 7fcc8effd700 1 -- 172.21.15.52:0/2841291197 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc940038e0 con 0x7fcca00b8e60 2023-06-23T18:44:45.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.736+0000 7fcca4d71700 1 -- 172.21.15.52:0/2841291197 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca01de7f0 con 0x7fcca00b8e60 2023-06-23T18:44:45.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.737+0000 7fcca4d71700 1 -- 172.21.15.52:0/2841291197 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca004e1d0 con 0x7fcca00b8e60 2023-06-23T18:44:45.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.738+0000 7fcc8effd700 1 -- 172.21.15.52:0/2841291197 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fcc94003a40 con 0x7fcca00b8e60 2023-06-23T18:44:45.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.738+0000 7fcc8effd700 1 --2- 172.21.15.52:0/2841291197 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcc8006ac50 0x7fcc8006d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:45.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.738+0000 7fcc8effd700 1 -- 172.21.15.52:0/2841291197 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcc94021070 con 0x7fcca00b8e60 2023-06-23T18:44:45.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.743+0000 7fcc8effd700 1 -- 172.21.15.52:0/2841291197 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcc94055aa0 con 0x7fcca00b8e60 2023-06-23T18:44:45.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.749+0000 7fcc9dd9b700 1 --2- 172.21.15.52:0/2841291197 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcc8006ac50 0x7fcc8006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:45.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.749+0000 7fcc9dd9b700 1 --2- 172.21.15.52:0/2841291197 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcc8006ac50 0x7fcc8006d100 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcca014c380 tx=0x7fcc90007dc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:45.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.939+0000 7fcca4d71700 1 -- 172.21.15.52:0/2841291197 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcca00b5010 con 0x7fcca00b8e60 2023-06-23T18:44:45.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.940+0000 7fcc8effd700 1 -- 172.21.15.52:0/2841291197 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcc9402b020 con 0x7fcca00b8e60 2023-06-23T18:44:45.945 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-06-23T18:44:45.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.942+0000 7fcca4d71700 1 -- 172.21.15.52:0/2841291197 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcc8006ac50 msgr2=0x7fcc8006d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:45.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.942+0000 7fcca4d71700 1 --2- 172.21.15.52:0/2841291197 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcc8006ac50 0x7fcc8006d100 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcca014c380 tx=0x7fcc90007dc0 comp rx=0 tx=0).stop 2023-06-23T18:44:45.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.942+0000 7fcca4d71700 1 -- 172.21.15.52:0/2841291197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcca00b8e60 msgr2=0x7fcca0145380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:45.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.942+0000 7fcca4d71700 1 --2- 172.21.15.52:0/2841291197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcca00b8e60 0x7fcca0145380 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcc94016000 tx=0x7fcc94004750 comp rx=0 tx=0).stop 2023-06-23T18:44:45.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.942+0000 7fcca4d71700 1 -- 172.21.15.52:0/2841291197 shutdown_connections 2023-06-23T18:44:45.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.942+0000 7fcca4d71700 1 --2- 172.21.15.52:0/2841291197 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcc8006ac50 0x7fcc8006d100 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:45.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.942+0000 7fcca4d71700 1 --2- 172.21.15.52:0/2841291197 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcca0149110 0x7fcca013f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:45.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.942+0000 7fcca4d71700 1 --2- 172.21.15.52:0/2841291197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcca00b8e60 0x7fcca0145380 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:45.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.942+0000 7fcca4d71700 1 --2- 172.21.15.52:0/2841291197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcca0142890 0x7fcca01437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:45.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.942+0000 7fcca4d71700 1 -- 172.21.15.52:0/2841291197 >> 172.21.15.52:0/2841291197 conn(0x7fcca00b95c0 msgr2=0x7fcca006ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:45.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.942+0000 7fcca4d71700 1 -- 172.21.15.52:0/2841291197 shutdown_connections 2023-06-23T18:44:45.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:45.942+0000 7fcca4d71700 1 -- 172.21.15.52:0/2841291197 wait complete. 2023-06-23T18:44:45.959 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T18:44:46.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.083+0000 7f7d4b876700 1 Processor -- start 2023-06-23T18:44:46.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.084+0000 7f7d4b876700 1 -- start start 2023-06-23T18:44:46.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.084+0000 7f7d4b876700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7d440b90c0 0x7f7d440ba2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:46.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.084+0000 7f7d4b876700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7d440b7510 0x7f7d440b7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:46.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.084+0000 7f7d4b876700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d440b8ea0 con 0x7f7d44145db0 2023-06-23T18:44:46.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.084+0000 7f7d4b876700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d44146180 con 0x7f7d440b7510 2023-06-23T18:44:46.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.084+0000 7f7d4b876700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d440b6570 con 0x7f7d440b90c0 2023-06-23T18:44:46.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.085+0000 7f7d49e13700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7d440b7510 0x7f7d440b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:46.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.085+0000 7f7d49612700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7d44145db0 0x7f7d440be420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.52:46022/0 (socket says 172.21.15.52:46022) 2023-06-23T18:44:46.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.085+0000 7f7d48e11700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7d440b90c0 0x7f7d440ba2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:46.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.085+0000 7f7d49612700 1 -- 172.21.15.52:0/541154364 learned_addr learned my addr 172.21.15.52:0/541154364 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:46.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.085+0000 7f7d3bfff700 1 -- 172.21.15.52:0/541154364 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3868496402 0 0) 0x7f7d440b8ea0 con 0x7f7d44145db0 2023-06-23T18:44:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.085+0000 7f7d3bfff700 1 -- 172.21.15.52:0/541154364 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d300035b0 con 0x7f7d44145db0 2023-06-23T18:44:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.085+0000 7f7d48e11700 1 -- 172.21.15.52:0/541154364 >> v2:172.21.15.52:3300/0 conn(0x7f7d440b7510 msgr2=0x7f7d440b7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.085+0000 7f7d48e11700 1 --2- 172.21.15.52:0/541154364 >> v2:172.21.15.52:3300/0 conn(0x7f7d440b7510 0x7f7d440b7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.085+0000 7f7d48e11700 1 -- 172.21.15.52:0/541154364 >> v1:172.21.15.89:6789/0 conn(0x7f7d44145db0 legacy=0x7f7d440be420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.085+0000 7f7d48e11700 1 -- 172.21.15.52:0/541154364 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d440beb30 con 0x7f7d440b90c0 2023-06-23T18:44:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.085+0000 7f7d48e11700 1 --2- 172.21.15.52:0/541154364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d440b90c0 0x7f7d440ba2e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7d44070e20 tx=0x7f7d34009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b664c97a4c4fe3b server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.085+0000 7f7d3bfff700 1 -- 172.21.15.52:0/541154364 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d34011830 con 0x7f7d440b90c0 2023-06-23T18:44:46.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.085+0000 7f7d3bfff700 1 -- 172.21.15.52:0/541154364 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d34011990 con 0x7f7d440b90c0 2023-06-23T18:44:46.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.085+0000 7f7d3bfff700 1 -- 172.21.15.52:0/541154364 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d34011d20 con 0x7f7d440b90c0 2023-06-23T18:44:46.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.086+0000 7f7d4b876700 1 -- 172.21.15.52:0/541154364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d440b90c0 msgr2=0x7f7d440ba2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:46.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.086+0000 7f7d4b876700 1 --2- 172.21.15.52:0/541154364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d440b90c0 0x7f7d440ba2e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7d44070e20 tx=0x7f7d34009b20 comp rx=0 tx=0).stop 2023-06-23T18:44:46.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.086+0000 7f7d4b876700 1 -- 172.21.15.52:0/541154364 shutdown_connections 2023-06-23T18:44:46.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.086+0000 7f7d4b876700 1 --2- 172.21.15.52:0/541154364 >> v2:172.21.15.52:3300/0 conn(0x7f7d440b7510 0x7f7d440b7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:46.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.086+0000 7f7d4b876700 1 --2- 172.21.15.52:0/541154364 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d440b90c0 0x7f7d440ba2e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:46.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.086+0000 7f7d4b876700 1 -- 172.21.15.52:0/541154364 >> 172.21.15.52:0/541154364 conn(0x7f7d44071410 msgr2=0x7f7d44071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:46.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.086+0000 7f7d4b876700 1 -- 172.21.15.52:0/541154364 shutdown_connections 2023-06-23T18:44:46.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.086+0000 7f7d4b876700 1 -- 172.21.15.52:0/541154364 wait complete. 2023-06-23T18:44:46.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.087+0000 7f7d4b876700 1 Processor -- start 2023-06-23T18:44:46.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.087+0000 7f7d4b876700 1 -- start start 2023-06-23T18:44:46.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.088+0000 7f7d4b876700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d440b7510 0x7f7d441485a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:46.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.088+0000 7f7d4b876700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d440b90c0 0x7f7d440bd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:46.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.088+0000 7f7d4b876700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d44145db0 0x7f7d44147b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:46.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.088+0000 7f7d4b876700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4413e880 con 0x7f7d440b7510 2023-06-23T18:44:46.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.088+0000 7f7d4b876700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d44146cc0 con 0x7f7d440b90c0 2023-06-23T18:44:46.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.088+0000 7f7d4b876700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d44146690 con 0x7f7d44145db0 2023-06-23T18:44:46.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.088+0000 7f7d49612700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d440b7510 0x7f7d441485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.088+0000 7f7d49612700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d440b7510 0x7f7d441485a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47272/0 (socket says 172.21.15.52:47272) 2023-06-23T18:44:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.088+0000 7f7d49612700 1 -- 172.21.15.52:0/2220146677 learned_addr learned my addr 172.21.15.52:0/2220146677 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.088+0000 7f7d48e11700 1 --2- 172.21.15.52:0/2220146677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d440b90c0 0x7f7d440bd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.088+0000 7f7d49e13700 1 --2- 172.21.15.52:0/2220146677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d44145db0 0x7f7d44147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.089+0000 7f7d49612700 1 -- 172.21.15.52:0/2220146677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d44145db0 msgr2=0x7f7d44147b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.089+0000 7f7d49612700 1 --2- 172.21.15.52:0/2220146677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d44145db0 0x7f7d44147b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.089+0000 7f7d49612700 1 -- 172.21.15.52:0/2220146677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d440b90c0 msgr2=0x7f7d440bd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:46.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.089+0000 7f7d49612700 1 --2- 172.21.15.52:0/2220146677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d440b90c0 0x7f7d440bd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:46.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.089+0000 7f7d49612700 1 -- 172.21.15.52:0/2220146677 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d340094a0 con 0x7f7d440b7510 2023-06-23T18:44:46.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.089+0000 7f7d49612700 1 --2- 172.21.15.52:0/2220146677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d440b7510 0x7f7d441485a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000c700 tx=0x7f7d4000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:46.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.129+0000 7f7d39ffb700 1 -- 172.21.15.52:0/2220146677 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d40005d70 con 0x7f7d440b7510 2023-06-23T18:44:46.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.129+0000 7f7d39ffb700 1 -- 172.21.15.52:0/2220146677 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d400070d0 con 0x7f7d440b7510 2023-06-23T18:44:46.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.129+0000 7f7d4b876700 1 -- 172.21.15.52:0/2220146677 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d44148ae0 con 0x7f7d440b7510 2023-06-23T18:44:46.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.130+0000 7f7d39ffb700 1 -- 172.21.15.52:0/2220146677 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d40007460 con 0x7f7d440b7510 2023-06-23T18:44:46.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.130+0000 7f7d4b876700 1 -- 172.21.15.52:0/2220146677 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d440be0a0 con 0x7f7d440b7510 2023-06-23T18:44:46.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.131+0000 7f7d4b876700 1 -- 172.21.15.52:0/2220146677 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d440b58e0 con 0x7f7d440b7510 2023-06-23T18:44:46.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.131+0000 7f7d39ffb700 1 -- 172.21.15.52:0/2220146677 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f7d400075c0 con 0x7f7d440b7510 2023-06-23T18:44:46.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.132+0000 7f7d39ffb700 1 --2- 172.21.15.52:0/2220146677 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7d2806aca0 0x7f7d2806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:46.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.132+0000 7f7d39ffb700 1 -- 172.21.15.52:0/2220146677 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7d400883f0 con 0x7f7d440b7510 2023-06-23T18:44:46.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.132+0000 7f7d48e11700 1 --2- 172.21.15.52:0/2220146677 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7d2806aca0 0x7f7d2806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:46.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.132+0000 7f7d48e11700 1 --2- 172.21.15.52:0/2220146677 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7d2806aca0 0x7f7d2806d150 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7d340090b0 tx=0x7f7d34008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:46.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.137+0000 7f7d39ffb700 1 -- 172.21.15.52:0/2220146677 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7d40053960 con 0x7f7d440b7510 2023-06-23T18:44:46.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.333+0000 7f7d4b876700 1 -- 172.21.15.52:0/2220146677 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7d44148ae0 con 0x7f7d440b7510 2023-06-23T18:44:46.338 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.333+0000 7f7d39ffb700 1 -- 172.21.15.52:0/2220146677 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7d44148ae0 con 0x7f7d440b7510 2023-06-23T18:44:46.339 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-06-23T18:44:46.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.336+0000 7f7d4b876700 1 -- 172.21.15.52:0/2220146677 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7d2806aca0 msgr2=0x7f7d2806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:46.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.336+0000 7f7d4b876700 1 --2- 172.21.15.52:0/2220146677 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7d2806aca0 0x7f7d2806d150 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7d340090b0 tx=0x7f7d34008030 comp rx=0 tx=0).stop 2023-06-23T18:44:46.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.336+0000 7f7d4b876700 1 -- 172.21.15.52:0/2220146677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d440b7510 msgr2=0x7f7d441485a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:46.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.336+0000 7f7d4b876700 1 --2- 172.21.15.52:0/2220146677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d440b7510 0x7f7d441485a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000c700 tx=0x7f7d4000cac0 comp rx=0 tx=0).stop 2023-06-23T18:44:46.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.336+0000 7f7d4b876700 1 -- 172.21.15.52:0/2220146677 shutdown_connections 2023-06-23T18:44:46.341 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.336+0000 7f7d4b876700 1 --2- 172.21.15.52:0/2220146677 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7d2806aca0 0x7f7d2806d150 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:46.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.336+0000 7f7d4b876700 1 --2- 172.21.15.52:0/2220146677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d44145db0 0x7f7d44147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:46.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.336+0000 7f7d4b876700 1 --2- 172.21.15.52:0/2220146677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7d440b7510 0x7f7d441485a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:46.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.336+0000 7f7d4b876700 1 --2- 172.21.15.52:0/2220146677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d440b90c0 0x7f7d440bd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:46.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.336+0000 7f7d4b876700 1 -- 172.21.15.52:0/2220146677 >> 172.21.15.52:0/2220146677 conn(0x7f7d44071410 msgr2=0x7f7d44143660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:46.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.336+0000 7f7d4b876700 1 -- 172.21.15.52:0/2220146677 shutdown_connections 2023-06-23T18:44:46.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.336+0000 7f7d4b876700 1 -- 172.21.15.52:0/2220146677 wait complete. 2023-06-23T18:44:46.353 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T18:44:46.479 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.475+0000 7f6c66c26700 1 Processor -- start 2023-06-23T18:44:46.480 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.475+0000 7f6c66c26700 1 -- start start 2023-06-23T18:44:46.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.475+0000 7f6c66c26700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c6006c1f0 0x7f6c6014b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:46.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.475+0000 7f6c66c26700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6c600701e0 0x7f6c60145580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:46.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.475+0000 7f6c66c26700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c60070ed0 con 0x7f6c600b0990 2023-06-23T18:44:46.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.475+0000 7f6c66c26700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c600b7ec0 con 0x7f6c600701e0 2023-06-23T18:44:46.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.476+0000 7f6c66c26700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6006fa40 con 0x7f6c6006c1f0 2023-06-23T18:44:46.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.476+0000 7f6c651c3700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f6c600b0990 0x7f6c600b6900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48424/0 (socket says 172.21.15.52:48424) 2023-06-23T18:44:46.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.476+0000 7f6c651c3700 1 -- 172.21.15.52:0/1285718994 learned_addr learned my addr 172.21.15.52:0/1285718994 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:46.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.476+0000 7f6c649c2700 1 --2- 172.21.15.52:0/1285718994 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c6006c1f0 0x7f6c6014b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:46.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.476+0000 7f6c5ffff700 1 --2- 172.21.15.52:0/1285718994 >> v2:172.21.15.89:3300/0 conn(0x7f6c600701e0 0x7f6c60145580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:46.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.476+0000 7f6c5f7fe700 1 -- 172.21.15.52:0/1285718994 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283658311 0 0) 0x7f6c60070ed0 con 0x7f6c600b0990 2023-06-23T18:44:46.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.476+0000 7f6c5f7fe700 1 -- 172.21.15.52:0/1285718994 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c500035b0 con 0x7f6c600b0990 2023-06-23T18:44:46.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.476+0000 7f6c5f7fe700 1 -- 172.21.15.52:0/1285718994 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 966793019 0 0) 0x7f6c500035b0 con 0x7f6c600b0990 2023-06-23T18:44:46.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.476+0000 7f6c5f7fe700 1 -- 172.21.15.52:0/1285718994 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c6006c1f0 msgr2=0x7f6c6014b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:46.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.476+0000 7f6c5f7fe700 1 --2- 172.21.15.52:0/1285718994 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c6006c1f0 0x7f6c6014b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:46.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.476+0000 7f6c5f7fe700 1 -- 172.21.15.52:0/1285718994 >> v2:172.21.15.89:3300/0 conn(0x7f6c600701e0 msgr2=0x7f6c60145580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:46.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.476+0000 7f6c5f7fe700 1 --2- 172.21.15.52:0/1285718994 >> v2:172.21.15.89:3300/0 conn(0x7f6c600701e0 0x7f6c60145580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:46.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.476+0000 7f6c5f7fe700 1 -- 172.21.15.52:0/1285718994 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c60069ef0 con 0x7f6c600b0990 2023-06-23T18:44:46.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.476+0000 7f6c5f7fe700 1 -- 172.21.15.52:0/1285718994 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7f6c580019f0 con 0x7f6c600b0990 2023-06-23T18:44:46.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.476+0000 7f6c5f7fe700 1 -- 172.21.15.52:0/1285718994 >> v1:172.21.15.52:6789/0 conn(0x7f6c600b0990 legacy=0x7f6c600b6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:46.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.476+0000 7f6c5f7fe700 1 --2- 172.21.15.52:0/1285718994 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c6006c1f0 0x7f6c50003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:46.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.476+0000 7f6c5f7fe700 1 --2- 172.21.15.52:0/1285718994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c50003f80 0x7f6c50004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:46.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.476+0000 7f6c5f7fe700 1 --2- 172.21.15.52:0/1285718994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c50004d90 0x7f6c50005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:46.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.476+0000 7f6c5f7fe700 1 -- 172.21.15.52:0/1285718994 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6006fa40 con 0x7f6c50004d90 2023-06-23T18:44:46.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.476+0000 7f6c5f7fe700 1 -- 172.21.15.52:0/1285718994 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5000ba10 con 0x7f6c50003f80 2023-06-23T18:44:46.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.476+0000 7f6c5f7fe700 1 -- 172.21.15.52:0/1285718994 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5000bb80 con 0x7f6c6006c1f0 2023-06-23T18:44:46.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.476+0000 7f6c651c3700 1 --2- 172.21.15.52:0/1285718994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c50004d90 0x7f6c50005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:46.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.476+0000 7f6c5ffff700 1 --2- 172.21.15.52:0/1285718994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c50003f80 0x7f6c50004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:46.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.476+0000 7f6c649c2700 1 --2- 172.21.15.52:0/1285718994 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c6006c1f0 0x7f6c50003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:46.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.477+0000 7f6c5ffff700 1 -- 172.21.15.52:0/1285718994 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c6006c1f0 msgr2=0x7f6c50003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:46.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.477+0000 7f6c5ffff700 1 --2- 172.21.15.52:0/1285718994 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c6006c1f0 0x7f6c50003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:46.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.477+0000 7f6c5ffff700 1 -- 172.21.15.52:0/1285718994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c50004d90 msgr2=0x7f6c50005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:46.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.477+0000 7f6c5ffff700 1 --2- 172.21.15.52:0/1285718994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c50004d90 0x7f6c50005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:46.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.477+0000 7f6c5ffff700 1 -- 172.21.15.52:0/1285718994 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c500035b0 con 0x7f6c50003f80 2023-06-23T18:44:46.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.477+0000 7f6c651c3700 1 --2- 172.21.15.52:0/1285718994 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c50004d90 0x7f6c50005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:46.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.477+0000 7f6c5ffff700 1 --2- 172.21.15.52:0/1285718994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c50003f80 0x7f6c50004850 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009b30 tx=0x7f6c50005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2cfa79352c95daf server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:46.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.477+0000 7f6c5f7fe700 1 -- 172.21.15.52:0/1285718994 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c00e6c0 con 0x7f6c50003f80 2023-06-23T18:44:46.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.477+0000 7f6c5f7fe700 1 -- 172.21.15.52:0/1285718994 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c00e820 con 0x7f6c50003f80 2023-06-23T18:44:46.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.477+0000 7f6c5f7fe700 1 -- 172.21.15.52:0/1285718994 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c00eb90 con 0x7f6c50003f80 2023-06-23T18:44:46.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.477+0000 7f6c66c26700 1 -- 172.21.15.52:0/1285718994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c50003f80 msgr2=0x7f6c50004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:46.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.477+0000 7f6c66c26700 1 --2- 172.21.15.52:0/1285718994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c50003f80 0x7f6c50004850 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009b30 tx=0x7f6c50005880 comp rx=0 tx=0).stop 2023-06-23T18:44:46.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.477+0000 7f6c651c3700 1 -- 172.21.15.52:0/1285718994 reap_dead start 2023-06-23T18:44:46.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.478+0000 7f6c66c26700 1 -- 172.21.15.52:0/1285718994 shutdown_connections 2023-06-23T18:44:46.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.478+0000 7f6c66c26700 1 -- 172.21.15.52:0/1285718994 >> 172.21.15.52:0/1285718994 conn(0x7f6c600bdf30 msgr2=0x7f6c600b9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:46.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.478+0000 7f6c66c26700 1 -- 172.21.15.52:0/1285718994 shutdown_connections 2023-06-23T18:44:46.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.478+0000 7f6c66c26700 1 -- 172.21.15.52:0/1285718994 wait complete. 2023-06-23T18:44:46.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.479+0000 7f6c66c26700 1 Processor -- start 2023-06-23T18:44:46.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.479+0000 7f6c66c26700 1 -- start start 2023-06-23T18:44:46.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.480+0000 7f6c66c26700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c50003f80 0x7f6c600b2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:46.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.480+0000 7f6c66c26700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c600b3df0 0x7f6c600b3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:46.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.480+0000 7f6c66c26700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c600b0f40 0x7f6c600b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:46.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.480+0000 7f6c66c26700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c60140350 con 0x7f6c50003f80 2023-06-23T18:44:46.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.480+0000 7f6c66c26700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c600b2880 con 0x7f6c600b0f40 2023-06-23T18:44:46.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.480+0000 7f6c66c26700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c60149670 con 0x7f6c600b3df0 2023-06-23T18:44:46.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.480+0000 7f6c649c2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c50003f80 0x7f6c600b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:46.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.480+0000 7f6c649c2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c50003f80 0x7f6c600b2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47298/0 (socket says 172.21.15.52:47298) 2023-06-23T18:44:46.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.480+0000 7f6c649c2700 1 -- 172.21.15.52:0/290274253 learned_addr learned my addr 172.21.15.52:0/290274253 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:46.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.480+0000 7f6c651c3700 1 --2- 172.21.15.52:0/290274253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c600b0f40 0x7f6c600b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:46.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.480+0000 7f6c5ffff700 1 --2- 172.21.15.52:0/290274253 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c600b3df0 0x7f6c600b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:46.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.480+0000 7f6c649c2700 1 -- 172.21.15.52:0/290274253 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c600b3df0 msgr2=0x7f6c600b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:46.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.480+0000 7f6c649c2700 1 --2- 172.21.15.52:0/290274253 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c600b3df0 0x7f6c600b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:46.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.480+0000 7f6c649c2700 1 -- 172.21.15.52:0/290274253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c600b0f40 msgr2=0x7f6c600b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:46.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.481+0000 7f6c649c2700 1 --2- 172.21.15.52:0/290274253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c600b0f40 0x7f6c600b13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:46.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.481+0000 7f6c649c2700 1 -- 172.21.15.52:0/290274253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c600b18f0 con 0x7f6c50003f80 2023-06-23T18:44:46.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.481+0000 7f6c651c3700 1 --2- 172.21.15.52:0/290274253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c600b0f40 0x7f6c600b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:44:46.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.481+0000 7f6c649c2700 1 --2- 172.21.15.52:0/290274253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c50003f80 0x7f6c600b2340 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6c54011aa0 tx=0x7f6c54011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:46.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.481+0000 7f6c5d7fa700 1 -- 172.21.15.52:0/290274253 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5400f980 con 0x7f6c50003f80 2023-06-23T18:44:46.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.481+0000 7f6c5d7fa700 1 -- 172.21.15.52:0/290274253 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5400fae0 con 0x7f6c50003f80 2023-06-23T18:44:46.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.481+0000 7f6c66c26700 1 -- 172.21.15.52:0/290274253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c601481c0 con 0x7f6c50003f80 2023-06-23T18:44:46.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.481+0000 7f6c5d7fa700 1 -- 172.21.15.52:0/290274253 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5400fe90 con 0x7f6c50003f80 2023-06-23T18:44:46.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.481+0000 7f6c66c26700 1 -- 172.21.15.52:0/290274253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c600b3570 con 0x7f6c50003f80 2023-06-23T18:44:46.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.482+0000 7f6c66c26700 1 -- 172.21.15.52:0/290274253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c60145020 con 0x7f6c50003f80 2023-06-23T18:44:46.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.482+0000 7f6c5d7fa700 1 -- 172.21.15.52:0/290274253 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6c54014440 con 0x7f6c50003f80 2023-06-23T18:44:46.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.482+0000 7f6c5d7fa700 1 --2- 172.21.15.52:0/290274253 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f6c4406ace0 0x7f6c4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:46.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.483+0000 7f6c5d7fa700 1 -- 172.21.15.52:0/290274253 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6c54089840 con 0x7f6c50003f80 2023-06-23T18:44:46.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.483+0000 7f6c5ffff700 1 --2- 172.21.15.52:0/290274253 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f6c4406ace0 0x7f6c4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:46.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.483+0000 7f6c5ffff700 1 --2- 172.21.15.52:0/290274253 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f6c4406ace0 0x7f6c4406d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c000c00 tx=0x7f6c4c01e040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:46.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.487+0000 7f6c5d7fa700 1 -- 172.21.15.52:0/290274253 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6c54054d00 con 0x7f6c50003f80 2023-06-23T18:44:46.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.728+0000 7f6c66c26700 1 -- 172.21.15.52:0/290274253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c6004e1d0 con 0x7f6c50003f80 2023-06-23T18:44:46.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.728+0000 7f6c5d7fa700 1 -- 172.21.15.52:0/290274253 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2765 (secure 0 0 0) 0x7f6c54022090 con 0x7f6c50003f80 2023-06-23T18:44:46.733 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:44:46.733 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/299877491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":299877491},{"type":"v1","addr":"172.21.15.89:6835","nonce":299877491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/2826461143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2826461143},{"type":"v1","addr":"172.21.15.52:6833","nonce":2826461143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/4214822260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4214822260},{"type":"v1","addr":"172.21.15.52:6835","nonce":4214822260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-06-23T18:44:46.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.730+0000 7f6c66c26700 1 -- 172.21.15.52:0/290274253 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f6c4406ace0 msgr2=0x7f6c4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:46.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.730+0000 7f6c66c26700 1 --2- 172.21.15.52:0/290274253 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f6c4406ace0 0x7f6c4406d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c000c00 tx=0x7f6c4c01e040 comp rx=0 tx=0).stop 2023-06-23T18:44:46.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.730+0000 7f6c66c26700 1 -- 172.21.15.52:0/290274253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c50003f80 msgr2=0x7f6c600b2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:46.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.730+0000 7f6c66c26700 1 --2- 172.21.15.52:0/290274253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c50003f80 0x7f6c600b2340 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6c54011aa0 tx=0x7f6c54011e60 comp rx=0 tx=0).stop 2023-06-23T18:44:46.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.730+0000 7f6c66c26700 1 -- 172.21.15.52:0/290274253 shutdown_connections 2023-06-23T18:44:46.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.730+0000 7f6c66c26700 1 --2- 172.21.15.52:0/290274253 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f6c4406ace0 0x7f6c4406d190 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:46.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.730+0000 7f6c66c26700 1 --2- 172.21.15.52:0/290274253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c600b0f40 0x7f6c600b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:46.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.730+0000 7f6c66c26700 1 --2- 172.21.15.52:0/290274253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6c50003f80 0x7f6c600b2340 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:46.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.730+0000 7f6c66c26700 1 --2- 172.21.15.52:0/290274253 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c600b3df0 0x7f6c600b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:46.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.730+0000 7f6c66c26700 1 -- 172.21.15.52:0/290274253 >> 172.21.15.52:0/290274253 conn(0x7f6c600bdf30 msgr2=0x7f6c60144910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:46.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.730+0000 7f6c66c26700 1 -- 172.21.15.52:0/290274253 shutdown_connections 2023-06-23T18:44:46.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.730+0000 7f6c66c26700 1 -- 172.21.15.52:0/290274253 wait complete. 2023-06-23T18:44:46.737 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 3 2023-06-23T18:44:46.747 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:44:46.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.867+0000 7f62cb66c700 1 Processor -- start 2023-06-23T18:44:46.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.868+0000 7f62cb66c700 1 -- start start 2023-06-23T18:44:46.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.868+0000 7f62cb66c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f62c41444a0 0x7f62c40b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:46.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.868+0000 7f62cb66c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c40b5a20 0x7f62c4154da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:46.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.868+0000 7f62cb66c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c40b7aa0 con 0x7f62c406a0d0 2023-06-23T18:44:46.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.868+0000 7f62cb66c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c40bcfc0 con 0x7f62c41444a0 2023-06-23T18:44:46.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.868+0000 7f62cb66c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40b5f30 con 0x7f62c40b5a20 2023-06-23T18:44:46.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.869+0000 7f62c8c07700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f62c41444a0 0x7f62c40b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:46.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.869+0000 7f62c8c07700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f62c41444a0 0x7f62c40b54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47304/0 (socket says 172.21.15.52:47304) 2023-06-23T18:44:46.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.869+0000 7f62c8c07700 1 -- 172.21.15.52:0/3269548013 learned_addr learned my addr 172.21.15.52:0/3269548013 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:46.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.869+0000 7f62c9408700 1 --1- 172.21.15.52:0/3269548013 >> v1:172.21.15.52:6789/0 conn(0x7f62c406a0d0 0x7f62c40bc8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48432/0 (socket says 172.21.15.52:48432) 2023-06-23T18:44:46.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.869+0000 7f62c9c09700 1 --2- 172.21.15.52:0/3269548013 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c40b5a20 0x7f62c4154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:46.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.869+0000 7f62c8c07700 1 -- 172.21.15.52:0/3269548013 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c40b5a20 msgr2=0x7f62c4154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:46.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.869+0000 7f62c8c07700 1 --2- 172.21.15.52:0/3269548013 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c40b5a20 0x7f62c4154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:46.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.869+0000 7f62c8c07700 1 -- 172.21.15.52:0/3269548013 >> v1:172.21.15.52:6789/0 conn(0x7f62c406a0d0 legacy=0x7f62c40bc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:46.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.869+0000 7f62c8c07700 1 -- 172.21.15.52:0/3269548013 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c40b6210 con 0x7f62c41444a0 2023-06-23T18:44:46.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.869+0000 7f62bbfff700 1 -- 172.21.15.52:0/3269548013 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3989710895 0 0) 0x7f62c40b7aa0 con 0x7f62c406a0d0 2023-06-23T18:44:46.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.869+0000 7f62c8c07700 1 --2- 172.21.15.52:0/3269548013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62c41444a0 0x7f62c40b54e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f62b40098f0 tx=0x7f62b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ca27d588d42a6e server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:46.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.869+0000 7f62bbfff700 1 -- 172.21.15.52:0/3269548013 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4011830 con 0x7f62c41444a0 2023-06-23T18:44:46.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.869+0000 7f62bbfff700 1 -- 172.21.15.52:0/3269548013 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b4011990 con 0x7f62c41444a0 2023-06-23T18:44:46.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.869+0000 7f62bbfff700 1 -- 172.21.15.52:0/3269548013 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4011d20 con 0x7f62c41444a0 2023-06-23T18:44:46.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.870+0000 7f62cb66c700 1 -- 172.21.15.52:0/3269548013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62c41444a0 msgr2=0x7f62c40b54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:46.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.870+0000 7f62cb66c700 1 --2- 172.21.15.52:0/3269548013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62c41444a0 0x7f62c40b54e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f62b40098f0 tx=0x7f62b4009c00 comp rx=0 tx=0).stop 2023-06-23T18:44:46.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.870+0000 7f62cb66c700 1 -- 172.21.15.52:0/3269548013 shutdown_connections 2023-06-23T18:44:46.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.870+0000 7f62cb66c700 1 --2- 172.21.15.52:0/3269548013 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c40b5a20 0x7f62c4154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:46.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.870+0000 7f62cb66c700 1 --2- 172.21.15.52:0/3269548013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62c41444a0 0x7f62c40b54e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:46.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.870+0000 7f62cb66c700 1 -- 172.21.15.52:0/3269548013 >> 172.21.15.52:0/3269548013 conn(0x7f62c406bb90 msgr2=0x7f62c406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:46.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.870+0000 7f62cb66c700 1 -- 172.21.15.52:0/3269548013 shutdown_connections 2023-06-23T18:44:46.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.870+0000 7f62cb66c700 1 -- 172.21.15.52:0/3269548013 wait complete. 2023-06-23T18:44:46.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.871+0000 7f62cb66c700 1 Processor -- start 2023-06-23T18:44:46.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.871+0000 7f62cb66c700 1 -- start start 2023-06-23T18:44:46.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.872+0000 7f62cb66c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62c406a0d0 0x7f62c41e2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:46.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.872+0000 7f62cb66c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c40b5a20 0x7f62c40b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:46.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.872+0000 7f62cb66c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c41444a0 0x7f62c40b9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:46.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.872+0000 7f62cb66c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c41d58e0 con 0x7f62c406a0d0 2023-06-23T18:44:46.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.872+0000 7f62cb66c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c41e3490 con 0x7f62c40b5a20 2023-06-23T18:44:46.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.872+0000 7f62cb66c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c41d4f40 con 0x7f62c41444a0 2023-06-23T18:44:46.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.872+0000 7f62c9408700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62c406a0d0 0x7f62c41e2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:46.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.872+0000 7f62c9408700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62c406a0d0 0x7f62c41e2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47314/0 (socket says 172.21.15.52:47314) 2023-06-23T18:44:46.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.872+0000 7f62c9408700 1 -- 172.21.15.52:0/1562792193 learned_addr learned my addr 172.21.15.52:0/1562792193 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:46.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.872+0000 7f62c9c09700 1 --2- 172.21.15.52:0/1562792193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c41444a0 0x7f62c40b9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:46.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.872+0000 7f62c8c07700 1 --2- 172.21.15.52:0/1562792193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c40b5a20 0x7f62c40b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:46.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.872+0000 7f62c9408700 1 -- 172.21.15.52:0/1562792193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c41444a0 msgr2=0x7f62c40b9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:46.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.872+0000 7f62c9408700 1 --2- 172.21.15.52:0/1562792193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c41444a0 0x7f62c40b9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:46.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.872+0000 7f62c9408700 1 -- 172.21.15.52:0/1562792193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c40b5a20 msgr2=0x7f62c40b8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:46.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.872+0000 7f62c9408700 1 --2- 172.21.15.52:0/1562792193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c40b5a20 0x7f62c40b8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:46.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.872+0000 7f62c9408700 1 -- 172.21.15.52:0/1562792193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b4009550 con 0x7f62c406a0d0 2023-06-23T18:44:46.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.872+0000 7f62c9408700 1 --2- 172.21.15.52:0/1562792193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62c406a0d0 0x7f62c41e2f50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f62c000c750 tx=0x7f62c000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:46.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.872+0000 7f62b9ffb700 1 -- 172.21.15.52:0/1562792193 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c0004c80 con 0x7f62c406a0d0 2023-06-23T18:44:46.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.872+0000 7f62b9ffb700 1 -- 172.21.15.52:0/1562792193 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c0004e00 con 0x7f62c406a0d0 2023-06-23T18:44:46.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.872+0000 7f62cb66c700 1 -- 172.21.15.52:0/1562792193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c41d5220 con 0x7f62c406a0d0 2023-06-23T18:44:46.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.872+0000 7f62b9ffb700 1 -- 172.21.15.52:0/1562792193 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c0007310 con 0x7f62c406a0d0 2023-06-23T18:44:46.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.872+0000 7f62cb66c700 1 -- 172.21.15.52:0/1562792193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c41e3bb0 con 0x7f62c406a0d0 2023-06-23T18:44:46.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.873+0000 7f62cb66c700 1 -- 172.21.15.52:0/1562792193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c404e1d0 con 0x7f62c406a0d0 2023-06-23T18:44:46.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.874+0000 7f62b9ffb700 1 -- 172.21.15.52:0/1562792193 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f62c0007470 con 0x7f62c406a0d0 2023-06-23T18:44:46.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.874+0000 7f62b9ffb700 1 --2- 172.21.15.52:0/1562792193 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f62a806ace0 0x7f62a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:46.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.874+0000 7f62b9ffb700 1 -- 172.21.15.52:0/1562792193 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f62c0088ce0 con 0x7f62c406a0d0 2023-06-23T18:44:46.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.874+0000 7f62c8c07700 1 --2- 172.21.15.52:0/1562792193 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f62a806ace0 0x7f62a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:46.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.875+0000 7f62c8c07700 1 --2- 172.21.15.52:0/1562792193 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f62a806ace0 0x7f62a806d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f62b4014040 tx=0x7f62b4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:46.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:46.879+0000 7f62b9ffb700 1 -- 172.21.15.52:0/1562792193 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f62c0054170 con 0x7f62c406a0d0 2023-06-23T18:44:47.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.077+0000 7f62cb66c700 1 -- 172.21.15.52:0/1562792193 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62c41d5b50 con 0x7f62c406a0d0 2023-06-23T18:44:47.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.078+0000 7f62b9ffb700 1 -- 172.21.15.52:0/1562792193 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+14531 (secure 0 0 0) 0x7f62c0057790 con 0x7f62c406a0d0 2023-06-23T18:44:47.083 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:44:47.083 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":17,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","created":"2023-06-23T18:44:31.918434+0000","modified":"2023-06-23T18:44:46.181306+0000","last_up_change":"2023-06-23T18:44:42.169624+0000","last_in_change":"2023-06-23T18:44:34.510501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-23T18:44:43.346578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-23T18:44:43.829719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c371fb28-1b15-4e43-8d5a-43e402920ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6812","nonce":1066999520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6815","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6818","nonce":1066999520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6829","nonce":1066999520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6823","nonce":1066999520}]},"public_addr":"172.21.15.52:6812/1066999520","cluster_addr":"172.21.15.52:6818/1066999520","heartbeat_back_addr":"172.21.15.52:6829/1066999520","heartbeat_front_addr":"172.21.15.52:6823/1066999520","state":["exists","up"]},{"osd":1,"uuid":"4a142f04-33eb-47ec-9cc5-b08b44d82658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6813","nonce":2360219751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6819","nonce":2360219751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6830","nonce":2360219751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6825","nonce":2360219751}]},"public_addr":"172.21.15.52:6813/2360219751","cluster_addr":"172.21.15.52:6819/2360219751","heartbeat_back_addr":"172.21.15.52:6830/2360219751","heartbeat_front_addr":"172.21.15.52:6825/2360219751","state":["exists","up"]},{"osd":2,"uuid":"d7bb089d-4c55-4370-ba59-7fe88c39512a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6801","nonce":835073005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6803","nonce":835073005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6807","nonce":835073005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6805","nonce":835073005}]},"public_addr":"172.21.15.52:6801/835073005","cluster_addr":"172.21.15.52:6803/835073005","heartbeat_back_addr":"172.21.15.52:6807/835073005","heartbeat_front_addr":"172.21.15.52:6805/835073005","state":["exists","up"]},{"osd":3,"uuid":"4bcdcdc3-6a8f-468e-877e-57f76079ac3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6811","nonce":2852700864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6817","nonce":2852700864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6831","nonce":2852700864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6824","nonce":2852700864}]},"public_addr":"172.21.15.52:6811/2852700864","cluster_addr":"172.21.15.52:6817/2852700864","heartbeat_back_addr":"172.21.15.52:6831/2852700864","heartbeat_front_addr":"172.21.15.52:6824/2852700864","state":["exists","up"]},{"osd":4,"uuid":"cac63000-ae94-4b08-93e6-a99119640b63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6809","nonce":2538664679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6811","nonce":2538664679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6815","nonce":2538664679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6813","nonce":2538664679}]},"public_addr":"172.21.15.89:6809/2538664679","cluster_addr":"172.21.15.89:6811/2538664679","heartbeat_back_addr":"172.21.15.89:6815/2538664679","heartbeat_front_addr":"172.21.15.89:6813/2538664679","state":["exists","up"]},{"osd":5,"uuid":"45c53102-18a6-4fd7-9c25-8ea5e1ef6851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6801","nonce":1683710352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6803","nonce":1683710352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6807","nonce":1683710352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6805","nonce":1683710352}]},"public_addr":"172.21.15.89:6801/1683710352","cluster_addr":"172.21.15.89:6803/1683710352","heartbeat_back_addr":"172.21.15.89:6807/1683710352","heartbeat_front_addr":"172.21.15.89:6805/1683710352","state":["exists","up"]},{"osd":6,"uuid":"abee09d1-8eba-484f-a25c-871c1fe2e843","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6817","nonce":3890899288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6819","nonce":3890899288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6823","nonce":3890899288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6821","nonce":3890899288}]},"public_addr":"172.21.15.89:6817/3890899288","cluster_addr":"172.21.15.89:6819/3890899288","heartbeat_back_addr":"172.21.15.89:6823/3890899288","heartbeat_front_addr":"172.21.15.89:6821/3890899288","state":["exists","up"]},{"osd":7,"uuid":"5acf9e2e-00dd-4f9b-a7d9-3d820f695de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6825","nonce":2989085420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6827","nonce":2989085420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6831","nonce":2989085420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6829","nonce":2989085420}]},"public_addr":"172.21.15.89:6825/2989085420","cluster_addr":"172.21.15.89:6827/2989085420","heartbeat_back_addr":"172.21.15.89:6831/2989085420","heartbeat_front_addr":"172.21.15.89:6829/2989085420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.663866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.710904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.619347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.660102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.686933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.724635+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.669111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.678740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:44:47.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.080+0000 7f62cb66c700 1 -- 172.21.15.52:0/1562792193 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f62a806ace0 msgr2=0x7f62a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:47.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.080+0000 7f62cb66c700 1 --2- 172.21.15.52:0/1562792193 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f62a806ace0 0x7f62a806d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f62b4014040 tx=0x7f62b4008030 comp rx=0 tx=0).stop 2023-06-23T18:44:47.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.080+0000 7f62cb66c700 1 -- 172.21.15.52:0/1562792193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62c406a0d0 msgr2=0x7f62c41e2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:47.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.080+0000 7f62cb66c700 1 --2- 172.21.15.52:0/1562792193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62c406a0d0 0x7f62c41e2f50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f62c000c750 tx=0x7f62c000ca60 comp rx=0 tx=0).stop 2023-06-23T18:44:47.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.080+0000 7f62cb66c700 1 -- 172.21.15.52:0/1562792193 shutdown_connections 2023-06-23T18:44:47.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.080+0000 7f62cb66c700 1 --2- 172.21.15.52:0/1562792193 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f62a806ace0 0x7f62a806d190 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.080+0000 7f62cb66c700 1 --2- 172.21.15.52:0/1562792193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c41444a0 0x7f62c40b9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.080+0000 7f62cb66c700 1 --2- 172.21.15.52:0/1562792193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f62c406a0d0 0x7f62c41e2f50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.080+0000 7f62cb66c700 1 --2- 172.21.15.52:0/1562792193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c40b5a20 0x7f62c40b8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.080+0000 7f62cb66c700 1 -- 172.21.15.52:0/1562792193 >> 172.21.15.52:0/1562792193 conn(0x7f62c406bb90 msgr2=0x7f62c4148210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:47.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.080+0000 7f62cb66c700 1 -- 172.21.15.52:0/1562792193 shutdown_connections 2023-06-23T18:44:47.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.080+0000 7f62cb66c700 1 -- 172.21.15.52:0/1562792193 wait complete. 2023-06-23T18:44:47.097 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-23T18:44:43.346578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-23T18:44:43.829719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-23T18:44:47.098 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T18:44:47.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.221+0000 7fa6bccb5700 1 Processor -- start 2023-06-23T18:44:47.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.221+0000 7fa6bccb5700 1 -- start start 2023-06-23T18:44:47.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.222+0000 7fa6bccb5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6b806a510 0x7fa6b806b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:47.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.222+0000 7fa6bccb5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa6b814a650 0x7fa6b8147610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:47.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.222+0000 7fa6bccb5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa6b814aaa0 0x7fa6b8147b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:47.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.222+0000 7fa6bccb5700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b8148090 con 0x7fa6b814a650 2023-06-23T18:44:47.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.222+0000 7fa6bccb5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b806bcf0 con 0x7fa6b814aaa0 2023-06-23T18:44:47.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.222+0000 7fa6bccb5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b80b0e70 con 0x7fa6b806a510 2023-06-23T18:44:47.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.222+0000 7fa6b5d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa6b814a650 0x7fa6b8147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:47.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.222+0000 7fa6b5d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa6b814a650 0x7fa6b8147610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47328/0 (socket says 172.21.15.52:47328) 2023-06-23T18:44:47.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.222+0000 7fa6b5d9b700 1 -- 172.21.15.52:0/1439077003 learned_addr learned my addr 172.21.15.52:0/1439077003 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:47.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.223+0000 7fa6b6d9d700 1 --2- 172.21.15.52:0/1439077003 >> v2:172.21.15.89:3300/0 conn(0x7fa6b814aaa0 0x7fa6b8147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:47.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.223+0000 7fa6b659c700 1 --2- 172.21.15.52:0/1439077003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6b806a510 0x7fa6b806b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:47.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.223+0000 7fa6b5d9b700 1 -- 172.21.15.52:0/1439077003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6b806a510 msgr2=0x7fa6b806b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:47.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.223+0000 7fa6b5d9b700 1 --2- 172.21.15.52:0/1439077003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6b806a510 0x7fa6b806b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.223+0000 7fa6b5d9b700 1 -- 172.21.15.52:0/1439077003 >> v2:172.21.15.89:3300/0 conn(0x7fa6b814aaa0 msgr2=0x7fa6b8147b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:47.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.223+0000 7fa6b5d9b700 1 --2- 172.21.15.52:0/1439077003 >> v2:172.21.15.89:3300/0 conn(0x7fa6b814aaa0 0x7fa6b8147b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.223+0000 7fa6b5d9b700 1 -- 172.21.15.52:0/1439077003 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b806c460 con 0x7fa6b814a650 2023-06-23T18:44:47.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.223+0000 7fa6b5d9b700 1 --2- 172.21.15.52:0/1439077003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6b814a650 0x7fa6b8147610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa6b806a0d0 tx=0x7fa6a8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e443dc66b569e568 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:47.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.223+0000 7fa6b559a700 1 -- 172.21.15.52:0/1439077003 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8011830 con 0x7fa6b814a650 2023-06-23T18:44:47.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.223+0000 7fa6b559a700 1 -- 172.21.15.52:0/1439077003 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a8011990 con 0x7fa6b814a650 2023-06-23T18:44:47.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.223+0000 7fa6b559a700 1 -- 172.21.15.52:0/1439077003 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8011d20 con 0x7fa6b814a650 2023-06-23T18:44:47.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.224+0000 7fa6bccb5700 1 -- 172.21.15.52:0/1439077003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6b814a650 msgr2=0x7fa6b8147610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:47.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.224+0000 7fa6bccb5700 1 --2- 172.21.15.52:0/1439077003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6b814a650 0x7fa6b8147610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa6b806a0d0 tx=0x7fa6a8009bd0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.224+0000 7fa6bccb5700 1 -- 172.21.15.52:0/1439077003 shutdown_connections 2023-06-23T18:44:47.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.224+0000 7fa6bccb5700 1 --2- 172.21.15.52:0/1439077003 >> v2:172.21.15.89:3300/0 conn(0x7fa6b814aaa0 0x7fa6b8147b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.224+0000 7fa6bccb5700 1 --2- 172.21.15.52:0/1439077003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6b806a510 0x7fa6b806b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.224+0000 7fa6bccb5700 1 --2- 172.21.15.52:0/1439077003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6b814a650 0x7fa6b8147610 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.224+0000 7fa6bccb5700 1 -- 172.21.15.52:0/1439077003 >> 172.21.15.52:0/1439077003 conn(0x7fa6b80bd3d0 msgr2=0x7fa6b80bd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:47.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.224+0000 7fa6bccb5700 1 -- 172.21.15.52:0/1439077003 shutdown_connections 2023-06-23T18:44:47.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.224+0000 7fa6bccb5700 1 -- 172.21.15.52:0/1439077003 wait complete. 2023-06-23T18:44:47.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.225+0000 7fa6bccb5700 1 Processor -- start 2023-06-23T18:44:47.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.225+0000 7fa6bccb5700 1 -- start start 2023-06-23T18:44:47.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.226+0000 7fa6bccb5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6b806a510 0x7fa6b81e3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:47.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.226+0000 7fa6bccb5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6b814a650 0x7fa6b81d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:47.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.226+0000 7fa6bccb5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6b814aaa0 0x7fa6b81e0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:47.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.226+0000 7fa6bccb5700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b81d0e10 con 0x7fa6b814a650 2023-06-23T18:44:47.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.226+0000 7fa6bccb5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b81e3ab0 con 0x7fa6b814aaa0 2023-06-23T18:44:47.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.226+0000 7fa6bccb5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b81e3d90 con 0x7fa6b806a510 2023-06-23T18:44:47.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.226+0000 7fa6b5d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6b814a650 0x7fa6b81d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:47.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.226+0000 7fa6b5d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6b814a650 0x7fa6b81d08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47336/0 (socket says 172.21.15.52:47336) 2023-06-23T18:44:47.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.226+0000 7fa6b5d9b700 1 -- 172.21.15.52:0/389119673 learned_addr learned my addr 172.21.15.52:0/389119673 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:47.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.226+0000 7fa6b6d9d700 1 --2- 172.21.15.52:0/389119673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6b814aaa0 0x7fa6b81e0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:47.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.226+0000 7fa6b659c700 1 --2- 172.21.15.52:0/389119673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6b806a510 0x7fa6b81e3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:47.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.226+0000 7fa6b5d9b700 1 -- 172.21.15.52:0/389119673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6b806a510 msgr2=0x7fa6b81e3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:47.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.226+0000 7fa6b5d9b700 1 --2- 172.21.15.52:0/389119673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6b806a510 0x7fa6b81e3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.226+0000 7fa6b5d9b700 1 -- 172.21.15.52:0/389119673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6b814aaa0 msgr2=0x7fa6b81e0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:47.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.226+0000 7fa6b5d9b700 1 --2- 172.21.15.52:0/389119673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6b814aaa0 0x7fa6b81e0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.226+0000 7fa6b5d9b700 1 -- 172.21.15.52:0/389119673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a8009550 con 0x7fa6b814a650 2023-06-23T18:44:47.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.226+0000 7fa6b5d9b700 1 --2- 172.21.15.52:0/389119673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6b814a650 0x7fa6b81d08d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8000c00 tx=0x7fa6a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:47.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.226+0000 7fa6a6ffd700 1 -- 172.21.15.52:0/389119673 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8004240 con 0x7fa6b814a650 2023-06-23T18:44:47.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.226+0000 7fa6a6ffd700 1 -- 172.21.15.52:0/389119673 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a801f070 con 0x7fa6b814a650 2023-06-23T18:44:47.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.226+0000 7fa6bccb5700 1 -- 172.21.15.52:0/389119673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b80b8d00 con 0x7fa6b814a650 2023-06-23T18:44:47.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.226+0000 7fa6a6ffd700 1 -- 172.21.15.52:0/389119673 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a80036a0 con 0x7fa6b814a650 2023-06-23T18:44:47.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.226+0000 7fa6bccb5700 1 -- 172.21.15.52:0/389119673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b81dfd60 con 0x7fa6b814a650 2023-06-23T18:44:47.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.227+0000 7fa6bccb5700 1 -- 172.21.15.52:0/389119673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b804e1d0 con 0x7fa6b814a650 2023-06-23T18:44:47.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.228+0000 7fa6a6ffd700 1 -- 172.21.15.52:0/389119673 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa6a8021030 con 0x7fa6b814a650 2023-06-23T18:44:47.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.229+0000 7fa6a6ffd700 1 --2- 172.21.15.52:0/389119673 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa69806ace0 0x7fa69806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:47.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.229+0000 7fa6a6ffd700 1 -- 172.21.15.52:0/389119673 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa6a808a600 con 0x7fa6b814a650 2023-06-23T18:44:47.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.229+0000 7fa6b659c700 1 --2- 172.21.15.52:0/389119673 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa69806ace0 0x7fa69806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:47.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.230+0000 7fa6b659c700 1 --2- 172.21.15.52:0/389119673 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa69806ace0 0x7fa69806d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac009be0 tx=0x7fa6ac009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:47.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.233+0000 7fa6a6ffd700 1 -- 172.21.15.52:0/389119673 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa6a8055a70 con 0x7fa6b814a650 2023-06-23T18:44:47.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.431+0000 7fa6bccb5700 1 -- 172.21.15.52:0/389119673 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa6b80b7790 con 0x7fa6b814a650 2023-06-23T18:44:47.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.431+0000 7fa6a6ffd700 1 -- 172.21.15.52:0/389119673 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa6a8015020 con 0x7fa6b814a650 2023-06-23T18:44:47.437 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-06-23T18:44:47.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.433+0000 7fa6bccb5700 1 -- 172.21.15.52:0/389119673 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa69806ace0 msgr2=0x7fa69806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:47.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.433+0000 7fa6bccb5700 1 --2- 172.21.15.52:0/389119673 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa69806ace0 0x7fa69806d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac009be0 tx=0x7fa6ac009210 comp rx=0 tx=0).stop 2023-06-23T18:44:47.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.433+0000 7fa6bccb5700 1 -- 172.21.15.52:0/389119673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6b814a650 msgr2=0x7fa6b81d08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:47.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.433+0000 7fa6bccb5700 1 --2- 172.21.15.52:0/389119673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6b814a650 0x7fa6b81d08d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8000c00 tx=0x7fa6a8004750 comp rx=0 tx=0).stop 2023-06-23T18:44:47.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.433+0000 7fa6bccb5700 1 -- 172.21.15.52:0/389119673 shutdown_connections 2023-06-23T18:44:47.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.433+0000 7fa6bccb5700 1 --2- 172.21.15.52:0/389119673 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa69806ace0 0x7fa69806d190 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.433+0000 7fa6bccb5700 1 --2- 172.21.15.52:0/389119673 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6b814aaa0 0x7fa6b81e0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.433+0000 7fa6bccb5700 1 --2- 172.21.15.52:0/389119673 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6b806a510 0x7fa6b81e3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.433+0000 7fa6bccb5700 1 --2- 172.21.15.52:0/389119673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6b814a650 0x7fa6b81d08d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.433+0000 7fa6bccb5700 1 -- 172.21.15.52:0/389119673 >> 172.21.15.52:0/389119673 conn(0x7fa6b80bd3d0 msgr2=0x7fa6b8146aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:47.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.433+0000 7fa6bccb5700 1 -- 172.21.15.52:0/389119673 shutdown_connections 2023-06-23T18:44:47.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.433+0000 7fa6bccb5700 1 -- 172.21.15.52:0/389119673 wait complete. 2023-06-23T18:44:47.450 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T18:44:47.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.574+0000 7f2f5a057700 1 Processor -- start 2023-06-23T18:44:47.579 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.574+0000 7f2f5a057700 1 -- start start 2023-06-23T18:44:47.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.575+0000 7f2f5a057700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2f5414a600 0x7f2f540bb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:47.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.575+0000 7f2f5a057700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f540b59b0 0x7f2f540bb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:47.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.575+0000 7f2f5a057700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f540be040 con 0x7f2f540b6870 2023-06-23T18:44:47.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.575+0000 7f2f5a057700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f5414aae0 con 0x7f2f5414a600 2023-06-23T18:44:47.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.575+0000 7f2f5a057700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5414adc0 con 0x7f2f540b59b0 2023-06-23T18:44:47.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.575+0000 7f2f4bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2f5414a600 0x7f2f540bb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:47.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.575+0000 7f2f537fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2f540b6870 0x7f2f54144480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48448/0 (socket says 172.21.15.52:48448) 2023-06-23T18:44:47.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.575+0000 7f2f537fe700 1 -- 172.21.15.52:0/1388433129 learned_addr learned my addr 172.21.15.52:0/1388433129 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:47.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.575+0000 7f2f53fff700 1 --2- 172.21.15.52:0/1388433129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f540b59b0 0x7f2f540bb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:47.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.575+0000 7f2f4bfff700 1 -- 172.21.15.52:0/1388433129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f540b59b0 msgr2=0x7f2f540bb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:47.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.575+0000 7f2f4bfff700 1 --2- 172.21.15.52:0/1388433129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f540b59b0 0x7f2f540bb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.575+0000 7f2f4bfff700 1 -- 172.21.15.52:0/1388433129 >> v1:172.21.15.52:6789/0 conn(0x7f2f540b6870 legacy=0x7f2f54144480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:47.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.575+0000 7f2f52ffd700 1 -- 172.21.15.52:0/1388433129 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598102200 0 0) 0x7f2f540be040 con 0x7f2f540b6870 2023-06-23T18:44:47.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.575+0000 7f2f4bfff700 1 -- 172.21.15.52:0/1388433129 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5414b0a0 con 0x7f2f5414a600 2023-06-23T18:44:47.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.575+0000 7f2f4bfff700 1 --2- 172.21.15.52:0/1388433129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f5414a600 0x7f2f540bb1f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c009840 tx=0x7f2f3c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b45520adb3faa6 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:47.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.575+0000 7f2f52ffd700 1 -- 172.21.15.52:0/1388433129 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c011830 con 0x7f2f5414a600 2023-06-23T18:44:47.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.575+0000 7f2f52ffd700 1 -- 172.21.15.52:0/1388433129 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3c011990 con 0x7f2f5414a600 2023-06-23T18:44:47.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.575+0000 7f2f52ffd700 1 -- 172.21.15.52:0/1388433129 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c011d20 con 0x7f2f5414a600 2023-06-23T18:44:47.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.576+0000 7f2f5a057700 1 -- 172.21.15.52:0/1388433129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f5414a600 msgr2=0x7f2f540bb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:47.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.576+0000 7f2f5a057700 1 --2- 172.21.15.52:0/1388433129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f5414a600 0x7f2f540bb1f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c009840 tx=0x7f2f3c009b50 comp rx=0 tx=0).stop 2023-06-23T18:44:47.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.576+0000 7f2f5a057700 1 -- 172.21.15.52:0/1388433129 shutdown_connections 2023-06-23T18:44:47.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.576+0000 7f2f5a057700 1 --2- 172.21.15.52:0/1388433129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f540b59b0 0x7f2f540bb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.576+0000 7f2f5a057700 1 --2- 172.21.15.52:0/1388433129 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f5414a600 0x7f2f540bb1f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.576+0000 7f2f5a057700 1 -- 172.21.15.52:0/1388433129 >> 172.21.15.52:0/1388433129 conn(0x7f2f540bd140 msgr2=0x7f2f540bd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:47.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.576+0000 7f2f5a057700 1 -- 172.21.15.52:0/1388433129 shutdown_connections 2023-06-23T18:44:47.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.576+0000 7f2f5a057700 1 -- 172.21.15.52:0/1388433129 wait complete. 2023-06-23T18:44:47.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.577+0000 7f2f5a057700 1 Processor -- start 2023-06-23T18:44:47.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.577+0000 7f2f5a057700 1 -- start start 2023-06-23T18:44:47.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.578+0000 7f2f5a057700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f540b59b0 0x7f2f54147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:47.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.578+0000 7f2f5a057700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f540b6870 0x7f2f54147040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:47.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.578+0000 7f2f5a057700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f5414a600 0x7f2f54145930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:47.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.578+0000 7f2f5a057700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f54147580 con 0x7f2f540b6870 2023-06-23T18:44:47.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.578+0000 7f2f5a057700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f541e0390 con 0x7f2f5414a600 2023-06-23T18:44:47.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.578+0000 7f2f5a057700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f541e0670 con 0x7f2f540b59b0 2023-06-23T18:44:47.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.578+0000 7f2f4bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f540b6870 0x7f2f54147040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:47.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.578+0000 7f2f4bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f540b6870 0x7f2f54147040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47344/0 (socket says 172.21.15.52:47344) 2023-06-23T18:44:47.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.578+0000 7f2f4bfff700 1 -- 172.21.15.52:0/2589497260 learned_addr learned my addr 172.21.15.52:0/2589497260 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:47.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.578+0000 7f2f537fe700 1 --2- 172.21.15.52:0/2589497260 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f540b59b0 0x7f2f54147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:47.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.578+0000 7f2f4bfff700 1 -- 172.21.15.52:0/2589497260 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f540b59b0 msgr2=0x7f2f54147b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:47.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.578+0000 7f2f4bfff700 1 --2- 172.21.15.52:0/2589497260 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f540b59b0 0x7f2f54147b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.578+0000 7f2f4bfff700 1 -- 172.21.15.52:0/2589497260 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f5414a600 msgr2=0x7f2f54145930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:47.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.578+0000 7f2f4bfff700 1 --2- 172.21.15.52:0/2589497260 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f5414a600 0x7f2f54145930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.578+0000 7f2f4bfff700 1 -- 172.21.15.52:0/2589497260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3c0094a0 con 0x7f2f540b6870 2023-06-23T18:44:47.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.578+0000 7f2f4bfff700 1 --2- 172.21.15.52:0/2589497260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f540b6870 0x7f2f54147040 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0090b0 tx=0x7f2f3c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:47.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.579+0000 7f2f50ff9700 1 -- 172.21.15.52:0/2589497260 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c0038a0 con 0x7f2f540b6870 2023-06-23T18:44:47.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.579+0000 7f2f50ff9700 1 -- 172.21.15.52:0/2589497260 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3c01f070 con 0x7f2f540b6870 2023-06-23T18:44:47.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.579+0000 7f2f5a057700 1 -- 172.21.15.52:0/2589497260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f541e0950 con 0x7f2f540b6870 2023-06-23T18:44:47.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.579+0000 7f2f50ff9700 1 -- 172.21.15.52:0/2589497260 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c003c20 con 0x7f2f540b6870 2023-06-23T18:44:47.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.579+0000 7f2f5a057700 1 -- 172.21.15.52:0/2589497260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f541e0f10 con 0x7f2f540b6870 2023-06-23T18:44:47.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.580+0000 7f2f5a057700 1 -- 172.21.15.52:0/2589497260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f541e10a0 con 0x7f2f540b6870 2023-06-23T18:44:47.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.580+0000 7f2f50ff9700 1 -- 172.21.15.52:0/2589497260 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2f3c01a430 con 0x7f2f540b6870 2023-06-23T18:44:47.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.581+0000 7f2f50ff9700 1 --2- 172.21.15.52:0/2589497260 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2f3406ace0 0x7f2f3406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:47.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.581+0000 7f2f50ff9700 1 -- 172.21.15.52:0/2589497260 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2f3c021070 con 0x7f2f540b6870 2023-06-23T18:44:47.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.581+0000 7f2f537fe700 1 --2- 172.21.15.52:0/2589497260 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2f3406ace0 0x7f2f3406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:47.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.581+0000 7f2f537fe700 1 --2- 172.21.15.52:0/2589497260 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2f3406ace0 0x7f2f3406d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2f44000f60 tx=0x7f2f44009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:47.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.585+0000 7f2f50ff9700 1 -- 172.21.15.52:0/2589497260 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2f3c055f90 con 0x7f2f540b6870 2023-06-23T18:44:47.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.783+0000 7f2f5a057700 1 -- 172.21.15.52:0/2589497260 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2f5404e1d0 con 0x7f2f540b6870 2023-06-23T18:44:47.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.783+0000 7f2f50ff9700 1 -- 172.21.15.52:0/2589497260 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2f3c0150a0 con 0x7f2f540b6870 2023-06-23T18:44:47.789 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-06-23T18:44:47.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.785+0000 7f2f5a057700 1 -- 172.21.15.52:0/2589497260 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2f3406ace0 msgr2=0x7f2f3406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:47.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.785+0000 7f2f5a057700 1 --2- 172.21.15.52:0/2589497260 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2f3406ace0 0x7f2f3406d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2f44000f60 tx=0x7f2f44009040 comp rx=0 tx=0).stop 2023-06-23T18:44:47.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.786+0000 7f2f5a057700 1 -- 172.21.15.52:0/2589497260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f540b6870 msgr2=0x7f2f54147040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:47.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.786+0000 7f2f5a057700 1 --2- 172.21.15.52:0/2589497260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f540b6870 0x7f2f54147040 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0090b0 tx=0x7f2f3c004750 comp rx=0 tx=0).stop 2023-06-23T18:44:47.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.786+0000 7f2f5a057700 1 -- 172.21.15.52:0/2589497260 shutdown_connections 2023-06-23T18:44:47.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.786+0000 7f2f5a057700 1 --2- 172.21.15.52:0/2589497260 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2f3406ace0 0x7f2f3406d190 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.786+0000 7f2f5a057700 1 --2- 172.21.15.52:0/2589497260 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f5414a600 0x7f2f54145930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.786+0000 7f2f5a057700 1 --2- 172.21.15.52:0/2589497260 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f540b59b0 0x7f2f54147b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.786+0000 7f2f5a057700 1 --2- 172.21.15.52:0/2589497260 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f540b6870 0x7f2f54147040 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.786+0000 7f2f5a057700 1 -- 172.21.15.52:0/2589497260 >> 172.21.15.52:0/2589497260 conn(0x7f2f540bd140 msgr2=0x7f2f54141de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:47.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.786+0000 7f2f5a057700 1 -- 172.21.15.52:0/2589497260 shutdown_connections 2023-06-23T18:44:47.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.786+0000 7f2f5a057700 1 -- 172.21.15.52:0/2589497260 wait complete. 2023-06-23T18:44:47.802 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-23T18:44:47.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.923+0000 7fdc60610700 1 Processor -- start 2023-06-23T18:44:47.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.923+0000 7fdc60610700 1 -- start start 2023-06-23T18:44:47.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.924+0000 7fdc60610700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdc5806b0e0 0x7fdc58140810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:47.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.924+0000 7fdc60610700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc58140d50 0x7fdc58149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:47.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.924+0000 7fdc60610700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc580701a0 con 0x7fdc5814a310 2023-06-23T18:44:47.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.924+0000 7fdc60610700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc58071540 con 0x7fdc5806b0e0 2023-06-23T18:44:47.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.924+0000 7fdc60610700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc580b8f00 con 0x7fdc58140d50 2023-06-23T18:44:47.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.924+0000 7fdc5e3ac700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdc5806b0e0 0x7fdc58140810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:47.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.924+0000 7fdc5dbab700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc58140d50 0x7fdc58149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:47.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.924+0000 7fdc5ebad700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fdc5814a310 0x7fdc580b7380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.52:46024/0 (socket says 172.21.15.52:46024) 2023-06-23T18:44:47.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.924+0000 7fdc5ebad700 1 -- 172.21.15.52:0/2308140666 learned_addr learned my addr 172.21.15.52:0/2308140666 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:47.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.924+0000 7fdc5d3aa700 1 -- 172.21.15.52:0/2308140666 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 254448246 0 0) 0x7fdc580701a0 con 0x7fdc5814a310 2023-06-23T18:44:47.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.924+0000 7fdc5e3ac700 1 -- 172.21.15.52:0/2308140666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc58140d50 msgr2=0x7fdc58149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:47.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.924+0000 7fdc5e3ac700 1 --2- 172.21.15.52:0/2308140666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc58140d50 0x7fdc58149dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.924+0000 7fdc5e3ac700 1 -- 172.21.15.52:0/2308140666 >> v1:172.21.15.89:6789/0 conn(0x7fdc5814a310 legacy=0x7fdc580b7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:47.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.924+0000 7fdc5e3ac700 1 -- 172.21.15.52:0/2308140666 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc580b91e0 con 0x7fdc5806b0e0 2023-06-23T18:44:47.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.924+0000 7fdc5dbab700 1 --2- 172.21.15.52:0/2308140666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc58140d50 0x7fdc58149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:47.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.925+0000 7fdc5e3ac700 1 --2- 172.21.15.52:0/2308140666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc5806b0e0 0x7fdc58140810 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdc54009840 tx=0x7fdc54009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5945a3e0f0fee435 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:47.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.925+0000 7fdc5d3aa700 1 -- 172.21.15.52:0/2308140666 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc54011830 con 0x7fdc5806b0e0 2023-06-23T18:44:47.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.925+0000 7fdc5d3aa700 1 -- 172.21.15.52:0/2308140666 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc54011990 con 0x7fdc5806b0e0 2023-06-23T18:44:47.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.925+0000 7fdc5d3aa700 1 -- 172.21.15.52:0/2308140666 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc54011d20 con 0x7fdc5806b0e0 2023-06-23T18:44:47.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.925+0000 7fdc60610700 1 -- 172.21.15.52:0/2308140666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc5806b0e0 msgr2=0x7fdc58140810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:47.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.925+0000 7fdc60610700 1 --2- 172.21.15.52:0/2308140666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc5806b0e0 0x7fdc58140810 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdc54009840 tx=0x7fdc54009b50 comp rx=0 tx=0).stop 2023-06-23T18:44:47.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.925+0000 7fdc60610700 1 -- 172.21.15.52:0/2308140666 shutdown_connections 2023-06-23T18:44:47.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.925+0000 7fdc60610700 1 --2- 172.21.15.52:0/2308140666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc5806b0e0 0x7fdc58140810 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.925+0000 7fdc60610700 1 --2- 172.21.15.52:0/2308140666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc58140d50 0x7fdc58149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.925+0000 7fdc60610700 1 -- 172.21.15.52:0/2308140666 >> 172.21.15.52:0/2308140666 conn(0x7fdc580bd690 msgr2=0x7fdc580b9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:47.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.925+0000 7fdc60610700 1 -- 172.21.15.52:0/2308140666 shutdown_connections 2023-06-23T18:44:47.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.925+0000 7fdc60610700 1 -- 172.21.15.52:0/2308140666 wait complete. 2023-06-23T18:44:47.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.926+0000 7fdc60610700 1 Processor -- start 2023-06-23T18:44:47.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.927+0000 7fdc60610700 1 -- start start 2023-06-23T18:44:47.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.927+0000 7fdc60610700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc5806b0e0 0x7fdc581e3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:47.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.927+0000 7fdc60610700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc5814a310 0x7fdc581415e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:47.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.927+0000 7fdc60610700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc580b54f0 0x7fdc58134040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:47.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.927+0000 7fdc60610700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc580b5970 con 0x7fdc5806b0e0 2023-06-23T18:44:47.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.927+0000 7fdc60610700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc58143620 con 0x7fdc580b54f0 2023-06-23T18:44:47.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.927+0000 7fdc60610700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc581e3120 con 0x7fdc5814a310 2023-06-23T18:44:47.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.927+0000 7fdc5e3ac700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc5806b0e0 0x7fdc581e3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:47.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.927+0000 7fdc5e3ac700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc5806b0e0 0x7fdc581e3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47350/0 (socket says 172.21.15.52:47350) 2023-06-23T18:44:47.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.927+0000 7fdc5e3ac700 1 -- 172.21.15.52:0/2776116604 learned_addr learned my addr 172.21.15.52:0/2776116604 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:47.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.927+0000 7fdc5ebad700 1 --2- 172.21.15.52:0/2776116604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc580b54f0 0x7fdc58134040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:47.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.927+0000 7fdc5dbab700 1 --2- 172.21.15.52:0/2776116604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc5814a310 0x7fdc581415e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:47.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.928+0000 7fdc5e3ac700 1 -- 172.21.15.52:0/2776116604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc5814a310 msgr2=0x7fdc581415e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:47.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.928+0000 7fdc5e3ac700 1 --2- 172.21.15.52:0/2776116604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc5814a310 0x7fdc581415e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.928+0000 7fdc5e3ac700 1 -- 172.21.15.52:0/2776116604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc580b54f0 msgr2=0x7fdc58134040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:47.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.928+0000 7fdc5e3ac700 1 --2- 172.21.15.52:0/2776116604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc580b54f0 0x7fdc58134040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:47.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.928+0000 7fdc5e3ac700 1 -- 172.21.15.52:0/2776116604 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc480094a0 con 0x7fdc5806b0e0 2023-06-23T18:44:47.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.928+0000 7fdc5ebad700 1 --2- 172.21.15.52:0/2776116604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc580b54f0 0x7fdc58134040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:44:47.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.928+0000 7fdc5dbab700 1 --2- 172.21.15.52:0/2776116604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc5814a310 0x7fdc581415e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:44:47.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.928+0000 7fdc5e3ac700 1 --2- 172.21.15.52:0/2776116604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc5806b0e0 0x7fdc581e3c00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdc54009fd0 tx=0x7fdc54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:47.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.928+0000 7fdc4effd700 1 -- 172.21.15.52:0/2776116604 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc540038a0 con 0x7fdc5806b0e0 2023-06-23T18:44:47.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.928+0000 7fdc4effd700 1 -- 172.21.15.52:0/2776116604 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5401f070 con 0x7fdc5806b0e0 2023-06-23T18:44:47.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.928+0000 7fdc60610700 1 -- 172.21.15.52:0/2776116604 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc540094a0 con 0x7fdc5806b0e0 2023-06-23T18:44:47.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.928+0000 7fdc4effd700 1 -- 172.21.15.52:0/2776116604 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc54003c40 con 0x7fdc5806b0e0 2023-06-23T18:44:47.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.928+0000 7fdc60610700 1 -- 172.21.15.52:0/2776116604 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc581e36e0 con 0x7fdc5806b0e0 2023-06-23T18:44:47.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.929+0000 7fdc60610700 1 -- 172.21.15.52:0/2776116604 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc581e3a50 con 0x7fdc5806b0e0 2023-06-23T18:44:47.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.929+0000 7fdc4effd700 1 -- 172.21.15.52:0/2776116604 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdc54026480 con 0x7fdc5806b0e0 2023-06-23T18:44:47.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.930+0000 7fdc4effd700 1 --2- 172.21.15.52:0/2776116604 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdc3c06ace0 0x7fdc3c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:47.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.930+0000 7fdc4effd700 1 -- 172.21.15.52:0/2776116604 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdc54021070 con 0x7fdc5806b0e0 2023-06-23T18:44:47.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.930+0000 7fdc5dbab700 1 --2- 172.21.15.52:0/2776116604 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdc3c06ace0 0x7fdc3c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:47.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.930+0000 7fdc5dbab700 1 --2- 172.21.15.52:0/2776116604 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdc3c06ace0 0x7fdc3c06d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdc580b7230 tx=0x7fdc48008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:47.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:47.934+0000 7fdc4effd700 1 -- 172.21.15.52:0/2776116604 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdc54055f00 con 0x7fdc5806b0e0 2023-06-23T18:44:48.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.131+0000 7fdc60610700 1 -- 172.21.15.52:0/2776116604 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdc5806e650 con 0x7fdc5806b0e0 2023-06-23T18:44:48.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.132+0000 7fdc4effd700 1 -- 172.21.15.52:0/2776116604 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7fdc5402b090 con 0x7fdc5806b0e0 2023-06-23T18:44:48.137 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:44:48.138 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2023-06-23T18:44:48.138 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-06-23T18:44:48.138 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2023-06-23T18:44:48.139 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": "rbd" 2023-06-23T18:44:48.139 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-06-23T18:44:48.139 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-06-23T18:44:48.139 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 2, 2023-06-23T18:44:48.140 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2023-06-23T18:44:48.140 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-06-23T18:44:48.140 INFO:teuthology.orchestra.run.smithi052.stdout:] 2023-06-23T18:44:48.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.134+0000 7fdc60610700 1 -- 172.21.15.52:0/2776116604 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdc3c06ace0 msgr2=0x7fdc3c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:48.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.134+0000 7fdc60610700 1 --2- 172.21.15.52:0/2776116604 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdc3c06ace0 0x7fdc3c06d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdc580b7230 tx=0x7fdc48008040 comp rx=0 tx=0).stop 2023-06-23T18:44:48.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.134+0000 7fdc60610700 1 -- 172.21.15.52:0/2776116604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc5806b0e0 msgr2=0x7fdc581e3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:48.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.134+0000 7fdc60610700 1 --2- 172.21.15.52:0/2776116604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc5806b0e0 0x7fdc581e3c00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdc54009fd0 tx=0x7fdc54004750 comp rx=0 tx=0).stop 2023-06-23T18:44:48.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.134+0000 7fdc60610700 1 -- 172.21.15.52:0/2776116604 shutdown_connections 2023-06-23T18:44:48.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.134+0000 7fdc60610700 1 --2- 172.21.15.52:0/2776116604 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdc3c06ace0 0x7fdc3c06d190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:48.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.134+0000 7fdc60610700 1 --2- 172.21.15.52:0/2776116604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc580b54f0 0x7fdc58134040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:48.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.134+0000 7fdc60610700 1 --2- 172.21.15.52:0/2776116604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc5806b0e0 0x7fdc581e3c00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:48.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.134+0000 7fdc60610700 1 --2- 172.21.15.52:0/2776116604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc5814a310 0x7fdc581415e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:48.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.134+0000 7fdc60610700 1 -- 172.21.15.52:0/2776116604 >> 172.21.15.52:0/2776116604 conn(0x7fdc580bd690 msgr2=0x7fdc58137040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:48.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.134+0000 7fdc60610700 1 -- 172.21.15.52:0/2776116604 shutdown_connections 2023-06-23T18:44:48.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.134+0000 7fdc60610700 1 -- 172.21.15.52:0/2776116604 wait complete. 2023-06-23T18:44:48.151 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-23T18:44:48.152 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-23T18:44:48.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.278+0000 7f7b2e82d700 1 Processor -- start 2023-06-23T18:44:48.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.278+0000 7f7b2e82d700 1 -- start start 2023-06-23T18:44:48.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.279+0000 7f7b2e82d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7b2806b0e0 0x7f7b2806fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:48.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.279+0000 7f7b2e82d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b28070930 0x7f7b280b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:48.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.279+0000 7f7b2e82d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b280b6fe0 con 0x7f7b280afe00 2023-06-23T18:44:48.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.279+0000 7f7b2e82d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b28071c00 con 0x7f7b2806b0e0 2023-06-23T18:44:48.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.279+0000 7f7b2e82d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280b6a20 con 0x7f7b28070930 2023-06-23T18:44:48.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.279+0000 7f7b277fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b28070930 0x7f7b280b73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:48.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.279+0000 7f7b27fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7b2806b0e0 0x7f7b2806fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:48.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.279+0000 7f7b27fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7b2806b0e0 0x7f7b2806fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.52:60350/0 (socket says 172.21.15.52:60350) 2023-06-23T18:44:48.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.279+0000 7f7b277fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b28070930 0x7f7b280b73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.52:51538/0 (socket says 172.21.15.52:51538) 2023-06-23T18:44:48.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.279+0000 7f7b2cdca700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7b280afe00 0x7f7b2814de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.52:46026/0 (socket says 172.21.15.52:46026) 2023-06-23T18:44:48.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.279+0000 7f7b27fff700 1 -- 172.21.15.52:0/3243620934 learned_addr learned my addr 172.21.15.52:0/3243620934 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:48.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.280+0000 7f7b27fff700 1 -- 172.21.15.52:0/3243620934 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b28070930 msgr2=0x7f7b280b73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:48.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.280+0000 7f7b27fff700 1 --2- 172.21.15.52:0/3243620934 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b28070930 0x7f7b280b73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:48.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.280+0000 7f7b27fff700 1 -- 172.21.15.52:0/3243620934 >> v1:172.21.15.89:6789/0 conn(0x7f7b280afe00 legacy=0x7f7b2814de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:48.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.280+0000 7f7b27fff700 1 -- 172.21.15.52:0/3243620934 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b280b6d00 con 0x7f7b2806b0e0 2023-06-23T18:44:48.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.280+0000 7f7b277fe700 1 --2- 172.21.15.52:0/3243620934 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b28070930 0x7f7b280b73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:48.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.280+0000 7f7b27fff700 1 --2- 172.21.15.52:0/3243620934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b2806b0e0 0x7f7b2806fab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7b180098f0 tx=0x7f7b18009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bbb9633821830ac server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:48.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.280+0000 7f7b26ffd700 1 -- 172.21.15.52:0/3243620934 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b18011830 con 0x7f7b2806b0e0 2023-06-23T18:44:48.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.280+0000 7f7b26ffd700 1 -- 172.21.15.52:0/3243620934 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b18011990 con 0x7f7b2806b0e0 2023-06-23T18:44:48.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.280+0000 7f7b26ffd700 1 -- 172.21.15.52:0/3243620934 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b18011d20 con 0x7f7b2806b0e0 2023-06-23T18:44:48.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.281+0000 7f7b2e82d700 1 -- 172.21.15.52:0/3243620934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b2806b0e0 msgr2=0x7f7b2806fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:48.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.281+0000 7f7b2e82d700 1 --2- 172.21.15.52:0/3243620934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b2806b0e0 0x7f7b2806fab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7b180098f0 tx=0x7f7b18009c00 comp rx=0 tx=0).stop 2023-06-23T18:44:48.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.281+0000 7f7b2e82d700 1 -- 172.21.15.52:0/3243620934 shutdown_connections 2023-06-23T18:44:48.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.281+0000 7f7b2e82d700 1 --2- 172.21.15.52:0/3243620934 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b2806b0e0 0x7f7b2806fab0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:48.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.281+0000 7f7b2e82d700 1 --2- 172.21.15.52:0/3243620934 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b28070930 0x7f7b280b73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:48.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.281+0000 7f7b2e82d700 1 -- 172.21.15.52:0/3243620934 >> 172.21.15.52:0/3243620934 conn(0x7f7b280b95c0 msgr2=0x7f7b280b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:48.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.281+0000 7f7b2e82d700 1 -- 172.21.15.52:0/3243620934 shutdown_connections 2023-06-23T18:44:48.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.281+0000 7f7b2e82d700 1 -- 172.21.15.52:0/3243620934 wait complete. 2023-06-23T18:44:48.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.282+0000 7f7b2e82d700 1 Processor -- start 2023-06-23T18:44:48.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.282+0000 7f7b2e82d700 1 -- start start 2023-06-23T18:44:48.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.282+0000 7f7b2e82d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b2806b0e0 0x7f7b280b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:48.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.282+0000 7f7b2e82d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b28070930 0x7f7b280ae830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:48.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.283+0000 7f7b2e82d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b280afe00 0x7f7b280b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:48.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.283+0000 7f7b2e82d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280aed70 con 0x7f7b280afe00 2023-06-23T18:44:48.290 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.283+0000 7f7b2e82d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280b3850 con 0x7f7b2806b0e0 2023-06-23T18:44:48.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.283+0000 7f7b2e82d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b28146e60 con 0x7f7b28070930 2023-06-23T18:44:48.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.283+0000 7f7b2cdca700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b280afe00 0x7f7b280b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:48.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.283+0000 7f7b27fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b2806b0e0 0x7f7b280b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:48.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.283+0000 7f7b2cdca700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b280afe00 0x7f7b280b3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47354/0 (socket says 172.21.15.52:47354) 2023-06-23T18:44:48.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.283+0000 7f7b27fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b2806b0e0 0x7f7b280b4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.52:60364/0 (socket says 172.21.15.52:60364) 2023-06-23T18:44:48.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.283+0000 7f7b2cdca700 1 -- 172.21.15.52:0/1244562926 learned_addr learned my addr 172.21.15.52:0/1244562926 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:48.291 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.283+0000 7f7b277fe700 1 --2- 172.21.15.52:0/1244562926 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b28070930 0x7f7b280ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:48.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.283+0000 7f7b2cdca700 1 -- 172.21.15.52:0/1244562926 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b28070930 msgr2=0x7f7b280ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:48.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.283+0000 7f7b2cdca700 1 --2- 172.21.15.52:0/1244562926 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b28070930 0x7f7b280ae830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:48.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.283+0000 7f7b2cdca700 1 -- 172.21.15.52:0/1244562926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b2806b0e0 msgr2=0x7f7b280b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:48.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.283+0000 7f7b2cdca700 1 --2- 172.21.15.52:0/1244562926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b2806b0e0 0x7f7b280b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:48.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.283+0000 7f7b2cdca700 1 -- 172.21.15.52:0/1244562926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1c0094a0 con 0x7f7b280afe00 2023-06-23T18:44:48.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.283+0000 7f7b27fff700 1 --2- 172.21.15.52:0/1244562926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b2806b0e0 0x7f7b280b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:48.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.283+0000 7f7b2cdca700 1 --2- 172.21.15.52:0/1244562926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b280afe00 0x7f7b280b3ce0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000cbc0 tx=0x7f7b2000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:48.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.283+0000 7f7b24ff9700 1 -- 172.21.15.52:0/1244562926 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2000a9e0 con 0x7f7b280afe00 2023-06-23T18:44:48.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.283+0000 7f7b24ff9700 1 -- 172.21.15.52:0/1244562926 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2000ab40 con 0x7f7b280afe00 2023-06-23T18:44:48.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.283+0000 7f7b2e82d700 1 -- 172.21.15.52:0/1244562926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b18009550 con 0x7f7b280afe00 2023-06-23T18:44:48.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.283+0000 7f7b24ff9700 1 -- 172.21.15.52:0/1244562926 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b20007070 con 0x7f7b280afe00 2023-06-23T18:44:48.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.283+0000 7f7b2e82d700 1 -- 172.21.15.52:0/1244562926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b281d6700 con 0x7f7b280afe00 2023-06-23T18:44:48.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.284+0000 7f7b2e82d700 1 -- 172.21.15.52:0/1244562926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b280b5b60 con 0x7f7b280afe00 2023-06-23T18:44:48.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.285+0000 7f7b24ff9700 1 -- 172.21.15.52:0/1244562926 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7b200071d0 con 0x7f7b280afe00 2023-06-23T18:44:48.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.286+0000 7f7b24ff9700 1 --2- 172.21.15.52:0/1244562926 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7b1406ace0 0x7f7b1406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:48.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.286+0000 7f7b24ff9700 1 -- 172.21.15.52:0/1244562926 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7b20089070 con 0x7f7b280afe00 2023-06-23T18:44:48.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.286+0000 7f7b27fff700 1 --2- 172.21.15.52:0/1244562926 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7b1406ace0 0x7f7b1406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:48.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.286+0000 7f7b27fff700 1 --2- 172.21.15.52:0/1244562926 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7b1406ace0 0x7f7b1406d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7b18009c40 tx=0x7f7b18008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:48.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.289+0000 7f7b24ff9700 1 -- 172.21.15.52:0/1244562926 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7b20054690 con 0x7f7b280afe00 2023-06-23T18:44:48.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:48.487+0000 7f7b2e82d700 1 -- 172.21.15.52:0/1244562926 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7b2804e1d0 con 0x7f7b280afe00 2023-06-23T18:44:49.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.218+0000 7f7b24ff9700 1 -- 172.21.15.52:0/1244562926 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7b20057cb0 con 0x7f7b280afe00 2023-06-23T18:44:49.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.221+0000 7f7b2e82d700 1 -- 172.21.15.52:0/1244562926 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7b1406ace0 msgr2=0x7f7b1406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:49.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.221+0000 7f7b2e82d700 1 --2- 172.21.15.52:0/1244562926 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7b1406ace0 0x7f7b1406d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7b18009c40 tx=0x7f7b18008030 comp rx=0 tx=0).stop 2023-06-23T18:44:49.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.221+0000 7f7b2e82d700 1 -- 172.21.15.52:0/1244562926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b280afe00 msgr2=0x7f7b280b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:49.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.221+0000 7f7b2e82d700 1 --2- 172.21.15.52:0/1244562926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b280afe00 0x7f7b280b3ce0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000cbc0 tx=0x7f7b2000ced0 comp rx=0 tx=0).stop 2023-06-23T18:44:49.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.221+0000 7f7b2e82d700 1 -- 172.21.15.52:0/1244562926 shutdown_connections 2023-06-23T18:44:49.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.221+0000 7f7b2e82d700 1 --2- 172.21.15.52:0/1244562926 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7b1406ace0 0x7f7b1406d190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:49.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.221+0000 7f7b2e82d700 1 --2- 172.21.15.52:0/1244562926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7b280afe00 0x7f7b280b3ce0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:49.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.221+0000 7f7b2e82d700 1 --2- 172.21.15.52:0/1244562926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b2806b0e0 0x7f7b280b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:49.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.221+0000 7f7b2e82d700 1 --2- 172.21.15.52:0/1244562926 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7b28070930 0x7f7b280ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:49.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.221+0000 7f7b2e82d700 1 -- 172.21.15.52:0/1244562926 >> 172.21.15.52:0/1244562926 conn(0x7f7b280b95c0 msgr2=0x7f7b281d6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:49.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.222+0000 7f7b2e82d700 1 -- 172.21.15.52:0/1244562926 shutdown_connections 2023-06-23T18:44:49.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.222+0000 7f7b2e82d700 1 -- 172.21.15.52:0/1244562926 wait complete. 2023-06-23T18:44:49.228 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2023-06-23T18:44:49.244 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-23T18:44:49.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.379+0000 7f766be57700 1 Processor -- start 2023-06-23T18:44:49.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.379+0000 7f766be57700 1 -- start start 2023-06-23T18:44:49.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.380+0000 7f766be57700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f76640bb900 0x7f7664155e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:49.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.380+0000 7f766be57700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76640be040 con 0x7f766414a600 2023-06-23T18:44:49.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.380+0000 7f766be57700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f766414aae0 con 0x7f76640b6830 2023-06-23T18:44:49.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.380+0000 7f766be57700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766414b480 con 0x7f76640bb900 2023-06-23T18:44:49.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.380+0000 7f76693f2700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f766414a600 0x7f76640bb1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48462/0 (socket says 172.21.15.52:48462) 2023-06-23T18:44:49.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.380+0000 7f76693f2700 1 -- 172.21.15.52:0/800262 learned_addr learned my addr 172.21.15.52:0/800262 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:49.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.381+0000 7f766a3f4700 1 --2- 172.21.15.52:0/800262 >> v2:172.21.15.89:3300/0 conn(0x7f76640bb900 0x7f7664155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:49.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.381+0000 7f7668bf1700 1 -- 172.21.15.52:0/800262 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601545477 0 0) 0x7f76640be040 con 0x7f766414a600 2023-06-23T18:44:49.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.381+0000 7f7668bf1700 1 -- 172.21.15.52:0/800262 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76500035b0 con 0x7f766414a600 2023-06-23T18:44:49.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.381+0000 7f7668bf1700 1 -- 172.21.15.52:0/800262 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590184538 0 0) 0x7f766414aae0 con 0x7f76640b6830 2023-06-23T18:44:49.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.381+0000 7f7668bf1700 1 -- 172.21.15.52:0/800262 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76640be040 con 0x7f76640b6830 2023-06-23T18:44:49.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.381+0000 7f7668bf1700 1 -- 172.21.15.52:0/800262 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3846507632 0 0) 0x7f76500035b0 con 0x7f766414a600 2023-06-23T18:44:49.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.381+0000 7f7668bf1700 1 -- 172.21.15.52:0/800262 >> v2:172.21.15.89:3300/0 conn(0x7f76640bb900 msgr2=0x7f7664155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:49.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.381+0000 7f7668bf1700 1 --2- 172.21.15.52:0/800262 >> v2:172.21.15.89:3300/0 conn(0x7f76640bb900 0x7f7664155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:49.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.381+0000 7f7668bf1700 1 -- 172.21.15.52:0/800262 >> v1:172.21.15.89:6789/0 conn(0x7f76640b6830 legacy=0x7f76641444a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:49.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.381+0000 7f7668bf1700 1 -- 172.21.15.52:0/800262 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766414adc0 con 0x7f766414a600 2023-06-23T18:44:49.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.381+0000 7f7668bf1700 1 -- 172.21.15.52:0/800262 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7f7654001670 con 0x7f766414a600 2023-06-23T18:44:49.389 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.381+0000 7f7668bf1700 1 -- 172.21.15.52:0/800262 >> v1:172.21.15.52:6789/0 conn(0x7f766414a600 legacy=0x7f76640bb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:49.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.381+0000 7f7668bf1700 1 --2- 172.21.15.52:0/800262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7650003b90 0x7f7650003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:49.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.381+0000 7f7668bf1700 1 --2- 172.21.15.52:0/800262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7650004850 0x7f7650004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:49.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.381+0000 7f7668bf1700 1 --2- 172.21.15.52:0/800262 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7650005200 0x7f765000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:49.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.381+0000 7f7668bf1700 1 -- 172.21.15.52:0/800262 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766414b480 con 0x7f7650003b90 2023-06-23T18:44:49.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.381+0000 7f7668bf1700 1 -- 172.21.15.52:0/800262 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765000c060 con 0x7f7650004850 2023-06-23T18:44:49.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.381+0000 7f7668bf1700 1 -- 172.21.15.52:0/800262 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765000c220 con 0x7f7650005200 2023-06-23T18:44:49.390 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.381+0000 7f7669bf3700 1 --2- 172.21.15.52:0/800262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7650003b90 0x7f7650003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:49.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.381+0000 7f76693f2700 1 --2- 172.21.15.52:0/800262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7650004850 0x7f7650004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:49.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.381+0000 7f766a3f4700 1 --2- 172.21.15.52:0/800262 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7650005200 0x7f765000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:49.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.381+0000 7f7669bf3700 1 -- 172.21.15.52:0/800262 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7650005200 msgr2=0x7f765000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:49.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.381+0000 7f7669bf3700 1 --2- 172.21.15.52:0/800262 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7650005200 0x7f765000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:49.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.381+0000 7f7669bf3700 1 -- 172.21.15.52:0/800262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7650004850 msgr2=0x7f7650004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:49.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.381+0000 7f7669bf3700 1 --2- 172.21.15.52:0/800262 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7650004850 0x7f7650004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:49.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.381+0000 7f7669bf3700 1 -- 172.21.15.52:0/800262 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76500035b0 con 0x7f7650003b90 2023-06-23T18:44:49.391 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.382+0000 7f766a3f4700 1 -- 172.21.15.52:0/800262 reap_dead start 2023-06-23T18:44:49.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.382+0000 7f7669bf3700 1 --2- 172.21.15.52:0/800262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7650003b90 0x7f7650003f80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7660001940 tx=0x7f7650005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25aa688516e6f09 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:49.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.382+0000 7f7668bf1700 1 -- 172.21.15.52:0/800262 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660001430 con 0x7f7650003b90 2023-06-23T18:44:49.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.382+0000 7f7668bf1700 1 -- 172.21.15.52:0/800262 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76600052d0 con 0x7f7650003b90 2023-06-23T18:44:49.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.382+0000 7f7668bf1700 1 -- 172.21.15.52:0/800262 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660001d10 con 0x7f7650003b90 2023-06-23T18:44:49.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.382+0000 7f766be57700 1 -- 172.21.15.52:0/800262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7650003b90 msgr2=0x7f7650003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:49.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.382+0000 7f766be57700 1 --2- 172.21.15.52:0/800262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7650003b90 0x7f7650003f80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7660001940 tx=0x7f7650005880 comp rx=0 tx=0).stop 2023-06-23T18:44:49.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.382+0000 7f766be57700 1 -- 172.21.15.52:0/800262 shutdown_connections 2023-06-23T18:44:49.392 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.382+0000 7f766be57700 1 --2- 172.21.15.52:0/800262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7650003b90 0x7f7650003f80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:49.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.382+0000 7f766be57700 1 -- 172.21.15.52:0/800262 >> 172.21.15.52:0/800262 conn(0x7f76640bd140 msgr2=0x7f76640bd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:49.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.382+0000 7f766be57700 1 -- 172.21.15.52:0/800262 shutdown_connections 2023-06-23T18:44:49.393 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.383+0000 7f766be57700 1 -- 172.21.15.52:0/800262 wait complete. 2023-06-23T18:44:49.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.384+0000 7f766be57700 1 Processor -- start 2023-06-23T18:44:49.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.384+0000 7f766be57700 1 -- start start 2023-06-23T18:44:49.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.384+0000 7f766be57700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7650003b90 0x7f76640bf030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:49.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.384+0000 7f766be57700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7664141000 0x7f766413ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:49.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.384+0000 7f766be57700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7664141470 0x7f766413f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:49.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.384+0000 7f766be57700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7664147fb0 con 0x7f7650003b90 2023-06-23T18:44:49.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.384+0000 7f766be57700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76640bf570 con 0x7f7664141000 2023-06-23T18:44:49.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.384+0000 7f766be57700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7664147da0 con 0x7f7664141470 2023-06-23T18:44:49.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.384+0000 7f7669bf3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7650003b90 0x7f76640bf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:49.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.384+0000 7f7669bf3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7650003b90 0x7f76640bf030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47364/0 (socket says 172.21.15.52:47364) 2023-06-23T18:44:49.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.384+0000 7f7669bf3700 1 -- 172.21.15.52:0/1439452328 learned_addr learned my addr 172.21.15.52:0/1439452328 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:49.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.384+0000 7f766a3f4700 1 --2- 172.21.15.52:0/1439452328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7664141470 0x7f766413f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:49.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.384+0000 7f76693f2700 1 --2- 172.21.15.52:0/1439452328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7664141000 0x7f766413ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:49.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.385+0000 7f7669bf3700 1 -- 172.21.15.52:0/1439452328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7664141470 msgr2=0x7f766413f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:49.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.385+0000 7f7669bf3700 1 --2- 172.21.15.52:0/1439452328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7664141470 0x7f766413f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:49.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.385+0000 7f7669bf3700 1 -- 172.21.15.52:0/1439452328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7664141000 msgr2=0x7f766413ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:49.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.385+0000 7f7669bf3700 1 --2- 172.21.15.52:0/1439452328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7664141000 0x7f766413ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:49.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.385+0000 7f7669bf3700 1 -- 172.21.15.52:0/1439452328 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76641402b0 con 0x7f7650003b90 2023-06-23T18:44:49.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.385+0000 7f76693f2700 1 --2- 172.21.15.52:0/1439452328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7664141000 0x7f766413ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:44:49.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.385+0000 7f7669bf3700 1 --2- 172.21.15.52:0/1439452328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7650003b90 0x7f76640bf030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f766000c3c0 tx=0x7f76600012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:49.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.385+0000 7f765a7fc700 1 -- 172.21.15.52:0/1439452328 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76600013d0 con 0x7f7650003b90 2023-06-23T18:44:49.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.385+0000 7f765a7fc700 1 -- 172.21.15.52:0/1439452328 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7660001d10 con 0x7f7650003b90 2023-06-23T18:44:49.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.385+0000 7f766be57700 1 -- 172.21.15.52:0/1439452328 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7664140590 con 0x7f7650003b90 2023-06-23T18:44:49.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.385+0000 7f765a7fc700 1 -- 172.21.15.52:0/1439452328 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7660007040 con 0x7f7650003b90 2023-06-23T18:44:49.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.385+0000 7f766be57700 1 -- 172.21.15.52:0/1439452328 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76641470f0 con 0x7f7650003b90 2023-06-23T18:44:49.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.386+0000 7f766be57700 1 -- 172.21.15.52:0/1439452328 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7664140110 con 0x7f7650003b90 2023-06-23T18:44:49.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.387+0000 7f765a7fc700 1 -- 172.21.15.52:0/1439452328 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f76600071a0 con 0x7f7650003b90 2023-06-23T18:44:49.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.387+0000 7f765a7fc700 1 --2- 172.21.15.52:0/1439452328 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f764806ace0 0x7f764806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:49.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.387+0000 7f765a7fc700 1 -- 172.21.15.52:0/1439452328 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f7660089f50 con 0x7f7650003b90 2023-06-23T18:44:49.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.387+0000 7f76693f2700 1 --2- 172.21.15.52:0/1439452328 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f764806ace0 0x7f764806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:49.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.388+0000 7f76693f2700 1 --2- 172.21.15.52:0/1439452328 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f764806ace0 0x7f764806d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7654000c00 tx=0x7f7654009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:49.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.391+0000 7f765a7fc700 1 -- 172.21.15.52:0/1439452328 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7660055270 con 0x7f7650003b90 2023-06-23T18:44:49.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:49.590+0000 7f766be57700 1 -- 172.21.15.52:0/1439452328 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7664140110 con 0x7f7650003b90 2023-06-23T18:44:50.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.226+0000 7f765a7fc700 1 -- 172.21.15.52:0/1439452328 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7664140110 con 0x7f7650003b90 2023-06-23T18:44:50.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.230+0000 7f766be57700 1 -- 172.21.15.52:0/1439452328 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f764806ace0 msgr2=0x7f764806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:50.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.230+0000 7f766be57700 1 --2- 172.21.15.52:0/1439452328 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f764806ace0 0x7f764806d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7654000c00 tx=0x7f7654009040 comp rx=0 tx=0).stop 2023-06-23T18:44:50.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.230+0000 7f766be57700 1 -- 172.21.15.52:0/1439452328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7650003b90 msgr2=0x7f76640bf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:50.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.230+0000 7f766be57700 1 --2- 172.21.15.52:0/1439452328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7650003b90 0x7f76640bf030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f766000c3c0 tx=0x7f76600012d0 comp rx=0 tx=0).stop 2023-06-23T18:44:50.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.231+0000 7f766be57700 1 -- 172.21.15.52:0/1439452328 shutdown_connections 2023-06-23T18:44:50.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.231+0000 7f766be57700 1 --2- 172.21.15.52:0/1439452328 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f764806ace0 0x7f764806d190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:50.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.231+0000 7f766be57700 1 --2- 172.21.15.52:0/1439452328 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7664141470 0x7f766413f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:50.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.231+0000 7f766be57700 1 --2- 172.21.15.52:0/1439452328 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7650003b90 0x7f76640bf030 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f766000c3c0 tx=0x7f76600012d0 comp rx=0 tx=0).stop 2023-06-23T18:44:50.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.231+0000 7f766be57700 1 --2- 172.21.15.52:0/1439452328 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7664141000 0x7f766413ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:50.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.231+0000 7f766be57700 1 -- 172.21.15.52:0/1439452328 >> 172.21.15.52:0/1439452328 conn(0x7f76640bd140 msgr2=0x7f7664148b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:50.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.232+0000 7f766be57700 1 -- 172.21.15.52:0/1439452328 shutdown_connections 2023-06-23T18:44:50.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.232+0000 7f766be57700 1 -- 172.21.15.52:0/1439452328 wait complete. 2023-06-23T18:44:50.247 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2023-06-23T18:44:50.261 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-23T18:44:50.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.389+0000 7f0c50482700 1 Processor -- start 2023-06-23T18:44:50.394 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.389+0000 7f0c50482700 1 -- start start 2023-06-23T18:44:50.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.390+0000 7f0c50482700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0c48145db0 0x7f0c480ba2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:50.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.390+0000 7f0c50482700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0c480b90c0 0x7f0c480be420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:50.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.390+0000 7f0c50482700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c480b8ea0 con 0x7f0c480b7510 2023-06-23T18:44:50.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.390+0000 7f0c50482700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c48146180 con 0x7f0c480b90c0 2023-06-23T18:44:50.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.390+0000 7f0c50482700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c480b6570 con 0x7f0c48145db0 2023-06-23T18:44:50.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.390+0000 7f0c4da1d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0c480b90c0 0x7f0c480be420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:50.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.390+0000 7f0c4ea1f700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0c480b7510 0x7f0c480b7930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48472/0 (socket says 172.21.15.52:48472) 2023-06-23T18:44:50.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.390+0000 7f0c4ea1f700 1 -- 172.21.15.52:0/995301384 learned_addr learned my addr 172.21.15.52:0/995301384 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:50.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.390+0000 7f0c4e21e700 1 --2- 172.21.15.52:0/995301384 >> v2:172.21.15.89:3300/0 conn(0x7f0c48145db0 0x7f0c480ba2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:50.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.391+0000 7f0c4da1d700 1 -- 172.21.15.52:0/995301384 >> v2:172.21.15.89:3300/0 conn(0x7f0c48145db0 msgr2=0x7f0c480ba2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:50.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.391+0000 7f0c4da1d700 1 --2- 172.21.15.52:0/995301384 >> v2:172.21.15.89:3300/0 conn(0x7f0c48145db0 0x7f0c480ba2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:50.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.391+0000 7f0c4da1d700 1 -- 172.21.15.52:0/995301384 >> v1:172.21.15.52:6789/0 conn(0x7f0c480b7510 legacy=0x7f0c480b7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:50.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.391+0000 7f0c4da1d700 1 -- 172.21.15.52:0/995301384 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c480b5930 con 0x7f0c480b90c0 2023-06-23T18:44:50.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.391+0000 7f0c4d21c700 1 -- 172.21.15.52:0/995301384 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 195460237 0 0) 0x7f0c480b8ea0 con 0x7f0c480b7510 2023-06-23T18:44:50.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.391+0000 7f0c4e21e700 1 --2- 172.21.15.52:0/995301384 >> v2:172.21.15.89:3300/0 conn(0x7f0c48145db0 0x7f0c480ba2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:44:50.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.391+0000 7f0c4da1d700 1 --2- 172.21.15.52:0/995301384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c480b90c0 0x7f0c480be420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0c48070650 tx=0x7f0c44009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9357cc6704fc2d74 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:50.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.391+0000 7f0c4d21c700 1 -- 172.21.15.52:0/995301384 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c44011830 con 0x7f0c480b90c0 2023-06-23T18:44:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.391+0000 7f0c4d21c700 1 -- 172.21.15.52:0/995301384 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c44011990 con 0x7f0c480b90c0 2023-06-23T18:44:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.391+0000 7f0c4d21c700 1 -- 172.21.15.52:0/995301384 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c44011d20 con 0x7f0c480b90c0 2023-06-23T18:44:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.391+0000 7f0c50482700 1 -- 172.21.15.52:0/995301384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c480b90c0 msgr2=0x7f0c480be420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.391+0000 7f0c50482700 1 --2- 172.21.15.52:0/995301384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c480b90c0 0x7f0c480be420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0c48070650 tx=0x7f0c44009b20 comp rx=0 tx=0).stop 2023-06-23T18:44:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.392+0000 7f0c50482700 1 -- 172.21.15.52:0/995301384 shutdown_connections 2023-06-23T18:44:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.392+0000 7f0c50482700 1 --2- 172.21.15.52:0/995301384 >> v2:172.21.15.89:3300/0 conn(0x7f0c48145db0 0x7f0c480ba2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.392+0000 7f0c50482700 1 --2- 172.21.15.52:0/995301384 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c480b90c0 0x7f0c480be420 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:50.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.392+0000 7f0c50482700 1 -- 172.21.15.52:0/995301384 >> 172.21.15.52:0/995301384 conn(0x7f0c48071410 msgr2=0x7f0c48071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:50.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.392+0000 7f0c50482700 1 -- 172.21.15.52:0/995301384 shutdown_connections 2023-06-23T18:44:50.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.392+0000 7f0c50482700 1 -- 172.21.15.52:0/995301384 wait complete. 2023-06-23T18:44:50.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.393+0000 7f0c50482700 1 Processor -- start 2023-06-23T18:44:50.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.393+0000 7f0c50482700 1 -- start start 2023-06-23T18:44:50.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.393+0000 7f0c50482700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c480b7510 0x7f0c481402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:50.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.393+0000 7f0c50482700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c480b90c0 0x7f0c48148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.393+0000 7f0c50482700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c48145db0 0x7f0c481e0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.393+0000 7f0c50482700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c481478a0 con 0x7f0c480b7510 2023-06-23T18:44:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.393+0000 7f0c50482700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c48140820 con 0x7f0c480b90c0 2023-06-23T18:44:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.393+0000 7f0c50482700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c48148560 con 0x7f0c48145db0 2023-06-23T18:44:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.393+0000 7f0c4e21e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c480b7510 0x7f0c481402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.393+0000 7f0c4e21e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c480b7510 0x7f0c481402e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47386/0 (socket says 172.21.15.52:47386) 2023-06-23T18:44:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.393+0000 7f0c4e21e700 1 -- 172.21.15.52:0/2920594907 learned_addr learned my addr 172.21.15.52:0/2920594907 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:50.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.394+0000 7f0c4ea1f700 1 --2- 172.21.15.52:0/2920594907 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c48145db0 0x7f0c481e0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.394+0000 7f0c4da1d700 1 --2- 172.21.15.52:0/2920594907 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c480b90c0 0x7f0c48148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.394+0000 7f0c4e21e700 1 -- 172.21.15.52:0/2920594907 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c48145db0 msgr2=0x7f0c481e0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.394+0000 7f0c4e21e700 1 --2- 172.21.15.52:0/2920594907 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c48145db0 0x7f0c481e0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.394+0000 7f0c4e21e700 1 -- 172.21.15.52:0/2920594907 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c480b90c0 msgr2=0x7f0c48148ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.394+0000 7f0c4e21e700 1 --2- 172.21.15.52:0/2920594907 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c480b90c0 0x7f0c48148ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.394+0000 7f0c4e21e700 1 -- 172.21.15.52:0/2920594907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c440094a0 con 0x7f0c480b7510 2023-06-23T18:44:50.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.394+0000 7f0c4e21e700 1 --2- 172.21.15.52:0/2920594907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c480b7510 0x7f0c481402e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0c3800e760 tx=0x7f0c3800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:50.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.394+0000 7f0c3effd700 1 -- 172.21.15.52:0/2920594907 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c38013610 con 0x7f0c480b7510 2023-06-23T18:44:50.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.394+0000 7f0c3effd700 1 -- 172.21.15.52:0/2920594907 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c38013770 con 0x7f0c480b7510 2023-06-23T18:44:50.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.394+0000 7f0c50482700 1 -- 172.21.15.52:0/2920594907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c481480d0 con 0x7f0c480b7510 2023-06-23T18:44:50.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.394+0000 7f0c3effd700 1 -- 172.21.15.52:0/2920594907 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c38013b20 con 0x7f0c480b7510 2023-06-23T18:44:50.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.394+0000 7f0c50482700 1 -- 172.21.15.52:0/2920594907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c480b5340 con 0x7f0c480b7510 2023-06-23T18:44:50.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.395+0000 7f0c50482700 1 -- 172.21.15.52:0/2920594907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c4804e1d0 con 0x7f0c480b7510 2023-06-23T18:44:50.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.395+0000 7f0c3effd700 1 -- 172.21.15.52:0/2920594907 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0c38013c80 con 0x7f0c480b7510 2023-06-23T18:44:50.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.396+0000 7f0c3effd700 1 --2- 172.21.15.52:0/2920594907 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0c2c06ace0 0x7f0c2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:50.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.396+0000 7f0c3effd700 1 -- 172.21.15.52:0/2920594907 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f0c38088f70 con 0x7f0c480b7510 2023-06-23T18:44:50.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.396+0000 7f0c4da1d700 1 --2- 172.21.15.52:0/2920594907 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0c2c06ace0 0x7f0c2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:50.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.397+0000 7f0c4da1d700 1 --2- 172.21.15.52:0/2920594907 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0c2c06ace0 0x7f0c2c06d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0c440090b0 tx=0x7f0c44008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:50.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.401+0000 7f0c3effd700 1 -- 172.21.15.52:0/2920594907 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0c38057ba0 con 0x7f0c480b7510 2023-06-23T18:44:50.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.641+0000 7f0c50482700 1 -- 172.21.15.52:0/2920594907 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0c480b1ff0 con 0x7f0c480b7510 2023-06-23T18:44:50.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.646+0000 7f0c3effd700 1 -- 172.21.15.52:0/2920594907 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0c380210c0 con 0x7f0c480b7510 2023-06-23T18:44:50.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.652+0000 7f0c50482700 1 -- 172.21.15.52:0/2920594907 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0c2c06ace0 msgr2=0x7f0c2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:50.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.652+0000 7f0c50482700 1 --2- 172.21.15.52:0/2920594907 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0c2c06ace0 0x7f0c2c06d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0c440090b0 tx=0x7f0c44008030 comp rx=0 tx=0).stop 2023-06-23T18:44:50.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.653+0000 7f0c50482700 1 -- 172.21.15.52:0/2920594907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c480b7510 msgr2=0x7f0c481402e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:50.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.653+0000 7f0c50482700 1 --2- 172.21.15.52:0/2920594907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c480b7510 0x7f0c481402e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0c3800e760 tx=0x7f0c3800eb20 comp rx=0 tx=0).stop 2023-06-23T18:44:50.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.661+0000 7f0c50482700 1 -- 172.21.15.52:0/2920594907 shutdown_connections 2023-06-23T18:44:50.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.661+0000 7f0c50482700 1 --2- 172.21.15.52:0/2920594907 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0c2c06ace0 0x7f0c2c06d190 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:50.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.661+0000 7f0c50482700 1 --2- 172.21.15.52:0/2920594907 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c48145db0 0x7f0c481e0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:50.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.661+0000 7f0c50482700 1 --2- 172.21.15.52:0/2920594907 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0c480b7510 0x7f0c481402e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:50.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.661+0000 7f0c50482700 1 --2- 172.21.15.52:0/2920594907 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c480b90c0 0x7f0c48148ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:50.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.661+0000 7f0c50482700 1 -- 172.21.15.52:0/2920594907 >> 172.21.15.52:0/2920594907 conn(0x7f0c48071410 msgr2=0x7f0c480bcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:50.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.662+0000 7f0c50482700 1 -- 172.21.15.52:0/2920594907 shutdown_connections 2023-06-23T18:44:50.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.662+0000 7f0c50482700 1 -- 172.21.15.52:0/2920594907 wait complete. 2023-06-23T18:44:50.675 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 3 and data pool 4 2023-06-23T18:44:50.686 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:44:50.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.807+0000 7fa9be128700 1 Processor -- start 2023-06-23T18:44:50.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.807+0000 7fa9be128700 1 -- start start 2023-06-23T18:44:50.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.808+0000 7fa9be128700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9b81415b0 0x7fa9b806af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:50.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.809+0000 7fa9be128700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa9b814f9f0 0x7fa9b8151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:50.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.809+0000 7fa9be128700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b8071150 con 0x7fa9b81474c0 2023-06-23T18:44:50.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.809+0000 7fa9be128700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b80719f0 con 0x7fa9b814f9f0 2023-06-23T18:44:50.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.809+0000 7fa9be128700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b80b4280 con 0x7fa9b81415b0 2023-06-23T18:44:50.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.809+0000 7fa9b7fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa9b814f9f0 0x7fa9b8151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:50.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.809+0000 7fa9b7fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa9b814f9f0 0x7fa9b8151dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47398/0 (socket says 172.21.15.52:47398) 2023-06-23T18:44:50.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.809+0000 7fa9b7fff700 1 -- 172.21.15.52:0/1036438771 learned_addr learned my addr 172.21.15.52:0/1036438771 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:50.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.809+0000 7fa9b77fe700 1 --2- 172.21.15.52:0/1036438771 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9b81415b0 0x7fa9b806af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:50.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.809+0000 7fa9b7fff700 1 -- 172.21.15.52:0/1036438771 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9b81415b0 msgr2=0x7fa9b806af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:50.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.809+0000 7fa9b7fff700 1 --2- 172.21.15.52:0/1036438771 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9b81415b0 0x7fa9b806af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:50.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.809+0000 7fa9b7fff700 1 -- 172.21.15.52:0/1036438771 >> v1:172.21.15.89:6789/0 conn(0x7fa9b81474c0 legacy=0x7fa9b8147910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:50.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.809+0000 7fa9b7fff700 1 -- 172.21.15.52:0/1036438771 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b80713a0 con 0x7fa9b814f9f0 2023-06-23T18:44:50.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.809+0000 7fa9b77fe700 1 --2- 172.21.15.52:0/1036438771 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9b81415b0 0x7fa9b806af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:44:50.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.809+0000 7fa9b7fff700 1 --2- 172.21.15.52:0/1036438771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9b814f9f0 0x7fa9b8151dd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0009e50 tx=0x7fa9b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ffaa0ef9ececed6 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:50.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.809+0000 7fa9b6ffd700 1 -- 172.21.15.52:0/1036438771 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b000e070 con 0x7fa9b814f9f0 2023-06-23T18:44:50.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.809+0000 7fa9b6ffd700 1 -- 172.21.15.52:0/1036438771 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b000b9c0 con 0x7fa9b814f9f0 2023-06-23T18:44:50.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.809+0000 7fa9b6ffd700 1 -- 172.21.15.52:0/1036438771 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b000bd70 con 0x7fa9b814f9f0 2023-06-23T18:44:50.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.810+0000 7fa9be128700 1 -- 172.21.15.52:0/1036438771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9b814f9f0 msgr2=0x7fa9b8151dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:50.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.810+0000 7fa9be128700 1 --2- 172.21.15.52:0/1036438771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9b814f9f0 0x7fa9b8151dd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0009e50 tx=0x7fa9b000b330 comp rx=0 tx=0).stop 2023-06-23T18:44:50.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.810+0000 7fa9be128700 1 -- 172.21.15.52:0/1036438771 shutdown_connections 2023-06-23T18:44:50.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.810+0000 7fa9be128700 1 --2- 172.21.15.52:0/1036438771 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9b814f9f0 0x7fa9b8151dd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:50.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.810+0000 7fa9be128700 1 --2- 172.21.15.52:0/1036438771 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9b81415b0 0x7fa9b806af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:50.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.810+0000 7fa9be128700 1 -- 172.21.15.52:0/1036438771 >> 172.21.15.52:0/1036438771 conn(0x7fa9b80bd690 msgr2=0x7fa9b80b9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:50.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.810+0000 7fa9be128700 1 -- 172.21.15.52:0/1036438771 shutdown_connections 2023-06-23T18:44:50.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.810+0000 7fa9be128700 1 -- 172.21.15.52:0/1036438771 wait complete. 2023-06-23T18:44:50.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.811+0000 7fa9be128700 1 Processor -- start 2023-06-23T18:44:50.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.811+0000 7fa9be128700 1 -- start start 2023-06-23T18:44:50.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.812+0000 7fa9be128700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9b81415b0 0x7fa9b80b6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:50.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.812+0000 7fa9be128700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9b81474c0 0x7fa9b80b75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:50.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.812+0000 7fa9be128700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9b814f9f0 0x7fa9b81e15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:50.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.812+0000 7fa9be128700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b80b7b30 con 0x7fa9b81474c0 2023-06-23T18:44:50.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.812+0000 7fa9be128700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b81e0e80 con 0x7fa9b81415b0 2023-06-23T18:44:50.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.812+0000 7fa9be128700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b80b46a0 con 0x7fa9b814f9f0 2023-06-23T18:44:50.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.812+0000 7fa9aeffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9b81474c0 0x7fa9b80b75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:50.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.812+0000 7fa9aeffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9b81474c0 0x7fa9b80b75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47402/0 (socket says 172.21.15.52:47402) 2023-06-23T18:44:50.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.812+0000 7fa9aeffd700 1 -- 172.21.15.52:0/2116707236 learned_addr learned my addr 172.21.15.52:0/2116707236 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:50.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.812+0000 7fa9b7fff700 1 --2- 172.21.15.52:0/2116707236 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9b814f9f0 0x7fa9b81e15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:50.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.812+0000 7fa9b77fe700 1 --2- 172.21.15.52:0/2116707236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9b81415b0 0x7fa9b80b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:50.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.812+0000 7fa9aeffd700 1 -- 172.21.15.52:0/2116707236 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9b814f9f0 msgr2=0x7fa9b81e15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:50.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.812+0000 7fa9aeffd700 1 --2- 172.21.15.52:0/2116707236 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9b814f9f0 0x7fa9b81e15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:50.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.812+0000 7fa9aeffd700 1 -- 172.21.15.52:0/2116707236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9b81415b0 msgr2=0x7fa9b80b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:50.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.812+0000 7fa9aeffd700 1 --2- 172.21.15.52:0/2116707236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9b81415b0 0x7fa9b80b6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:50.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.812+0000 7fa9aeffd700 1 -- 172.21.15.52:0/2116707236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b0009b30 con 0x7fa9b81474c0 2023-06-23T18:44:50.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.813+0000 7fa9aeffd700 1 --2- 172.21.15.52:0/2116707236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9b81474c0 0x7fa9b80b75f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000c510 tx=0x7fa9a000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:50.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.813+0000 7fa9b4ff9700 1 -- 172.21.15.52:0/2116707236 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a00052d0 con 0x7fa9b81474c0 2023-06-23T18:44:50.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.813+0000 7fa9b4ff9700 1 -- 172.21.15.52:0/2116707236 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a0005430 con 0x7fa9b81474c0 2023-06-23T18:44:50.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.813+0000 7fa9be128700 1 -- 172.21.15.52:0/2116707236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b8140430 con 0x7fa9b81474c0 2023-06-23T18:44:50.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.813+0000 7fa9b4ff9700 1 -- 172.21.15.52:0/2116707236 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a00038c0 con 0x7fa9b81474c0 2023-06-23T18:44:50.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.813+0000 7fa9be128700 1 -- 172.21.15.52:0/2116707236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b81e10d0 con 0x7fa9b81474c0 2023-06-23T18:44:50.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.814+0000 7fa9be128700 1 -- 172.21.15.52:0/2116707236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b81e1260 con 0x7fa9b81474c0 2023-06-23T18:44:50.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.814+0000 7fa9b4ff9700 1 -- 172.21.15.52:0/2116707236 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa9a0003a20 con 0x7fa9b81474c0 2023-06-23T18:44:50.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.814+0000 7fa9b4ff9700 1 --2- 172.21.15.52:0/2116707236 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa99806ace0 0x7fa99806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:50.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.815+0000 7fa9b4ff9700 1 -- 172.21.15.52:0/2116707236 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa9a0088790 con 0x7fa9b81474c0 2023-06-23T18:44:50.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.815+0000 7fa9b77fe700 1 --2- 172.21.15.52:0/2116707236 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa99806ace0 0x7fa99806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:50.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.815+0000 7fa9b77fe700 1 --2- 172.21.15.52:0/2116707236 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa99806ace0 0x7fa99806d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8146ed0 tx=0x7fa9a8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:50.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:50.819+0000 7fa9b4ff9700 1 -- 172.21.15.52:0/2116707236 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa9a00538d0 con 0x7fa9b81474c0 2023-06-23T18:44:51.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.015+0000 7fa9be128700 1 -- 172.21.15.52:0/2116707236 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9b804e1d0 con 0x7fa9b81474c0 2023-06-23T18:44:51.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.016+0000 7fa9b4ff9700 1 -- 172.21.15.52:0/2116707236 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18186 (secure 0 0 0) 0x7fa9a0056ef0 con 0x7fa9b81474c0 2023-06-23T18:44:51.021 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:44:51.021 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":20,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","created":"2023-06-23T18:44:31.918434+0000","modified":"2023-06-23T18:44:50.642051+0000","last_up_change":"2023-06-23T18:44:42.169624+0000","last_in_change":"2023-06-23T18:44:34.510501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-23T18:44:43.346578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-23T18:44:43.829719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:44:48.517897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:44:49.621134+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c371fb28-1b15-4e43-8d5a-43e402920ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6812","nonce":1066999520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6815","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6818","nonce":1066999520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6829","nonce":1066999520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6823","nonce":1066999520}]},"public_addr":"172.21.15.52:6812/1066999520","cluster_addr":"172.21.15.52:6818/1066999520","heartbeat_back_addr":"172.21.15.52:6829/1066999520","heartbeat_front_addr":"172.21.15.52:6823/1066999520","state":["exists","up"]},{"osd":1,"uuid":"4a142f04-33eb-47ec-9cc5-b08b44d82658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6813","nonce":2360219751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6819","nonce":2360219751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6830","nonce":2360219751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6825","nonce":2360219751}]},"public_addr":"172.21.15.52:6813/2360219751","cluster_addr":"172.21.15.52:6819/2360219751","heartbeat_back_addr":"172.21.15.52:6830/2360219751","heartbeat_front_addr":"172.21.15.52:6825/2360219751","state":["exists","up"]},{"osd":2,"uuid":"d7bb089d-4c55-4370-ba59-7fe88c39512a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6801","nonce":835073005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6803","nonce":835073005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6807","nonce":835073005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6805","nonce":835073005}]},"public_addr":"172.21.15.52:6801/835073005","cluster_addr":"172.21.15.52:6803/835073005","heartbeat_back_addr":"172.21.15.52:6807/835073005","heartbeat_front_addr":"172.21.15.52:6805/835073005","state":["exists","up"]},{"osd":3,"uuid":"4bcdcdc3-6a8f-468e-877e-57f76079ac3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6811","nonce":2852700864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6817","nonce":2852700864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6831","nonce":2852700864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6824","nonce":2852700864}]},"public_addr":"172.21.15.52:6811/2852700864","cluster_addr":"172.21.15.52:6817/2852700864","heartbeat_back_addr":"172.21.15.52:6831/2852700864","heartbeat_front_addr":"172.21.15.52:6824/2852700864","state":["exists","up"]},{"osd":4,"uuid":"cac63000-ae94-4b08-93e6-a99119640b63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6809","nonce":2538664679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6811","nonce":2538664679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6815","nonce":2538664679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6813","nonce":2538664679}]},"public_addr":"172.21.15.89:6809/2538664679","cluster_addr":"172.21.15.89:6811/2538664679","heartbeat_back_addr":"172.21.15.89:6815/2538664679","heartbeat_front_addr":"172.21.15.89:6813/2538664679","state":["exists","up"]},{"osd":5,"uuid":"45c53102-18a6-4fd7-9c25-8ea5e1ef6851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6801","nonce":1683710352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6803","nonce":1683710352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6807","nonce":1683710352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6805","nonce":1683710352}]},"public_addr":"172.21.15.89:6801/1683710352","cluster_addr":"172.21.15.89:6803/1683710352","heartbeat_back_addr":"172.21.15.89:6807/1683710352","heartbeat_front_addr":"172.21.15.89:6805/1683710352","state":["exists","up"]},{"osd":6,"uuid":"abee09d1-8eba-484f-a25c-871c1fe2e843","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6817","nonce":3890899288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6819","nonce":3890899288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6823","nonce":3890899288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6821","nonce":3890899288}]},"public_addr":"172.21.15.89:6817/3890899288","cluster_addr":"172.21.15.89:6819/3890899288","heartbeat_back_addr":"172.21.15.89:6823/3890899288","heartbeat_front_addr":"172.21.15.89:6821/3890899288","state":["exists","up"]},{"osd":7,"uuid":"5acf9e2e-00dd-4f9b-a7d9-3d820f695de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6825","nonce":2989085420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6827","nonce":2989085420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6831","nonce":2989085420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6829","nonce":2989085420}]},"public_addr":"172.21.15.89:6825/2989085420","cluster_addr":"172.21.15.89:6827/2989085420","heartbeat_back_addr":"172.21.15.89:6831/2989085420","heartbeat_front_addr":"172.21.15.89:6829/2989085420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.663866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.710904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.619347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.660102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.686933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.724635+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.669111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.678740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:44:51.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.018+0000 7fa9be128700 1 -- 172.21.15.52:0/2116707236 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa99806ace0 msgr2=0x7fa99806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:51.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.018+0000 7fa9be128700 1 --2- 172.21.15.52:0/2116707236 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa99806ace0 0x7fa99806d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8146ed0 tx=0x7fa9a8008040 comp rx=0 tx=0).stop 2023-06-23T18:44:51.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.018+0000 7fa9be128700 1 -- 172.21.15.52:0/2116707236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9b81474c0 msgr2=0x7fa9b80b75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:51.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.018+0000 7fa9be128700 1 --2- 172.21.15.52:0/2116707236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9b81474c0 0x7fa9b80b75f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000c510 tx=0x7fa9a000c820 comp rx=0 tx=0).stop 2023-06-23T18:44:51.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.018+0000 7fa9be128700 1 -- 172.21.15.52:0/2116707236 shutdown_connections 2023-06-23T18:44:51.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.018+0000 7fa9be128700 1 --2- 172.21.15.52:0/2116707236 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa99806ace0 0x7fa99806d190 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:51.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.018+0000 7fa9be128700 1 --2- 172.21.15.52:0/2116707236 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9b814f9f0 0x7fa9b81e15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:51.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.018+0000 7fa9be128700 1 --2- 172.21.15.52:0/2116707236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9b81415b0 0x7fa9b80b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:51.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.018+0000 7fa9be128700 1 --2- 172.21.15.52:0/2116707236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa9b81474c0 0x7fa9b80b75f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:51.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.018+0000 7fa9be128700 1 -- 172.21.15.52:0/2116707236 >> 172.21.15.52:0/2116707236 conn(0x7fa9b80bd690 msgr2=0x7fa9b813b120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:51.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.018+0000 7fa9be128700 1 -- 172.21.15.52:0/2116707236 shutdown_connections 2023-06-23T18:44:51.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.018+0000 7fa9be128700 1 -- 172.21.15.52:0/2116707236 wait complete. 2023-06-23T18:44:51.035 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:44:51.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.156+0000 7ff24e07f700 1 Processor -- start 2023-06-23T18:44:51.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.156+0000 7ff24e07f700 1 -- start start 2023-06-23T18:44:51.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.156+0000 7ff24e07f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff24806c1f0 0x7ff2480b8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:51.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.156+0000 7ff24e07f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff2480b9310 0x7ff2481443e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:51.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.156+0000 7ff24e07f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2480b98a0 con 0x7ff24814da40 2023-06-23T18:44:51.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.156+0000 7ff24e07f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff24814a6a0 con 0x7ff2480b9310 2023-06-23T18:44:51.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.156+0000 7ff24e07f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff24814a980 con 0x7ff24806c1f0 2023-06-23T18:44:51.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.157+0000 7ff247fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff2480b9310 0x7ff2481443e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:51.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.157+0000 7ff246ffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff24814da40 0x7ff24814aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48486/0 (socket says 172.21.15.52:48486) 2023-06-23T18:44:51.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.157+0000 7ff246ffd700 1 -- 172.21.15.52:0/2581939013 learned_addr learned my addr 172.21.15.52:0/2581939013 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:51.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.157+0000 7ff2477fe700 1 --2- 172.21.15.52:0/2581939013 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff24806c1f0 0x7ff2480b8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:51.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.157+0000 7ff247fff700 1 -- 172.21.15.52:0/2581939013 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff24806c1f0 msgr2=0x7ff2480b8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:51.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.157+0000 7ff247fff700 1 --2- 172.21.15.52:0/2581939013 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff24806c1f0 0x7ff2480b8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:51.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.157+0000 7ff247fff700 1 -- 172.21.15.52:0/2581939013 >> v1:172.21.15.52:6789/0 conn(0x7ff24814da40 legacy=0x7ff24814aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:51.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.157+0000 7ff247fff700 1 -- 172.21.15.52:0/2581939013 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff24806c5c0 con 0x7ff2480b9310 2023-06-23T18:44:51.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.157+0000 7ff2467fc700 1 -- 172.21.15.52:0/2581939013 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705638930 0 0) 0x7ff2480b98a0 con 0x7ff24814da40 2023-06-23T18:44:51.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.157+0000 7ff247fff700 1 --2- 172.21.15.52:0/2581939013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2480b9310 0x7ff2481443e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff240009d90 tx=0x7ff24000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca18c425978b4321 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:51.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.157+0000 7ff2467fc700 1 -- 172.21.15.52:0/2581939013 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24000e070 con 0x7ff2480b9310 2023-06-23T18:44:51.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.157+0000 7ff2467fc700 1 -- 172.21.15.52:0/2581939013 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24000bbd0 con 0x7ff2480b9310 2023-06-23T18:44:51.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.157+0000 7ff2467fc700 1 -- 172.21.15.52:0/2581939013 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff240012430 con 0x7ff2480b9310 2023-06-23T18:44:51.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.158+0000 7ff24e07f700 1 -- 172.21.15.52:0/2581939013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2480b9310 msgr2=0x7ff2481443e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:51.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.158+0000 7ff24e07f700 1 --2- 172.21.15.52:0/2581939013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2480b9310 0x7ff2481443e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff240009d90 tx=0x7ff24000b330 comp rx=0 tx=0).stop 2023-06-23T18:44:51.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.158+0000 7ff24e07f700 1 -- 172.21.15.52:0/2581939013 shutdown_connections 2023-06-23T18:44:51.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.158+0000 7ff24e07f700 1 --2- 172.21.15.52:0/2581939013 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2480b9310 0x7ff2481443e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:51.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.158+0000 7ff24e07f700 1 --2- 172.21.15.52:0/2581939013 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff24806c1f0 0x7ff2480b8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:51.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.158+0000 7ff24e07f700 1 -- 172.21.15.52:0/2581939013 >> 172.21.15.52:0/2581939013 conn(0x7ff2480bdf30 msgr2=0x7ff2480b9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:51.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.158+0000 7ff24e07f700 1 -- 172.21.15.52:0/2581939013 shutdown_connections 2023-06-23T18:44:51.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.158+0000 7ff24e07f700 1 -- 172.21.15.52:0/2581939013 wait complete. 2023-06-23T18:44:51.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.159+0000 7ff24e07f700 1 Processor -- start 2023-06-23T18:44:51.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.159+0000 7ff24e07f700 1 -- start start 2023-06-23T18:44:51.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.160+0000 7ff24e07f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff24806c1f0 0x7ff2480b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:51.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.160+0000 7ff24e07f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2480b9310 0x7ff2481e0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:51.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.160+0000 7ff24e07f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff24814da40 0x7ff2481e3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:51.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.160+0000 7ff24e07f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2481e1420 con 0x7ff2480b9310 2023-06-23T18:44:51.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.160+0000 7ff24e07f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2480b3e10 con 0x7ff24814da40 2023-06-23T18:44:51.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.160+0000 7ff24e07f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2480b7470 con 0x7ff24806c1f0 2023-06-23T18:44:51.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.160+0000 7ff246ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2480b9310 0x7ff2481e0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.160+0000 7ff246ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2480b9310 0x7ff2481e0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47422/0 (socket says 172.21.15.52:47422) 2023-06-23T18:44:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.160+0000 7ff246ffd700 1 -- 172.21.15.52:0/3781608128 learned_addr learned my addr 172.21.15.52:0/3781608128 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.160+0000 7ff2477fe700 1 --2- 172.21.15.52:0/3781608128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff24806c1f0 0x7ff2480b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.160+0000 7ff247fff700 1 --2- 172.21.15.52:0/3781608128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff24814da40 0x7ff2481e3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.160+0000 7ff246ffd700 1 -- 172.21.15.52:0/3781608128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff24806c1f0 msgr2=0x7ff2480b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.160+0000 7ff246ffd700 1 --2- 172.21.15.52:0/3781608128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff24806c1f0 0x7ff2480b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:51.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.160+0000 7ff246ffd700 1 -- 172.21.15.52:0/3781608128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff24814da40 msgr2=0x7ff2481e3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:51.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.160+0000 7ff246ffd700 1 --2- 172.21.15.52:0/3781608128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff24814da40 0x7ff2481e3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:51.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.160+0000 7ff246ffd700 1 -- 172.21.15.52:0/3781608128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff240009a70 con 0x7ff2480b9310 2023-06-23T18:44:51.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.160+0000 7ff246ffd700 1 --2- 172.21.15.52:0/3781608128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2480b9310 0x7ff2481e0ee0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff23c00c550 tx=0x7ff23c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:51.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.160+0000 7ff22ffff700 1 -- 172.21.15.52:0/3781608128 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c004c80 con 0x7ff2480b9310 2023-06-23T18:44:51.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.160+0000 7ff22ffff700 1 -- 172.21.15.52:0/3781608128 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23c004e00 con 0x7ff2480b9310 2023-06-23T18:44:51.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.160+0000 7ff24e07f700 1 -- 172.21.15.52:0/3781608128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2481e3ab0 con 0x7ff2480b9310 2023-06-23T18:44:51.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.160+0000 7ff22ffff700 1 -- 172.21.15.52:0/3781608128 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c007310 con 0x7ff2480b9310 2023-06-23T18:44:51.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.160+0000 7ff24e07f700 1 -- 172.21.15.52:0/3781608128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2481e3790 con 0x7ff2480b9310 2023-06-23T18:44:51.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.161+0000 7ff24e07f700 1 -- 172.21.15.52:0/3781608128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff24804e1d0 con 0x7ff2480b9310 2023-06-23T18:44:51.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.162+0000 7ff22ffff700 1 -- 172.21.15.52:0/3781608128 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff23c007470 con 0x7ff2480b9310 2023-06-23T18:44:51.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.162+0000 7ff22ffff700 1 --2- 172.21.15.52:0/3781608128 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff23406ace0 0x7ff23406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:51.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.163+0000 7ff22ffff700 1 -- 172.21.15.52:0/3781608128 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff23c089040 con 0x7ff2480b9310 2023-06-23T18:44:51.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.163+0000 7ff2477fe700 1 --2- 172.21.15.52:0/3781608128 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff23406ace0 0x7ff23406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:51.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.163+0000 7ff2477fe700 1 --2- 172.21.15.52:0/3781608128 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff23406ace0 0x7ff23406d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff238006b20 tx=0x7ff238008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:51.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.167+0000 7ff22ffff700 1 -- 172.21.15.52:0/3781608128 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff23c0540f0 con 0x7ff2480b9310 2023-06-23T18:44:51.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.367+0000 7ff24e07f700 1 -- 172.21.15.52:0/3781608128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2480b8650 con 0x7ff2480b9310 2023-06-23T18:44:51.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.368+0000 7ff22ffff700 1 -- 172.21.15.52:0/3781608128 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+18186 (secure 0 0 0) 0x7ff23c057710 con 0x7ff2480b9310 2023-06-23T18:44:51.373 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:44:51.373 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":20,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","created":"2023-06-23T18:44:31.918434+0000","modified":"2023-06-23T18:44:50.642051+0000","last_up_change":"2023-06-23T18:44:42.169624+0000","last_in_change":"2023-06-23T18:44:34.510501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-23T18:44:43.346578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-23T18:44:43.829719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:44:48.517897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:44:49.621134+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c371fb28-1b15-4e43-8d5a-43e402920ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6812","nonce":1066999520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6815","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6818","nonce":1066999520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6829","nonce":1066999520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6823","nonce":1066999520}]},"public_addr":"172.21.15.52:6812/1066999520","cluster_addr":"172.21.15.52:6818/1066999520","heartbeat_back_addr":"172.21.15.52:6829/1066999520","heartbeat_front_addr":"172.21.15.52:6823/1066999520","state":["exists","up"]},{"osd":1,"uuid":"4a142f04-33eb-47ec-9cc5-b08b44d82658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6813","nonce":2360219751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6819","nonce":2360219751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6830","nonce":2360219751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6825","nonce":2360219751}]},"public_addr":"172.21.15.52:6813/2360219751","cluster_addr":"172.21.15.52:6819/2360219751","heartbeat_back_addr":"172.21.15.52:6830/2360219751","heartbeat_front_addr":"172.21.15.52:6825/2360219751","state":["exists","up"]},{"osd":2,"uuid":"d7bb089d-4c55-4370-ba59-7fe88c39512a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6801","nonce":835073005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6803","nonce":835073005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6807","nonce":835073005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6805","nonce":835073005}]},"public_addr":"172.21.15.52:6801/835073005","cluster_addr":"172.21.15.52:6803/835073005","heartbeat_back_addr":"172.21.15.52:6807/835073005","heartbeat_front_addr":"172.21.15.52:6805/835073005","state":["exists","up"]},{"osd":3,"uuid":"4bcdcdc3-6a8f-468e-877e-57f76079ac3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6811","nonce":2852700864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6817","nonce":2852700864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6831","nonce":2852700864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6824","nonce":2852700864}]},"public_addr":"172.21.15.52:6811/2852700864","cluster_addr":"172.21.15.52:6817/2852700864","heartbeat_back_addr":"172.21.15.52:6831/2852700864","heartbeat_front_addr":"172.21.15.52:6824/2852700864","state":["exists","up"]},{"osd":4,"uuid":"cac63000-ae94-4b08-93e6-a99119640b63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6809","nonce":2538664679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6811","nonce":2538664679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6815","nonce":2538664679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6813","nonce":2538664679}]},"public_addr":"172.21.15.89:6809/2538664679","cluster_addr":"172.21.15.89:6811/2538664679","heartbeat_back_addr":"172.21.15.89:6815/2538664679","heartbeat_front_addr":"172.21.15.89:6813/2538664679","state":["exists","up"]},{"osd":5,"uuid":"45c53102-18a6-4fd7-9c25-8ea5e1ef6851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6801","nonce":1683710352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6803","nonce":1683710352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6807","nonce":1683710352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6805","nonce":1683710352}]},"public_addr":"172.21.15.89:6801/1683710352","cluster_addr":"172.21.15.89:6803/1683710352","heartbeat_back_addr":"172.21.15.89:6807/1683710352","heartbeat_front_addr":"172.21.15.89:6805/1683710352","state":["exists","up"]},{"osd":6,"uuid":"abee09d1-8eba-484f-a25c-871c1fe2e843","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6817","nonce":3890899288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6819","nonce":3890899288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6823","nonce":3890899288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6821","nonce":3890899288}]},"public_addr":"172.21.15.89:6817/3890899288","cluster_addr":"172.21.15.89:6819/3890899288","heartbeat_back_addr":"172.21.15.89:6823/3890899288","heartbeat_front_addr":"172.21.15.89:6821/3890899288","state":["exists","up"]},{"osd":7,"uuid":"5acf9e2e-00dd-4f9b-a7d9-3d820f695de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6825","nonce":2989085420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6827","nonce":2989085420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6831","nonce":2989085420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6829","nonce":2989085420}]},"public_addr":"172.21.15.89:6825/2989085420","cluster_addr":"172.21.15.89:6827/2989085420","heartbeat_back_addr":"172.21.15.89:6831/2989085420","heartbeat_front_addr":"172.21.15.89:6829/2989085420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.663866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.710904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.619347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.660102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.686933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.724635+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.669111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.678740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:44:51.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.370+0000 7ff24e07f700 1 -- 172.21.15.52:0/3781608128 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff23406ace0 msgr2=0x7ff23406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:51.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.370+0000 7ff24e07f700 1 --2- 172.21.15.52:0/3781608128 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff23406ace0 0x7ff23406d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff238006b20 tx=0x7ff238008040 comp rx=0 tx=0).stop 2023-06-23T18:44:51.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.370+0000 7ff24e07f700 1 -- 172.21.15.52:0/3781608128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2480b9310 msgr2=0x7ff2481e0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:51.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.370+0000 7ff24e07f700 1 --2- 172.21.15.52:0/3781608128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2480b9310 0x7ff2481e0ee0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff23c00c550 tx=0x7ff23c00c860 comp rx=0 tx=0).stop 2023-06-23T18:44:51.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.370+0000 7ff24e07f700 1 -- 172.21.15.52:0/3781608128 shutdown_connections 2023-06-23T18:44:51.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.370+0000 7ff24e07f700 1 --2- 172.21.15.52:0/3781608128 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff23406ace0 0x7ff23406d190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:51.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.370+0000 7ff24e07f700 1 --2- 172.21.15.52:0/3781608128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff24814da40 0x7ff2481e3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:51.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.370+0000 7ff24e07f700 1 --2- 172.21.15.52:0/3781608128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff24806c1f0 0x7ff2480b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:51.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.370+0000 7ff24e07f700 1 --2- 172.21.15.52:0/3781608128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff2480b9310 0x7ff2481e0ee0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:51.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.370+0000 7ff24e07f700 1 -- 172.21.15.52:0/3781608128 >> 172.21.15.52:0/3781608128 conn(0x7ff2480bdf30 msgr2=0x7ff2480bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:51.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.370+0000 7ff24e07f700 1 -- 172.21.15.52:0/3781608128 shutdown_connections 2023-06-23T18:44:51.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.370+0000 7ff24e07f700 1 -- 172.21.15.52:0/3781608128 wait complete. 2023-06-23T18:44:51.387 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-23T18:44:51.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.511+0000 7f9a2666a700 1 Processor -- start 2023-06-23T18:44:51.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.511+0000 7f9a2666a700 1 -- start start 2023-06-23T18:44:51.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.512+0000 7f9a2666a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a20071a70 0x7f9a2014a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:51.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.512+0000 7f9a2666a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9a200b6cf0 0x7f9a2006af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:51.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.512+0000 7f9a2666a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a200b8df0 con 0x7f9a200b5f40 2023-06-23T18:44:51.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.512+0000 7f9a2666a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a200b90d0 con 0x7f9a200b6cf0 2023-06-23T18:44:51.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.512+0000 7f9a2666a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a20071270 con 0x7f9a20071a70 2023-06-23T18:44:51.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.512+0000 7f9a1ffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9a200b5f40 0x7f9a200b85d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48494/0 (socket says 172.21.15.52:48494) 2023-06-23T18:44:51.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.512+0000 7f9a1ffff700 1 -- 172.21.15.52:0/878721078 learned_addr learned my addr 172.21.15.52:0/878721078 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:51.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.512+0000 7f9a1f7fe700 1 --2- 172.21.15.52:0/878721078 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a20071a70 0x7f9a2014a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:51.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.512+0000 7f9a24c07700 1 --2- 172.21.15.52:0/878721078 >> v2:172.21.15.89:3300/0 conn(0x7f9a200b6cf0 0x7f9a2006af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:51.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.513+0000 7f9a1effd700 1 -- 172.21.15.52:0/878721078 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 975834081 0 0) 0x7f9a200b8df0 con 0x7f9a200b5f40 2023-06-23T18:44:51.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.513+0000 7f9a1effd700 1 -- 172.21.15.52:0/878721078 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a080035b0 con 0x7f9a200b5f40 2023-06-23T18:44:51.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.513+0000 7f9a1effd700 1 -- 172.21.15.52:0/878721078 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3712113706 0 0) 0x7f9a080035b0 con 0x7f9a200b5f40 2023-06-23T18:44:51.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.513+0000 7f9a1effd700 1 -- 172.21.15.52:0/878721078 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a20071a70 msgr2=0x7f9a2014a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:51.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.513+0000 7f9a1effd700 1 --2- 172.21.15.52:0/878721078 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a20071a70 0x7f9a2014a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:51.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.513+0000 7f9a1effd700 1 -- 172.21.15.52:0/878721078 >> v2:172.21.15.89:3300/0 conn(0x7f9a200b6cf0 msgr2=0x7f9a2006af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:51.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.513+0000 7f9a1effd700 1 --2- 172.21.15.52:0/878721078 >> v2:172.21.15.89:3300/0 conn(0x7f9a200b6cf0 0x7f9a2006af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:51.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.513+0000 7f9a1effd700 1 -- 172.21.15.52:0/878721078 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a20071550 con 0x7f9a200b5f40 2023-06-23T18:44:51.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.513+0000 7f9a1effd700 1 -- 172.21.15.52:0/878721078 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7f9a10001670 con 0x7f9a200b5f40 2023-06-23T18:44:51.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.513+0000 7f9a1effd700 1 -- 172.21.15.52:0/878721078 >> v1:172.21.15.52:6789/0 conn(0x7f9a200b5f40 legacy=0x7f9a200b85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:51.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.513+0000 7f9a1effd700 1 --2- 172.21.15.52:0/878721078 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a20071a70 0x7f9a08003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:51.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.513+0000 7f9a1effd700 1 --2- 172.21.15.52:0/878721078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a08003f80 0x7f9a08004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:51.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.513+0000 7f9a1effd700 1 --2- 172.21.15.52:0/878721078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a08004d90 0x7f9a08005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:51.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.513+0000 7f9a1effd700 1 -- 172.21.15.52:0/878721078 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a200b90d0 con 0x7f9a08004d90 2023-06-23T18:44:51.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.513+0000 7f9a1effd700 1 -- 172.21.15.52:0/878721078 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a20071270 con 0x7f9a08003f80 2023-06-23T18:44:51.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.513+0000 7f9a1effd700 1 -- 172.21.15.52:0/878721078 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0800ba40 con 0x7f9a20071a70 2023-06-23T18:44:51.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.513+0000 7f9a24c07700 1 --2- 172.21.15.52:0/878721078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a08004d90 0x7f9a08005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:51.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.513+0000 7f9a1ffff700 1 --2- 172.21.15.52:0/878721078 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a20071a70 0x7f9a08003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:51.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.513+0000 7f9a1f7fe700 1 --2- 172.21.15.52:0/878721078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a08003f80 0x7f9a08004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:51.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.513+0000 7f9a24c07700 1 -- 172.21.15.52:0/878721078 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a20071a70 msgr2=0x7f9a08003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:51.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.513+0000 7f9a24c07700 1 --2- 172.21.15.52:0/878721078 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a20071a70 0x7f9a08003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:51.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.513+0000 7f9a24c07700 1 -- 172.21.15.52:0/878721078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a08003f80 msgr2=0x7f9a08004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:51.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.513+0000 7f9a24c07700 1 --2- 172.21.15.52:0/878721078 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a08003f80 0x7f9a08004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:51.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.513+0000 7f9a24c07700 1 -- 172.21.15.52:0/878721078 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a080035b0 con 0x7f9a08004d90 2023-06-23T18:44:51.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.513+0000 7f9a24c07700 1 --2- 172.21.15.52:0/878721078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a08004d90 0x7f9a08005200 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009fc0 tx=0x7f9a08005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7be4a6bfd1990e2 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:51.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.514+0000 7f9a1effd700 1 -- 172.21.15.52:0/878721078 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1800ebd0 con 0x7f9a08004d90 2023-06-23T18:44:51.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.514+0000 7f9a1effd700 1 -- 172.21.15.52:0/878721078 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1800f040 con 0x7f9a08004d90 2023-06-23T18:44:51.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.514+0000 7f9a1effd700 1 -- 172.21.15.52:0/878721078 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a18012430 con 0x7f9a08004d90 2023-06-23T18:44:51.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.514+0000 7f9a2666a700 1 -- 172.21.15.52:0/878721078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a08004d90 msgr2=0x7f9a08005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:51.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.514+0000 7f9a2666a700 1 --2- 172.21.15.52:0/878721078 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a08004d90 0x7f9a08005200 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009fc0 tx=0x7f9a08005880 comp rx=0 tx=0).stop 2023-06-23T18:44:51.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.514+0000 7f9a24c07700 1 -- 172.21.15.52:0/878721078 reap_dead start 2023-06-23T18:44:51.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.514+0000 7f9a2666a700 1 -- 172.21.15.52:0/878721078 shutdown_connections 2023-06-23T18:44:51.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.514+0000 7f9a2666a700 1 -- 172.21.15.52:0/878721078 >> 172.21.15.52:0/878721078 conn(0x7f9a200b95c0 msgr2=0x7f9a200b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:51.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.514+0000 7f9a2666a700 1 -- 172.21.15.52:0/878721078 shutdown_connections 2023-06-23T18:44:51.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.514+0000 7f9a2666a700 1 -- 172.21.15.52:0/878721078 wait complete. 2023-06-23T18:44:51.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.515+0000 7f9a2666a700 1 Processor -- start 2023-06-23T18:44:51.532 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.515+0000 7f9a2666a700 1 -- start start 2023-06-23T18:44:51.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.516+0000 7f9a2666a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a08004d90 0x7f9a20143be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:51.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.516+0000 7f9a2666a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a20141da0 0x7f9a20147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:51.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.516+0000 7f9a2666a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a20147ec0 0x7f9a201dfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:51.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.516+0000 7f9a2666a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a20144e70 con 0x7f9a20141da0 2023-06-23T18:44:51.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.516+0000 7f9a2666a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a201dbe70 con 0x7f9a20147ec0 2023-06-23T18:44:51.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.516+0000 7f9a2666a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a201448b0 con 0x7f9a08004d90 2023-06-23T18:44:51.533 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.516+0000 7f9a1f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a20141da0 0x7f9a20147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:51.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.516+0000 7f9a1f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a20141da0 0x7f9a20147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47434/0 (socket says 172.21.15.52:47434) 2023-06-23T18:44:51.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.516+0000 7f9a1f7fe700 1 -- 172.21.15.52:0/2088470091 learned_addr learned my addr 172.21.15.52:0/2088470091 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:51.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.516+0000 7f9a1ffff700 1 --2- 172.21.15.52:0/2088470091 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a08004d90 0x7f9a20143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:51.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.516+0000 7f9a24c07700 1 --2- 172.21.15.52:0/2088470091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a20147ec0 0x7f9a201dfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:51.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.516+0000 7f9a1f7fe700 1 -- 172.21.15.52:0/2088470091 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a08004d90 msgr2=0x7f9a20143be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:51.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.516+0000 7f9a1f7fe700 1 --2- 172.21.15.52:0/2088470091 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a08004d90 0x7f9a20143be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:51.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.516+0000 7f9a1f7fe700 1 -- 172.21.15.52:0/2088470091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a20147ec0 msgr2=0x7f9a201dfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:51.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.516+0000 7f9a1f7fe700 1 --2- 172.21.15.52:0/2088470091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a20147ec0 0x7f9a201dfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:51.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.516+0000 7f9a1f7fe700 1 -- 172.21.15.52:0/2088470091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a20144b90 con 0x7f9a20141da0 2023-06-23T18:44:51.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.516+0000 7f9a24c07700 1 --2- 172.21.15.52:0/2088470091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a20147ec0 0x7f9a201dfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:44:51.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.517+0000 7f9a1f7fe700 1 --2- 172.21.15.52:0/2088470091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a20141da0 0x7f9a20147980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9a140119a0 tx=0x7f9a14011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:51.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.517+0000 7f9a1cff9700 1 -- 172.21.15.52:0/2088470091 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1400f940 con 0x7f9a20141da0 2023-06-23T18:44:51.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.517+0000 7f9a1cff9700 1 -- 172.21.15.52:0/2088470091 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1400faa0 con 0x7f9a20141da0 2023-06-23T18:44:51.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.517+0000 7f9a1cff9700 1 -- 172.21.15.52:0/2088470091 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1400fe30 con 0x7f9a20141da0 2023-06-23T18:44:51.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.517+0000 7f9a2666a700 1 -- 172.21.15.52:0/2088470091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a201df560 con 0x7f9a20141da0 2023-06-23T18:44:51.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.517+0000 7f9a2666a700 1 -- 172.21.15.52:0/2088470091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a201e01a0 con 0x7f9a20141da0 2023-06-23T18:44:51.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.518+0000 7f9a2666a700 1 -- 172.21.15.52:0/2088470091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a201df8d0 con 0x7f9a20141da0 2023-06-23T18:44:51.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.518+0000 7f9a1cff9700 1 -- 172.21.15.52:0/2088470091 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9a14014440 con 0x7f9a20141da0 2023-06-23T18:44:51.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.519+0000 7f9a1cff9700 1 --2- 172.21.15.52:0/2088470091 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9a0c06ace0 0x7f9a0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:51.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.519+0000 7f9a1cff9700 1 -- 172.21.15.52:0/2088470091 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9a14089b00 con 0x7f9a20141da0 2023-06-23T18:44:51.536 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.519+0000 7f9a1ffff700 1 --2- 172.21.15.52:0/2088470091 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9a0c06ace0 0x7f9a0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:51.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.519+0000 7f9a1ffff700 1 --2- 172.21.15.52:0/2088470091 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9a0c06ace0 0x7f9a0c06d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9a100015f0 tx=0x7f9a10009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:51.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.523+0000 7f9a1cff9700 1 -- 172.21.15.52:0/2088470091 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9a140586d0 con 0x7f9a20141da0 2023-06-23T18:44:51.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:51.768+0000 7f9a2666a700 1 -- 172.21.15.52:0/2088470091 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9a201449f0 con 0x7f9a20141da0 2023-06-23T18:44:52.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.680+0000 7f9a1cff9700 1 -- 172.21.15.52:0/2088470091 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9a201449f0 con 0x7f9a20141da0 2023-06-23T18:44:52.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.683+0000 7f9a2666a700 1 -- 172.21.15.52:0/2088470091 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9a0c06ace0 msgr2=0x7f9a0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:52.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.683+0000 7f9a2666a700 1 --2- 172.21.15.52:0/2088470091 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9a0c06ace0 0x7f9a0c06d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9a100015f0 tx=0x7f9a10009040 comp rx=0 tx=0).stop 2023-06-23T18:44:52.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.683+0000 7f9a2666a700 1 -- 172.21.15.52:0/2088470091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a20141da0 msgr2=0x7f9a20147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:52.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.683+0000 7f9a2666a700 1 --2- 172.21.15.52:0/2088470091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a20141da0 0x7f9a20147980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9a140119a0 tx=0x7f9a14011d60 comp rx=0 tx=0).stop 2023-06-23T18:44:52.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.683+0000 7f9a2666a700 1 -- 172.21.15.52:0/2088470091 shutdown_connections 2023-06-23T18:44:52.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.683+0000 7f9a2666a700 1 --2- 172.21.15.52:0/2088470091 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9a0c06ace0 0x7f9a0c06d190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:52.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.683+0000 7f9a2666a700 1 --2- 172.21.15.52:0/2088470091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a20147ec0 0x7f9a201dfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:52.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.683+0000 7f9a2666a700 1 --2- 172.21.15.52:0/2088470091 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a08004d90 0x7f9a20143be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:52.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.683+0000 7f9a2666a700 1 --2- 172.21.15.52:0/2088470091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a20141da0 0x7f9a20147980 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:52.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.683+0000 7f9a2666a700 1 -- 172.21.15.52:0/2088470091 >> 172.21.15.52:0/2088470091 conn(0x7f9a200b95c0 msgr2=0x7f9a200b4920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:52.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.683+0000 7f9a2666a700 1 -- 172.21.15.52:0/2088470091 shutdown_connections 2023-06-23T18:44:52.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.683+0000 7f9a2666a700 1 -- 172.21.15.52:0/2088470091 wait complete. 2023-06-23T18:44:52.703 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-23T18:44:52.703 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-23T18:44:52.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.834+0000 7fcc30018700 1 Processor -- start 2023-06-23T18:44:52.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.834+0000 7fcc30018700 1 -- start start 2023-06-23T18:44:52.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.834+0000 7fcc30018700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcc280b6bc0 0x7fcc280b7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:52.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.834+0000 7fcc30018700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc28145d50 0x7fcc2814bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:52.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.834+0000 7fcc30018700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc280b9220 con 0x7fcc2814bac0 2023-06-23T18:44:52.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.834+0000 7fcc30018700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc2814c470 con 0x7fcc280b6bc0 2023-06-23T18:44:52.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.834+0000 7fcc30018700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc280b8580 con 0x7fcc28145d50 2023-06-23T18:44:52.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.835+0000 7fcc2ddb4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcc280b6bc0 0x7fcc280b7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:52.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.835+0000 7fcc2ddb4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fcc280b6bc0 0x7fcc280b7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47436/0 (socket says 172.21.15.52:47436) 2023-06-23T18:44:52.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.835+0000 7fcc2ddb4700 1 -- 172.21.15.52:0/1727102566 learned_addr learned my addr 172.21.15.52:0/1727102566 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:52.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.835+0000 7fcc2e5b5700 1 --2- 172.21.15.52:0/1727102566 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc28145d50 0x7fcc2814bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:52.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.835+0000 7fcc2ddb4700 1 -- 172.21.15.52:0/1727102566 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc28145d50 msgr2=0x7fcc2814bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:52.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.835+0000 7fcc2ddb4700 1 --2- 172.21.15.52:0/1727102566 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc28145d50 0x7fcc2814bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:52.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.835+0000 7fcc2ddb4700 1 -- 172.21.15.52:0/1727102566 >> v1:172.21.15.89:6789/0 conn(0x7fcc2814bac0 legacy=0x7fcc28145640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:52.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.835+0000 7fcc2ddb4700 1 -- 172.21.15.52:0/1727102566 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc280b9470 con 0x7fcc280b6bc0 2023-06-23T18:44:52.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.835+0000 7fcc2ddb4700 1 --2- 172.21.15.52:0/1727102566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc280b6bc0 0x7fcc280b7f60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcc180098f0 tx=0x7fcc18009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d435e85eedf30f server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:52.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.835+0000 7fcc2cdb2700 1 -- 172.21.15.52:0/1727102566 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc18004230 con 0x7fcc280b6bc0 2023-06-23T18:44:52.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.835+0000 7fcc2cdb2700 1 -- 172.21.15.52:0/1727102566 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc18004390 con 0x7fcc280b6bc0 2023-06-23T18:44:52.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.835+0000 7fcc2cdb2700 1 -- 172.21.15.52:0/1727102566 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc180036a0 con 0x7fcc280b6bc0 2023-06-23T18:44:52.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.836+0000 7fcc30018700 1 -- 172.21.15.52:0/1727102566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc280b6bc0 msgr2=0x7fcc280b7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:52.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.836+0000 7fcc30018700 1 --2- 172.21.15.52:0/1727102566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc280b6bc0 0x7fcc280b7f60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcc180098f0 tx=0x7fcc18009c00 comp rx=0 tx=0).stop 2023-06-23T18:44:52.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.836+0000 7fcc30018700 1 -- 172.21.15.52:0/1727102566 shutdown_connections 2023-06-23T18:44:52.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.836+0000 7fcc30018700 1 --2- 172.21.15.52:0/1727102566 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc28145d50 0x7fcc2814bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:52.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.836+0000 7fcc30018700 1 --2- 172.21.15.52:0/1727102566 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc280b6bc0 0x7fcc280b7f60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:52.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.836+0000 7fcc30018700 1 -- 172.21.15.52:0/1727102566 >> 172.21.15.52:0/1727102566 conn(0x7fcc280bd3d0 msgr2=0x7fcc280bd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:52.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.836+0000 7fcc30018700 1 -- 172.21.15.52:0/1727102566 shutdown_connections 2023-06-23T18:44:52.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.836+0000 7fcc30018700 1 -- 172.21.15.52:0/1727102566 wait complete. 2023-06-23T18:44:52.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.837+0000 7fcc30018700 1 Processor -- start 2023-06-23T18:44:52.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.837+0000 7fcc30018700 1 -- start start 2023-06-23T18:44:52.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.838+0000 7fcc30018700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc280b6bc0 0x7fcc281ddb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:52.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.838+0000 7fcc30018700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc28145d50 0x7fcc28070420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:52.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.838+0000 7fcc30018700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc2814bac0 0x7fcc2813f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:52.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.838+0000 7fcc30018700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc28149460 con 0x7fcc280b6bc0 2023-06-23T18:44:52.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.838+0000 7fcc30018700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc28147c20 con 0x7fcc2814bac0 2023-06-23T18:44:52.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.838+0000 7fcc30018700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2814b2a0 con 0x7fcc28145d50 2023-06-23T18:44:52.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.838+0000 7fcc2ddb4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc280b6bc0 0x7fcc281ddb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:52.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.838+0000 7fcc2ddb4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc280b6bc0 0x7fcc281ddb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47440/0 (socket says 172.21.15.52:47440) 2023-06-23T18:44:52.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.838+0000 7fcc2ddb4700 1 -- 172.21.15.52:0/2050522729 learned_addr learned my addr 172.21.15.52:0/2050522729 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:52.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.838+0000 7fcc2e5b5700 1 --2- 172.21.15.52:0/2050522729 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc2814bac0 0x7fcc2813f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:52.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.838+0000 7fcc2d5b3700 1 --2- 172.21.15.52:0/2050522729 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc28145d50 0x7fcc28070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:52.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.839+0000 7fcc2ddb4700 1 -- 172.21.15.52:0/2050522729 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc28145d50 msgr2=0x7fcc28070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:52.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.839+0000 7fcc2ddb4700 1 --2- 172.21.15.52:0/2050522729 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc28145d50 0x7fcc28070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:52.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.839+0000 7fcc2ddb4700 1 -- 172.21.15.52:0/2050522729 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc2814bac0 msgr2=0x7fcc2813f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:52.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.839+0000 7fcc2ddb4700 1 --2- 172.21.15.52:0/2050522729 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc2814bac0 0x7fcc2813f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:52.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.839+0000 7fcc2ddb4700 1 -- 172.21.15.52:0/2050522729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc18009550 con 0x7fcc280b6bc0 2023-06-23T18:44:52.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.839+0000 7fcc2ddb4700 1 --2- 172.21.15.52:0/2050522729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc280b6bc0 0x7fcc281ddb60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcc280be380 tx=0x7fcc18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:52.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.839+0000 7fcc1e7fc700 1 -- 172.21.15.52:0/2050522729 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc18003aa0 con 0x7fcc280b6bc0 2023-06-23T18:44:52.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.839+0000 7fcc1e7fc700 1 -- 172.21.15.52:0/2050522729 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1801f070 con 0x7fcc280b6bc0 2023-06-23T18:44:52.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.839+0000 7fcc1e7fc700 1 -- 172.21.15.52:0/2050522729 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc18003e40 con 0x7fcc280b6bc0 2023-06-23T18:44:52.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.839+0000 7fcc30018700 1 -- 172.21.15.52:0/2050522729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc28149180 con 0x7fcc280b6bc0 2023-06-23T18:44:52.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.839+0000 7fcc30018700 1 -- 172.21.15.52:0/2050522729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc28148880 con 0x7fcc280b6bc0 2023-06-23T18:44:52.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.840+0000 7fcc30018700 1 -- 172.21.15.52:0/2050522729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc2814ad90 con 0x7fcc280b6bc0 2023-06-23T18:44:52.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.840+0000 7fcc1e7fc700 1 -- 172.21.15.52:0/2050522729 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcc18021030 con 0x7fcc280b6bc0 2023-06-23T18:44:52.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.841+0000 7fcc1e7fc700 1 --2- 172.21.15.52:0/2050522729 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcc0c06ace0 0x7fcc0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:52.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.841+0000 7fcc1e7fc700 1 -- 172.21.15.52:0/2050522729 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcc1808a950 con 0x7fcc280b6bc0 2023-06-23T18:44:52.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.841+0000 7fcc2d5b3700 1 --2- 172.21.15.52:0/2050522729 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcc0c06ace0 0x7fcc0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:52.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.841+0000 7fcc2d5b3700 1 --2- 172.21.15.52:0/2050522729 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcc0c06ace0 0x7fcc0c06d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcc28143290 tx=0x7fcc240090e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:52.851 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:52.845+0000 7fcc1e7fc700 1 -- 172.21.15.52:0/2050522729 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcc2814ad90 con 0x7fcc280b6bc0 2023-06-23T18:44:53.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.090+0000 7fcc30018700 1 -- 172.21.15.52:0/2050522729 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcc2814ad90 con 0x7fcc280b6bc0 2023-06-23T18:44:53.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.682+0000 7fcc1e7fc700 1 -- 172.21.15.52:0/2050522729 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcc2814ad90 con 0x7fcc280b6bc0 2023-06-23T18:44:53.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.684+0000 7fcc30018700 1 -- 172.21.15.52:0/2050522729 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcc0c06ace0 msgr2=0x7fcc0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:53.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.684+0000 7fcc30018700 1 --2- 172.21.15.52:0/2050522729 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcc0c06ace0 0x7fcc0c06d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcc28143290 tx=0x7fcc240090e0 comp rx=0 tx=0).stop 2023-06-23T18:44:53.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.684+0000 7fcc30018700 1 -- 172.21.15.52:0/2050522729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc280b6bc0 msgr2=0x7fcc281ddb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:53.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.684+0000 7fcc30018700 1 --2- 172.21.15.52:0/2050522729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc280b6bc0 0x7fcc281ddb60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcc280be380 tx=0x7fcc18004750 comp rx=0 tx=0).stop 2023-06-23T18:44:53.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.685+0000 7fcc30018700 1 -- 172.21.15.52:0/2050522729 shutdown_connections 2023-06-23T18:44:53.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.685+0000 7fcc30018700 1 --2- 172.21.15.52:0/2050522729 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcc0c06ace0 0x7fcc0c06d190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:53.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.685+0000 7fcc30018700 1 --2- 172.21.15.52:0/2050522729 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc2814bac0 0x7fcc2813f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:53.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.685+0000 7fcc30018700 1 --2- 172.21.15.52:0/2050522729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc280b6bc0 0x7fcc281ddb60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:53.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.685+0000 7fcc30018700 1 --2- 172.21.15.52:0/2050522729 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcc28145d50 0x7fcc28070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:53.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.685+0000 7fcc30018700 1 -- 172.21.15.52:0/2050522729 >> 172.21.15.52:0/2050522729 conn(0x7fcc280bd3d0 msgr2=0x7fcc2806afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:53.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.685+0000 7fcc30018700 1 -- 172.21.15.52:0/2050522729 shutdown_connections 2023-06-23T18:44:53.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.685+0000 7fcc30018700 1 -- 172.21.15.52:0/2050522729 wait complete. 2023-06-23T18:44:53.704 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-23T18:44:53.705 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T18:44:53.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.832+0000 7fde58e5d700 1 Processor -- start 2023-06-23T18:44:53.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.832+0000 7fde58e5d700 1 -- start start 2023-06-23T18:44:53.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.832+0000 7fde58e5d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fde5406a0d0 0x7fde540bc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:53.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.832+0000 7fde58e5d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde541444a0 0x7fde540b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:53.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.832+0000 7fde58e5d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fde540b5a20 0x7fde540bb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:53.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.832+0000 7fde58e5d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde540b7aa0 con 0x7fde540b5a20 2023-06-23T18:44:53.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.832+0000 7fde58e5d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde540b5f30 con 0x7fde5406a0d0 2023-06-23T18:44:53.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.832+0000 7fde58e5d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde540b6210 con 0x7fde541444a0 2023-06-23T18:44:53.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.833+0000 7fde52d9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fde540b5a20 0x7fde540bb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:53.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.833+0000 7fde52d9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fde540b5a20 0x7fde540bb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47452/0 (socket says 172.21.15.52:47452) 2023-06-23T18:44:53.840 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.833+0000 7fde52d9d700 1 -- 172.21.15.52:0/1550886021 learned_addr learned my addr 172.21.15.52:0/1550886021 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:53.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.833+0000 7fde5259c700 1 --2- 172.21.15.52:0/1550886021 >> v2:172.21.15.89:3300/0 conn(0x7fde5406a0d0 0x7fde540bc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:53.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.833+0000 7fde51d9b700 1 --2- 172.21.15.52:0/1550886021 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde541444a0 0x7fde540b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:53.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.833+0000 7fde52d9d700 1 -- 172.21.15.52:0/1550886021 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde541444a0 msgr2=0x7fde540b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:53.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.833+0000 7fde52d9d700 1 --2- 172.21.15.52:0/1550886021 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde541444a0 0x7fde540b54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:53.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.833+0000 7fde52d9d700 1 -- 172.21.15.52:0/1550886021 >> v2:172.21.15.89:3300/0 conn(0x7fde5406a0d0 msgr2=0x7fde540bc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:53.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.833+0000 7fde52d9d700 1 --2- 172.21.15.52:0/1550886021 >> v2:172.21.15.89:3300/0 conn(0x7fde5406a0d0 0x7fde540bc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:53.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.833+0000 7fde52d9d700 1 -- 172.21.15.52:0/1550886021 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde540b64f0 con 0x7fde540b5a20 2023-06-23T18:44:53.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.833+0000 7fde52d9d700 1 --2- 172.21.15.52:0/1550886021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde540b5a20 0x7fde540bb020 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fde5408a170 tx=0x7fde4c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9134cc72fde452bb server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:53.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.833+0000 7fde5159a700 1 -- 172.21.15.52:0/1550886021 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c00e070 con 0x7fde540b5a20 2023-06-23T18:44:53.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.833+0000 7fde5159a700 1 -- 172.21.15.52:0/1550886021 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c00b9c0 con 0x7fde540b5a20 2023-06-23T18:44:53.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.833+0000 7fde5159a700 1 -- 172.21.15.52:0/1550886021 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c00bd70 con 0x7fde540b5a20 2023-06-23T18:44:53.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.834+0000 7fde58e5d700 1 -- 172.21.15.52:0/1550886021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde540b5a20 msgr2=0x7fde540bb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:53.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.834+0000 7fde58e5d700 1 --2- 172.21.15.52:0/1550886021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde540b5a20 0x7fde540bb020 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fde5408a170 tx=0x7fde4c00b330 comp rx=0 tx=0).stop 2023-06-23T18:44:53.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.834+0000 7fde58e5d700 1 -- 172.21.15.52:0/1550886021 shutdown_connections 2023-06-23T18:44:53.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.834+0000 7fde58e5d700 1 --2- 172.21.15.52:0/1550886021 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde540b5a20 0x7fde540bb020 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:53.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.834+0000 7fde58e5d700 1 --2- 172.21.15.52:0/1550886021 >> v2:172.21.15.89:3300/0 conn(0x7fde5406a0d0 0x7fde540bc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:53.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.834+0000 7fde58e5d700 1 --2- 172.21.15.52:0/1550886021 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde541444a0 0x7fde540b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:53.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.834+0000 7fde58e5d700 1 -- 172.21.15.52:0/1550886021 >> 172.21.15.52:0/1550886021 conn(0x7fde5406bb90 msgr2=0x7fde5406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:53.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.834+0000 7fde58e5d700 1 -- 172.21.15.52:0/1550886021 shutdown_connections 2023-06-23T18:44:53.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.834+0000 7fde58e5d700 1 -- 172.21.15.52:0/1550886021 wait complete. 2023-06-23T18:44:53.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.835+0000 7fde58e5d700 1 Processor -- start 2023-06-23T18:44:53.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.835+0000 7fde58e5d700 1 -- start start 2023-06-23T18:44:53.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.836+0000 7fde58e5d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde5406a0d0 0x7fde541d5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:53.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.836+0000 7fde58e5d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde540b5a20 0x7fde54146b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:53.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.836+0000 7fde58e5d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde541444a0 0x7fde541e3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:53.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.836+0000 7fde58e5d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde54145800 con 0x7fde540b5a20 2023-06-23T18:44:53.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.836+0000 7fde58e5d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde54146680 con 0x7fde541444a0 2023-06-23T18:44:53.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.836+0000 7fde58e5d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde54145240 con 0x7fde5406a0d0 2023-06-23T18:44:53.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.836+0000 7fde51d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde540b5a20 0x7fde54146b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:53.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.836+0000 7fde51d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde540b5a20 0x7fde54146b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47460/0 (socket says 172.21.15.52:47460) 2023-06-23T18:44:53.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.836+0000 7fde51d9b700 1 -- 172.21.15.52:0/588022963 learned_addr learned my addr 172.21.15.52:0/588022963 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:53.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.836+0000 7fde5259c700 1 --2- 172.21.15.52:0/588022963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde5406a0d0 0x7fde541d5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:53.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.836+0000 7fde52d9d700 1 --2- 172.21.15.52:0/588022963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde541444a0 0x7fde541e3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:53.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.836+0000 7fde51d9b700 1 -- 172.21.15.52:0/588022963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde5406a0d0 msgr2=0x7fde541d5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:53.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.836+0000 7fde51d9b700 1 --2- 172.21.15.52:0/588022963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde5406a0d0 0x7fde541d5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:53.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.836+0000 7fde51d9b700 1 -- 172.21.15.52:0/588022963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde541444a0 msgr2=0x7fde541e3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:53.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.836+0000 7fde51d9b700 1 --2- 172.21.15.52:0/588022963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde541444a0 0x7fde541e3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:53.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.836+0000 7fde51d9b700 1 -- 172.21.15.52:0/588022963 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4c009b30 con 0x7fde540b5a20 2023-06-23T18:44:53.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.836+0000 7fde52d9d700 1 --2- 172.21.15.52:0/588022963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde541444a0 0x7fde541e3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:44:53.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.836+0000 7fde51d9b700 1 --2- 172.21.15.52:0/588022963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde540b5a20 0x7fde54146b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fde4800d800 tx=0x7fde4800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:53.848 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.837+0000 7fde42ffd700 1 -- 172.21.15.52:0/588022963 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde480125f0 con 0x7fde540b5a20 2023-06-23T18:44:53.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.837+0000 7fde42ffd700 1 -- 172.21.15.52:0/588022963 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde48012750 con 0x7fde540b5a20 2023-06-23T18:44:53.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.837+0000 7fde58e5d700 1 -- 172.21.15.52:0/588022963 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde54145520 con 0x7fde540b5a20 2023-06-23T18:44:53.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.837+0000 7fde42ffd700 1 -- 172.21.15.52:0/588022963 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde48012b00 con 0x7fde540b5a20 2023-06-23T18:44:53.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.837+0000 7fde58e5d700 1 -- 172.21.15.52:0/588022963 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde54147050 con 0x7fde540b5a20 2023-06-23T18:44:53.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.837+0000 7fde58e5d700 1 -- 172.21.15.52:0/588022963 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde54146810 con 0x7fde540b5a20 2023-06-23T18:44:53.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.838+0000 7fde42ffd700 1 -- 172.21.15.52:0/588022963 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fde48012c60 con 0x7fde540b5a20 2023-06-23T18:44:53.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.838+0000 7fde42ffd700 1 --2- 172.21.15.52:0/588022963 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fde3406ad10 0x7fde3406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:53.849 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.838+0000 7fde42ffd700 1 -- 172.21.15.52:0/588022963 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fde48089690 con 0x7fde540b5a20 2023-06-23T18:44:53.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.839+0000 7fde5259c700 1 --2- 172.21.15.52:0/588022963 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fde3406ad10 0x7fde3406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:53.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.839+0000 7fde5259c700 1 --2- 172.21.15.52:0/588022963 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fde3406ad10 0x7fde3406d1c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fde44006b20 tx=0x7fde44008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:53.850 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:53.843+0000 7fde42ffd700 1 -- 172.21.15.52:0/588022963 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fde480547d0 con 0x7fde540b5a20 2023-06-23T18:44:54.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.083+0000 7fde58e5d700 1 -- 172.21.15.52:0/588022963 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde5404e1d0 con 0x7fde540b5a20 2023-06-23T18:44:54.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.084+0000 7fde42ffd700 1 -- 172.21.15.52:0/588022963 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3906 (secure 0 0 0) 0x7fde48057df0 con 0x7fde540b5a20 2023-06-23T18:44:54.089 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:44:54.089 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/299877491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":299877491},{"type":"v1","addr":"172.21.15.89:6835","nonce":299877491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/2826461143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2826461143},{"type":"v1","addr":"172.21.15.52:6833","nonce":2826461143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T18:44:50.642376+0000","modified":"2023-06-23T18:44:53.679243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/4214822260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4214822260},{"type":"v1","addr":"172.21.15.52:6835","nonce":4214822260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-23T18:44:54.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.086+0000 7fde58e5d700 1 -- 172.21.15.52:0/588022963 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fde3406ad10 msgr2=0x7fde3406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:54.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.086+0000 7fde58e5d700 1 --2- 172.21.15.52:0/588022963 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fde3406ad10 0x7fde3406d1c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fde44006b20 tx=0x7fde44008040 comp rx=0 tx=0).stop 2023-06-23T18:44:54.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.086+0000 7fde58e5d700 1 -- 172.21.15.52:0/588022963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde540b5a20 msgr2=0x7fde54146b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:54.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.086+0000 7fde58e5d700 1 --2- 172.21.15.52:0/588022963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde540b5a20 0x7fde54146b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fde4800d800 tx=0x7fde4800db10 comp rx=0 tx=0).stop 2023-06-23T18:44:54.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.086+0000 7fde58e5d700 1 -- 172.21.15.52:0/588022963 shutdown_connections 2023-06-23T18:44:54.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.086+0000 7fde58e5d700 1 --2- 172.21.15.52:0/588022963 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fde3406ad10 0x7fde3406d1c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.086+0000 7fde58e5d700 1 --2- 172.21.15.52:0/588022963 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde541444a0 0x7fde541e3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.086+0000 7fde58e5d700 1 --2- 172.21.15.52:0/588022963 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde5406a0d0 0x7fde541d5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.086+0000 7fde58e5d700 1 --2- 172.21.15.52:0/588022963 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fde540b5a20 0x7fde54146b10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.086+0000 7fde58e5d700 1 -- 172.21.15.52:0/588022963 >> 172.21.15.52:0/588022963 conn(0x7fde5406bb90 msgr2=0x7fde540a5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:54.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.086+0000 7fde58e5d700 1 -- 172.21.15.52:0/588022963 shutdown_connections 2023-06-23T18:44:54.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.086+0000 7fde58e5d700 1 -- 172.21.15.52:0/588022963 wait complete. 2023-06-23T18:44:54.093 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2023-06-23T18:44:54.103 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:44:54.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.224+0000 7f602ec59700 1 Processor -- start 2023-06-23T18:44:54.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.225+0000 7f602ec59700 1 -- start start 2023-06-23T18:44:54.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.226+0000 7f602ec59700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f602806a0d0 0x7f60280bc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:54.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.226+0000 7f602ec59700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f60281448f0 0x7f6028154da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:54.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.226+0000 7f602ec59700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60280b7aa0 con 0x7f60281444a0 2023-06-23T18:44:54.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.226+0000 7f602ec59700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60280b5f30 con 0x7f60281448f0 2023-06-23T18:44:54.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.226+0000 7f602ec59700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60280b6210 con 0x7f602806a0d0 2023-06-23T18:44:54.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.226+0000 7f6027fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f60281444a0 0x7f60280b54e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48502/0 (socket says 172.21.15.52:48502) 2023-06-23T18:44:54.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.226+0000 7f6027fff700 1 -- 172.21.15.52:0/3695329179 learned_addr learned my addr 172.21.15.52:0/3695329179 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:54.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.226+0000 7f602c9f5700 1 --2- 172.21.15.52:0/3695329179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f602806a0d0 0x7f60280bc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:54.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.226+0000 7f602d1f6700 1 --2- 172.21.15.52:0/3695329179 >> v2:172.21.15.89:3300/0 conn(0x7f60281448f0 0x7f6028154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:54.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.226+0000 7f60277fe700 1 -- 172.21.15.52:0/3695329179 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3605573428 0 0) 0x7f60280b7aa0 con 0x7f60281444a0 2023-06-23T18:44:54.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.226+0000 7f60277fe700 1 -- 172.21.15.52:0/3695329179 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60180035b0 con 0x7f60281444a0 2023-06-23T18:44:54.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.226+0000 7f602c9f5700 1 -- 172.21.15.52:0/3695329179 >> v2:172.21.15.89:3300/0 conn(0x7f60281448f0 msgr2=0x7f6028154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:54.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.226+0000 7f602c9f5700 1 --2- 172.21.15.52:0/3695329179 >> v2:172.21.15.89:3300/0 conn(0x7f60281448f0 0x7f6028154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.226+0000 7f602c9f5700 1 -- 172.21.15.52:0/3695329179 >> v1:172.21.15.52:6789/0 conn(0x7f60281444a0 legacy=0x7f60280b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:54.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.226+0000 7f602c9f5700 1 -- 172.21.15.52:0/3695329179 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60280b64f0 con 0x7f602806a0d0 2023-06-23T18:44:54.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.226+0000 7f602c9f5700 1 --2- 172.21.15.52:0/3695329179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f602806a0d0 0x7f60280bc8b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f601c009840 tx=0x7f601c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=125ceedc5d1835ba server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:54.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.227+0000 7f60277fe700 1 -- 172.21.15.52:0/3695329179 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c011830 con 0x7f602806a0d0 2023-06-23T18:44:54.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.227+0000 7f60277fe700 1 -- 172.21.15.52:0/3695329179 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601c011990 con 0x7f602806a0d0 2023-06-23T18:44:54.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.227+0000 7f60277fe700 1 -- 172.21.15.52:0/3695329179 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c011d20 con 0x7f602806a0d0 2023-06-23T18:44:54.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.227+0000 7f602ec59700 1 -- 172.21.15.52:0/3695329179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f602806a0d0 msgr2=0x7f60280bc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:54.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.227+0000 7f602ec59700 1 --2- 172.21.15.52:0/3695329179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f602806a0d0 0x7f60280bc8b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f601c009840 tx=0x7f601c009b50 comp rx=0 tx=0).stop 2023-06-23T18:44:54.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.227+0000 7f602ec59700 1 -- 172.21.15.52:0/3695329179 shutdown_connections 2023-06-23T18:44:54.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.227+0000 7f602ec59700 1 --2- 172.21.15.52:0/3695329179 >> v2:172.21.15.89:3300/0 conn(0x7f60281448f0 0x7f6028154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.227+0000 7f602ec59700 1 --2- 172.21.15.52:0/3695329179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f602806a0d0 0x7f60280bc8b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.227+0000 7f602ec59700 1 -- 172.21.15.52:0/3695329179 >> 172.21.15.52:0/3695329179 conn(0x7f602806bb90 msgr2=0x7f602806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:54.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.227+0000 7f602ec59700 1 -- 172.21.15.52:0/3695329179 shutdown_connections 2023-06-23T18:44:54.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.227+0000 7f602ec59700 1 -- 172.21.15.52:0/3695329179 wait complete. 2023-06-23T18:44:54.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.229+0000 7f602ec59700 1 Processor -- start 2023-06-23T18:44:54.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.229+0000 7f602ec59700 1 -- start start 2023-06-23T18:44:54.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.230+0000 7f602ec59700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f602806a0d0 0x7f60280b92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:54.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.230+0000 7f602ec59700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60281444a0 0x7f60281421d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:54.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.230+0000 7f602ec59700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60281448f0 0x7f6028142710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:54.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.230+0000 7f602ec59700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6028140930 con 0x7f602806a0d0 2023-06-23T18:44:54.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.230+0000 7f602ec59700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60280b97f0 con 0x7f60281444a0 2023-06-23T18:44:54.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.230+0000 7f602ec59700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6028143080 con 0x7f60281448f0 2023-06-23T18:44:54.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.230+0000 7f602c9f5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f602806a0d0 0x7f60280b92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:54.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.230+0000 7f602c9f5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f602806a0d0 0x7f60280b92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47472/0 (socket says 172.21.15.52:47472) 2023-06-23T18:44:54.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.230+0000 7f602c9f5700 1 -- 172.21.15.52:0/1343820883 learned_addr learned my addr 172.21.15.52:0/1343820883 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:54.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.230+0000 7f602d1f6700 1 --2- 172.21.15.52:0/1343820883 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60281448f0 0x7f6028142710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:54.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.230+0000 7f6027fff700 1 --2- 172.21.15.52:0/1343820883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60281444a0 0x7f60281421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:54.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.230+0000 7f602c9f5700 1 -- 172.21.15.52:0/1343820883 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60281448f0 msgr2=0x7f6028142710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:54.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.230+0000 7f602c9f5700 1 --2- 172.21.15.52:0/1343820883 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60281448f0 0x7f6028142710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.230+0000 7f602c9f5700 1 -- 172.21.15.52:0/1343820883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60281444a0 msgr2=0x7f60281421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:54.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.230+0000 7f602c9f5700 1 --2- 172.21.15.52:0/1343820883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60281444a0 0x7f60281421d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.230+0000 7f602c9f5700 1 -- 172.21.15.52:0/1343820883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c0094a0 con 0x7f602806a0d0 2023-06-23T18:44:54.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.230+0000 7f602c9f5700 1 --2- 172.21.15.52:0/1343820883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f602806a0d0 0x7f60280b92b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f601c0090b0 tx=0x7f601c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:54.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.230+0000 7f60257fa700 1 -- 172.21.15.52:0/1343820883 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c004590 con 0x7f602806a0d0 2023-06-23T18:44:54.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.231+0000 7f60257fa700 1 -- 172.21.15.52:0/1343820883 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601c01f070 con 0x7f602806a0d0 2023-06-23T18:44:54.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.231+0000 7f602ec59700 1 -- 172.21.15.52:0/1343820883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60281432d0 con 0x7f602806a0d0 2023-06-23T18:44:54.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.231+0000 7f60257fa700 1 -- 172.21.15.52:0/1343820883 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c0038e0 con 0x7f602806a0d0 2023-06-23T18:44:54.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.231+0000 7f602ec59700 1 -- 172.21.15.52:0/1343820883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6028141db0 con 0x7f602806a0d0 2023-06-23T18:44:54.240 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.232+0000 7f602ec59700 1 -- 172.21.15.52:0/1343820883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60281403b0 con 0x7f602806a0d0 2023-06-23T18:44:54.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.232+0000 7f60257fa700 1 -- 172.21.15.52:0/1343820883 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f601c003a40 con 0x7f602806a0d0 2023-06-23T18:44:54.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.232+0000 7f60257fa700 1 --2- 172.21.15.52:0/1343820883 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f600c06ace0 0x7f600c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:54.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.233+0000 7f60257fa700 1 -- 172.21.15.52:0/1343820883 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f601c021070 con 0x7f602806a0d0 2023-06-23T18:44:54.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.233+0000 7f6027fff700 1 --2- 172.21.15.52:0/1343820883 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f600c06ace0 0x7f600c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:54.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.233+0000 7f6027fff700 1 --2- 172.21.15.52:0/1343820883 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f600c06ace0 0x7f600c06d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f60281d79f0 tx=0x7f6014007dc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:54.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.237+0000 7f60257fa700 1 -- 172.21.15.52:0/1343820883 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f60281403b0 con 0x7f602806a0d0 2023-06-23T18:44:54.442 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.437+0000 7f602ec59700 1 -- 172.21.15.52:0/1343820883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60281403b0 con 0x7f602806a0d0 2023-06-23T18:44:54.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.438+0000 7f60257fa700 1 -- 172.21.15.52:0/1343820883 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7f60281403b0 con 0x7f602806a0d0 2023-06-23T18:44:54.443 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:44:54.443 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","created":"2023-06-23T18:44:31.918434+0000","modified":"2023-06-23T18:44:51.644330+0000","last_up_change":"2023-06-23T18:44:42.169624+0000","last_in_change":"2023-06-23T18:44:34.510501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-23T18:44:43.346578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-23T18:44:43.829719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:44:48.517897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:44:49.621134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c371fb28-1b15-4e43-8d5a-43e402920ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6812","nonce":1066999520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6815","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6818","nonce":1066999520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6829","nonce":1066999520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6823","nonce":1066999520}]},"public_addr":"172.21.15.52:6812/1066999520","cluster_addr":"172.21.15.52:6818/1066999520","heartbeat_back_addr":"172.21.15.52:6829/1066999520","heartbeat_front_addr":"172.21.15.52:6823/1066999520","state":["exists","up"]},{"osd":1,"uuid":"4a142f04-33eb-47ec-9cc5-b08b44d82658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6813","nonce":2360219751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6819","nonce":2360219751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6830","nonce":2360219751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6825","nonce":2360219751}]},"public_addr":"172.21.15.52:6813/2360219751","cluster_addr":"172.21.15.52:6819/2360219751","heartbeat_back_addr":"172.21.15.52:6830/2360219751","heartbeat_front_addr":"172.21.15.52:6825/2360219751","state":["exists","up"]},{"osd":2,"uuid":"d7bb089d-4c55-4370-ba59-7fe88c39512a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6801","nonce":835073005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6803","nonce":835073005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6807","nonce":835073005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6805","nonce":835073005}]},"public_addr":"172.21.15.52:6801/835073005","cluster_addr":"172.21.15.52:6803/835073005","heartbeat_back_addr":"172.21.15.52:6807/835073005","heartbeat_front_addr":"172.21.15.52:6805/835073005","state":["exists","up"]},{"osd":3,"uuid":"4bcdcdc3-6a8f-468e-877e-57f76079ac3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6811","nonce":2852700864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6817","nonce":2852700864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6831","nonce":2852700864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6824","nonce":2852700864}]},"public_addr":"172.21.15.52:6811/2852700864","cluster_addr":"172.21.15.52:6817/2852700864","heartbeat_back_addr":"172.21.15.52:6831/2852700864","heartbeat_front_addr":"172.21.15.52:6824/2852700864","state":["exists","up"]},{"osd":4,"uuid":"cac63000-ae94-4b08-93e6-a99119640b63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6809","nonce":2538664679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6811","nonce":2538664679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6815","nonce":2538664679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6813","nonce":2538664679}]},"public_addr":"172.21.15.89:6809/2538664679","cluster_addr":"172.21.15.89:6811/2538664679","heartbeat_back_addr":"172.21.15.89:6815/2538664679","heartbeat_front_addr":"172.21.15.89:6813/2538664679","state":["exists","up"]},{"osd":5,"uuid":"45c53102-18a6-4fd7-9c25-8ea5e1ef6851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6801","nonce":1683710352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6803","nonce":1683710352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6807","nonce":1683710352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6805","nonce":1683710352}]},"public_addr":"172.21.15.89:6801/1683710352","cluster_addr":"172.21.15.89:6803/1683710352","heartbeat_back_addr":"172.21.15.89:6807/1683710352","heartbeat_front_addr":"172.21.15.89:6805/1683710352","state":["exists","up"]},{"osd":6,"uuid":"abee09d1-8eba-484f-a25c-871c1fe2e843","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6817","nonce":3890899288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6819","nonce":3890899288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6823","nonce":3890899288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6821","nonce":3890899288}]},"public_addr":"172.21.15.89:6817/3890899288","cluster_addr":"172.21.15.89:6819/3890899288","heartbeat_back_addr":"172.21.15.89:6823/3890899288","heartbeat_front_addr":"172.21.15.89:6821/3890899288","state":["exists","up"]},{"osd":7,"uuid":"5acf9e2e-00dd-4f9b-a7d9-3d820f695de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6825","nonce":2989085420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6827","nonce":2989085420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6831","nonce":2989085420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6829","nonce":2989085420}]},"public_addr":"172.21.15.89:6825/2989085420","cluster_addr":"172.21.15.89:6827/2989085420","heartbeat_back_addr":"172.21.15.89:6831/2989085420","heartbeat_front_addr":"172.21.15.89:6829/2989085420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.663866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.710904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.619347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.660102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.686933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.724635+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.669111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.678740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:44:54.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.440+0000 7f602ec59700 1 -- 172.21.15.52:0/1343820883 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f600c06ace0 msgr2=0x7f600c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:54.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.440+0000 7f602ec59700 1 --2- 172.21.15.52:0/1343820883 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f600c06ace0 0x7f600c06d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f60281d79f0 tx=0x7f6014007dc0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.440+0000 7f602ec59700 1 -- 172.21.15.52:0/1343820883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f602806a0d0 msgr2=0x7f60280b92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:54.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.440+0000 7f602ec59700 1 --2- 172.21.15.52:0/1343820883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f602806a0d0 0x7f60280b92b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f601c0090b0 tx=0x7f601c004750 comp rx=0 tx=0).stop 2023-06-23T18:44:54.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.441+0000 7f602ec59700 1 -- 172.21.15.52:0/1343820883 shutdown_connections 2023-06-23T18:44:54.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.441+0000 7f602ec59700 1 --2- 172.21.15.52:0/1343820883 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f600c06ace0 0x7f600c06d190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.441+0000 7f602ec59700 1 --2- 172.21.15.52:0/1343820883 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60281448f0 0x7f6028142710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.441+0000 7f602ec59700 1 --2- 172.21.15.52:0/1343820883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f602806a0d0 0x7f60280b92b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.441+0000 7f602ec59700 1 --2- 172.21.15.52:0/1343820883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60281444a0 0x7f60281421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.441+0000 7f602ec59700 1 -- 172.21.15.52:0/1343820883 >> 172.21.15.52:0/1343820883 conn(0x7f602806bb90 msgr2=0x7f602806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:54.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.441+0000 7f602ec59700 1 -- 172.21.15.52:0/1343820883 shutdown_connections 2023-06-23T18:44:54.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.441+0000 7f602ec59700 1 -- 172.21.15.52:0/1343820883 wait complete. 2023-06-23T18:44:54.458 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-23T18:44:54.458 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T18:44:54.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.579+0000 7fa6dddf3700 1 Processor -- start 2023-06-23T18:44:54.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.579+0000 7fa6dddf3700 1 -- start start 2023-06-23T18:44:54.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.580+0000 7fa6dddf3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa6d806c1f0 0x7fa6d81473d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:54.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.580+0000 7fa6dddf3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa6d80b7c70 0x7fa6d8147910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:54.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.580+0000 7fa6dddf3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6d8071540 0x7fa6d80719b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:54.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.580+0000 7fa6dddf3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d80b8fb0 con 0x7fa6d80b7c70 2023-06-23T18:44:54.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.580+0000 7fa6dddf3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6d80b8b20 con 0x7fa6d806c1f0 2023-06-23T18:44:54.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.580+0000 7fa6dddf3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d80b9b20 con 0x7fa6d8071540 2023-06-23T18:44:54.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.580+0000 7fa6ceffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa6d80b7c70 0x7fa6d8147910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:54.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.580+0000 7fa6ceffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa6d80b7c70 0x7fa6d8147910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47486/0 (socket says 172.21.15.52:47486) 2023-06-23T18:44:54.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.580+0000 7fa6ceffd700 1 -- 172.21.15.52:0/4035758291 learned_addr learned my addr 172.21.15.52:0/4035758291 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:54.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.580+0000 7fa6d7fff700 1 --2- 172.21.15.52:0/4035758291 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6d8071540 0x7fa6d80719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:54.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.580+0000 7fa6d77fe700 1 --2- 172.21.15.52:0/4035758291 >> v2:172.21.15.89:3300/0 conn(0x7fa6d806c1f0 0x7fa6d81473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:54.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.581+0000 7fa6ceffd700 1 -- 172.21.15.52:0/4035758291 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6d8071540 msgr2=0x7fa6d80719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:54.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.581+0000 7fa6ceffd700 1 --2- 172.21.15.52:0/4035758291 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6d8071540 0x7fa6d80719b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.581+0000 7fa6ceffd700 1 -- 172.21.15.52:0/4035758291 >> v2:172.21.15.89:3300/0 conn(0x7fa6d806c1f0 msgr2=0x7fa6d81473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:54.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.581+0000 7fa6ceffd700 1 --2- 172.21.15.52:0/4035758291 >> v2:172.21.15.89:3300/0 conn(0x7fa6d806c1f0 0x7fa6d81473d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.581+0000 7fa6ceffd700 1 -- 172.21.15.52:0/4035758291 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d80b49b0 con 0x7fa6d80b7c70 2023-06-23T18:44:54.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.581+0000 7fa6d77fe700 1 --2- 172.21.15.52:0/4035758291 >> v2:172.21.15.89:3300/0 conn(0x7fa6d806c1f0 0x7fa6d81473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:44:54.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.581+0000 7fa6ceffd700 1 --2- 172.21.15.52:0/4035758291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d80b7c70 0x7fa6d8147910 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa6d806ecf0 tx=0x7fa6c000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419183bb6a7a0ee8 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:54.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.581+0000 7fa6d6ffd700 1 -- 172.21.15.52:0/4035758291 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c000dc70 con 0x7fa6d80b7c70 2023-06-23T18:44:54.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.581+0000 7fa6d6ffd700 1 -- 172.21.15.52:0/4035758291 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c000ddd0 con 0x7fa6d80b7c70 2023-06-23T18:44:54.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.581+0000 7fa6d6ffd700 1 -- 172.21.15.52:0/4035758291 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0010690 con 0x7fa6d80b7c70 2023-06-23T18:44:54.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.581+0000 7fa6dddf3700 1 -- 172.21.15.52:0/4035758291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d80b7c70 msgr2=0x7fa6d8147910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:54.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.581+0000 7fa6dddf3700 1 --2- 172.21.15.52:0/4035758291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d80b7c70 0x7fa6d8147910 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa6d806ecf0 tx=0x7fa6c000be70 comp rx=0 tx=0).stop 2023-06-23T18:44:54.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.581+0000 7fa6dddf3700 1 -- 172.21.15.52:0/4035758291 shutdown_connections 2023-06-23T18:44:54.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.582+0000 7fa6dddf3700 1 --2- 172.21.15.52:0/4035758291 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6d8071540 0x7fa6d80719b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.582+0000 7fa6dddf3700 1 --2- 172.21.15.52:0/4035758291 >> v2:172.21.15.89:3300/0 conn(0x7fa6d806c1f0 0x7fa6d81473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.582+0000 7fa6dddf3700 1 --2- 172.21.15.52:0/4035758291 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d80b7c70 0x7fa6d8147910 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.582+0000 7fa6dddf3700 1 -- 172.21.15.52:0/4035758291 >> 172.21.15.52:0/4035758291 conn(0x7fa6d80bdf30 msgr2=0x7fa6d80b9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:54.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.582+0000 7fa6dddf3700 1 -- 172.21.15.52:0/4035758291 shutdown_connections 2023-06-23T18:44:54.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.582+0000 7fa6dddf3700 1 -- 172.21.15.52:0/4035758291 wait complete. 2023-06-23T18:44:54.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.583+0000 7fa6dddf3700 1 Processor -- start 2023-06-23T18:44:54.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.583+0000 7fa6dddf3700 1 -- start start 2023-06-23T18:44:54.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.583+0000 7fa6dddf3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6d806c1f0 0x7fa6d8140a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:54.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.583+0000 7fa6dddf3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d8071540 0x7fa6d81d0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:54.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.583+0000 7fa6dddf3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6d80b7c70 0x7fa6d81d1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:54.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.583+0000 7fa6dddf3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d8140fa0 con 0x7fa6d8071540 2023-06-23T18:44:54.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.583+0000 7fa6dddf3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d81d0970 con 0x7fa6d806c1f0 2023-06-23T18:44:54.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.583+0000 7fa6dddf3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d813fad0 con 0x7fa6d80b7c70 2023-06-23T18:44:54.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.584+0000 7fa6ceffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d8071540 0x7fa6d81d0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:54.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.584+0000 7fa6ceffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d8071540 0x7fa6d81d0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47498/0 (socket says 172.21.15.52:47498) 2023-06-23T18:44:54.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.584+0000 7fa6ceffd700 1 -- 172.21.15.52:0/3929802006 learned_addr learned my addr 172.21.15.52:0/3929802006 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:54.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.584+0000 7fa6d7fff700 1 --2- 172.21.15.52:0/3929802006 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6d80b7c70 0x7fa6d81d1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:54.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.584+0000 7fa6d77fe700 1 --2- 172.21.15.52:0/3929802006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6d806c1f0 0x7fa6d8140a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:54.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.584+0000 7fa6ceffd700 1 -- 172.21.15.52:0/3929802006 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6d80b7c70 msgr2=0x7fa6d81d1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:54.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.584+0000 7fa6ceffd700 1 --2- 172.21.15.52:0/3929802006 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6d80b7c70 0x7fa6d81d1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.584+0000 7fa6ceffd700 1 -- 172.21.15.52:0/3929802006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6d806c1f0 msgr2=0x7fa6d8140a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:54.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.584+0000 7fa6ceffd700 1 --2- 172.21.15.52:0/3929802006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6d806c1f0 0x7fa6d8140a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.584+0000 7fa6ceffd700 1 -- 172.21.15.52:0/3929802006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c000b7f0 con 0x7fa6d8071540 2023-06-23T18:44:54.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.584+0000 7fa6d77fe700 1 --2- 172.21.15.52:0/3929802006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6d806c1f0 0x7fa6d8140a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:44:54.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.584+0000 7fa6ceffd700 1 --2- 172.21.15.52:0/3929802006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d8071540 0x7fa6d81d0e00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa6d806f890 tx=0x7fa6c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:54.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.584+0000 7fa6d4ff9700 1 -- 172.21.15.52:0/3929802006 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0003b70 con 0x7fa6d8071540 2023-06-23T18:44:54.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.584+0000 7fa6d4ff9700 1 -- 172.21.15.52:0/3929802006 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c0003cd0 con 0x7fa6d8071540 2023-06-23T18:44:54.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.584+0000 7fa6dddf3700 1 -- 172.21.15.52:0/3929802006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d81d3490 con 0x7fa6d8071540 2023-06-23T18:44:54.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.584+0000 7fa6d4ff9700 1 -- 172.21.15.52:0/3929802006 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c00106b0 con 0x7fa6d8071540 2023-06-23T18:44:54.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.584+0000 7fa6dddf3700 1 -- 172.21.15.52:0/3929802006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d813f7f0 con 0x7fa6d8071540 2023-06-23T18:44:54.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.585+0000 7fa6dddf3700 1 -- 172.21.15.52:0/3929802006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d81d0b20 con 0x7fa6d8071540 2023-06-23T18:44:54.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.586+0000 7fa6d4ff9700 1 -- 172.21.15.52:0/3929802006 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa6c0019400 con 0x7fa6d8071540 2023-06-23T18:44:54.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.586+0000 7fa6d4ff9700 1 --2- 172.21.15.52:0/3929802006 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa6b806ace0 0x7fa6b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:54.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.586+0000 7fa6d4ff9700 1 -- 172.21.15.52:0/3929802006 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa6c008a990 con 0x7fa6d8071540 2023-06-23T18:44:54.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.586+0000 7fa6d77fe700 1 --2- 172.21.15.52:0/3929802006 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa6b806ace0 0x7fa6b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:54.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.587+0000 7fa6d77fe700 1 --2- 172.21.15.52:0/3929802006 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa6b806ace0 0x7fa6b806d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa6c80099f0 tx=0x7fa6c8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:54.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.590+0000 7fa6d4ff9700 1 -- 172.21.15.52:0/3929802006 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa6d81d0b20 con 0x7fa6d8071540 2023-06-23T18:44:54.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.782+0000 7fa6dddf3700 1 -- 172.21.15.52:0/3929802006 --> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa6d806fa40 con 0x7fa6b806ace0 2023-06-23T18:44:54.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.791+0000 7fa6d4ff9700 1 -- 172.21.15.52:0/3929802006 <== mgr.4106 v2:172.21.15.89:6832/397406548 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286914 (secure 0 0 0) 0x7fa6c8009680 con 0x7fa6b806ace0 2023-06-23T18:44:54.799 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:44:54.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.795+0000 7fa6dddf3700 1 -- 172.21.15.52:0/3929802006 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa6b806ace0 msgr2=0x7fa6b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:54.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.795+0000 7fa6dddf3700 1 --2- 172.21.15.52:0/3929802006 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa6b806ace0 0x7fa6b806d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa6c80099f0 tx=0x7fa6c8008040 comp rx=0 tx=0).stop 2023-06-23T18:44:54.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.795+0000 7fa6dddf3700 1 -- 172.21.15.52:0/3929802006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d8071540 msgr2=0x7fa6d81d0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:54.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.795+0000 7fa6dddf3700 1 --2- 172.21.15.52:0/3929802006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d8071540 0x7fa6d81d0e00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa6d806f890 tx=0x7fa6c0004750 comp rx=0 tx=0).stop 2023-06-23T18:44:54.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.795+0000 7fa6dddf3700 1 -- 172.21.15.52:0/3929802006 shutdown_connections 2023-06-23T18:44:54.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.795+0000 7fa6dddf3700 1 --2- 172.21.15.52:0/3929802006 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa6b806ace0 0x7fa6b806d190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.795+0000 7fa6dddf3700 1 --2- 172.21.15.52:0/3929802006 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6d80b7c70 0x7fa6d81d1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.795+0000 7fa6dddf3700 1 --2- 172.21.15.52:0/3929802006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6d806c1f0 0x7fa6d8140a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.795+0000 7fa6dddf3700 1 --2- 172.21.15.52:0/3929802006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa6d8071540 0x7fa6d81d0e00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.795+0000 7fa6dddf3700 1 -- 172.21.15.52:0/3929802006 >> 172.21.15.52:0/3929802006 conn(0x7fa6d80bdf30 msgr2=0x7fa6d8146370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:54.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.795+0000 7fa6dddf3700 1 -- 172.21.15.52:0/3929802006 shutdown_connections 2023-06-23T18:44:54.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.795+0000 7fa6dddf3700 1 -- 172.21.15.52:0/3929802006 wait complete. 2023-06-23T18:44:54.803 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-06-23T18:44:54.812 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-06-23T18:44:53.776338+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218496,"kb_used_data":2880,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756224,"statfs":{"total":773094113280,"available":772870373376,"internally_reserved":0,"allocated":2949120,"data_stored":1797332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.558628"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.670832+0000","last_change":"2023-06-23T18:44:50.669535+0000","last_active":"2023-06-23T18:44:50.670832+0000","last_peered":"2023-06-23T18:44:50.670832+0000","last_clean":"2023-06-23T18:44:50.670832+0000","last_became_active":"2023-06-23T18:44:50.669314+0000","last_became_peered":"2023-06-23T18:44:50.669314+0000","last_unstale":"2023-06-23T18:44:50.670832+0000","last_undegraded":"2023-06-23T18:44:50.670832+0000","last_fullsized":"2023-06-23T18:44:50.670832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:33:18.398833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.663610+0000","last_change":"2023-06-23T18:44:50.655548+0000","last_active":"2023-06-23T18:44:50.663610+0000","last_peered":"2023-06-23T18:44:50.663610+0000","last_clean":"2023-06-23T18:44:50.663610+0000","last_became_active":"2023-06-23T18:44:50.655143+0000","last_became_peered":"2023-06-23T18:44:50.655143+0000","last_unstale":"2023-06-23T18:44:50.663610+0000","last_undegraded":"2023-06-23T18:44:50.663610+0000","last_fullsized":"2023-06-23T18:44:50.663610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:03:32.209474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498122+0000","last_change":"2023-06-23T18:44:50.667478+0000","last_active":"2023-06-23T18:44:52.498122+0000","last_peered":"2023-06-23T18:44:52.498122+0000","last_clean":"2023-06-23T18:44:52.498122+0000","last_became_active":"2023-06-23T18:44:50.667142+0000","last_became_peered":"2023-06-23T18:44:50.667142+0000","last_unstale":"2023-06-23T18:44:52.498122+0000","last_undegraded":"2023-06-23T18:44:52.498122+0000","last_fullsized":"2023-06-23T18:44:52.498122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:48:26.644150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655406+0000","last_change":"2023-06-23T18:44:50.663624+0000","last_active":"2023-06-23T18:44:51.655406+0000","last_peered":"2023-06-23T18:44:51.655406+0000","last_clean":"2023-06-23T18:44:51.655406+0000","last_became_active":"2023-06-23T18:44:50.663376+0000","last_became_peered":"2023-06-23T18:44:50.663376+0000","last_unstale":"2023-06-23T18:44:51.655406+0000","last_undegraded":"2023-06-23T18:44:51.655406+0000","last_fullsized":"2023-06-23T18:44:51.655406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:17:28.994298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404393+0000","last_change":"2023-06-23T18:44:50.671557+0000","last_active":"2023-06-23T18:44:52.404393+0000","last_peered":"2023-06-23T18:44:52.404393+0000","last_clean":"2023-06-23T18:44:52.404393+0000","last_became_active":"2023-06-23T18:44:50.671298+0000","last_became_peered":"2023-06-23T18:44:50.671298+0000","last_unstale":"2023-06-23T18:44:52.404393+0000","last_undegraded":"2023-06-23T18:44:52.404393+0000","last_fullsized":"2023-06-23T18:44:52.404393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:06:39.243693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498058+0000","last_change":"2023-06-23T18:44:50.664406+0000","last_active":"2023-06-23T18:44:52.498058+0000","last_peered":"2023-06-23T18:44:52.498058+0000","last_clean":"2023-06-23T18:44:52.498058+0000","last_became_active":"2023-06-23T18:44:50.664144+0000","last_became_peered":"2023-06-23T18:44:50.664144+0000","last_unstale":"2023-06-23T18:44:52.498058+0000","last_undegraded":"2023-06-23T18:44:52.498058+0000","last_fullsized":"2023-06-23T18:44:52.498058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:43:05.880234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006057+0000","last_change":"2023-06-23T18:44:50.669048+0000","last_active":"2023-06-23T18:44:52.006057+0000","last_peered":"2023-06-23T18:44:52.006057+0000","last_clean":"2023-06-23T18:44:52.006057+0000","last_became_active":"2023-06-23T18:44:50.668771+0000","last_became_peered":"2023-06-23T18:44:50.668771+0000","last_unstale":"2023-06-23T18:44:52.006057+0000","last_undegraded":"2023-06-23T18:44:52.006057+0000","last_fullsized":"2023-06-23T18:44:52.006057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:43:05.880234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.669844+0000","last_change":"2023-06-23T18:44:50.667476+0000","last_active":"2023-06-23T18:44:50.669844+0000","last_peered":"2023-06-23T18:44:50.669844+0000","last_clean":"2023-06-23T18:44:50.669844+0000","last_became_active":"2023-06-23T18:44:50.667193+0000","last_became_peered":"2023-06-23T18:44:50.667193+0000","last_unstale":"2023-06-23T18:44:50.669844+0000","last_undegraded":"2023-06-23T18:44:50.669844+0000","last_fullsized":"2023-06-23T18:44:50.669844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:50:10.163258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404434+0000","last_change":"2023-06-23T18:44:50.659873+0000","last_active":"2023-06-23T18:44:52.404434+0000","last_peered":"2023-06-23T18:44:52.404434+0000","last_clean":"2023-06-23T18:44:52.404434+0000","last_became_active":"2023-06-23T18:44:50.659596+0000","last_became_peered":"2023-06-23T18:44:50.659596+0000","last_unstale":"2023-06-23T18:44:52.404434+0000","last_undegraded":"2023-06-23T18:44:52.404434+0000","last_fullsized":"2023-06-23T18:44:52.404434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:11:35.546421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.664373+0000","last_change":"2023-06-23T18:44:50.662516+0000","last_active":"2023-06-23T18:44:50.664373+0000","last_peered":"2023-06-23T18:44:50.664373+0000","last_clean":"2023-06-23T18:44:50.664373+0000","last_became_active":"2023-06-23T18:44:50.662228+0000","last_became_peered":"2023-06-23T18:44:50.662228+0000","last_unstale":"2023-06-23T18:44:50.664373+0000","last_undegraded":"2023-06-23T18:44:50.664373+0000","last_fullsized":"2023-06-23T18:44:50.664373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:26:28.408408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498265+0000","last_change":"2023-06-23T18:44:50.669567+0000","last_active":"2023-06-23T18:44:52.498265+0000","last_peered":"2023-06-23T18:44:52.498265+0000","last_clean":"2023-06-23T18:44:52.498265+0000","last_became_active":"2023-06-23T18:44:50.667154+0000","last_became_peered":"2023-06-23T18:44:50.667154+0000","last_unstale":"2023-06-23T18:44:52.498265+0000","last_undegraded":"2023-06-23T18:44:52.498265+0000","last_fullsized":"2023-06-23T18:44:52.498265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:34:35.075905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.670274+0000","last_change":"2023-06-23T18:44:50.667100+0000","last_active":"2023-06-23T18:44:50.670274+0000","last_peered":"2023-06-23T18:44:50.670274+0000","last_clean":"2023-06-23T18:44:50.670274+0000","last_became_active":"2023-06-23T18:44:50.666768+0000","last_became_peered":"2023-06-23T18:44:50.666768+0000","last_unstale":"2023-06-23T18:44:50.670274+0000","last_undegraded":"2023-06-23T18:44:50.670274+0000","last_fullsized":"2023-06-23T18:44:50.670274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:36:48.977717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.671460+0000","last_change":"2023-06-23T18:44:50.670413+0000","last_active":"2023-06-23T18:44:50.671460+0000","last_peered":"2023-06-23T18:44:50.671460+0000","last_clean":"2023-06-23T18:44:50.671460+0000","last_became_active":"2023-06-23T18:44:50.670105+0000","last_became_peered":"2023-06-23T18:44:50.670105+0000","last_unstale":"2023-06-23T18:44:50.671460+0000","last_undegraded":"2023-06-23T18:44:50.671460+0000","last_fullsized":"2023-06-23T18:44:50.671460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:34:24.673029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.663297+0000","last_change":"2023-06-23T18:44:50.655737+0000","last_active":"2023-06-23T18:44:50.663297+0000","last_peered":"2023-06-23T18:44:50.663297+0000","last_clean":"2023-06-23T18:44:50.663297+0000","last_became_active":"2023-06-23T18:44:50.655253+0000","last_became_peered":"2023-06-23T18:44:50.655253+0000","last_unstale":"2023-06-23T18:44:50.663297+0000","last_undegraded":"2023-06-23T18:44:50.663297+0000","last_fullsized":"2023-06-23T18:44:50.663297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:20:59.100212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006225+0000","last_change":"2023-06-23T18:44:50.669573+0000","last_active":"2023-06-23T18:44:52.006225+0000","last_peered":"2023-06-23T18:44:52.006225+0000","last_clean":"2023-06-23T18:44:52.006225+0000","last_became_active":"2023-06-23T18:44:50.668886+0000","last_became_peered":"2023-06-23T18:44:50.668886+0000","last_unstale":"2023-06-23T18:44:52.006225+0000","last_undegraded":"2023-06-23T18:44:52.006225+0000","last_fullsized":"2023-06-23T18:44:52.006225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:00:29.622659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.497857+0000","last_change":"2023-06-23T18:44:50.664890+0000","last_active":"2023-06-23T18:44:52.497857+0000","last_peered":"2023-06-23T18:44:52.497857+0000","last_clean":"2023-06-23T18:44:52.497857+0000","last_became_active":"2023-06-23T18:44:50.664571+0000","last_became_peered":"2023-06-23T18:44:50.664571+0000","last_unstale":"2023-06-23T18:44:52.497857+0000","last_undegraded":"2023-06-23T18:44:52.497857+0000","last_fullsized":"2023-06-23T18:44:52.497857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:24:20.739761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404406+0000","last_change":"2023-06-23T18:44:50.672231+0000","last_active":"2023-06-23T18:44:52.404406+0000","last_peered":"2023-06-23T18:44:52.404406+0000","last_clean":"2023-06-23T18:44:52.404406+0000","last_became_active":"2023-06-23T18:44:50.671979+0000","last_became_peered":"2023-06-23T18:44:50.671979+0000","last_unstale":"2023-06-23T18:44:52.404406+0000","last_undegraded":"2023-06-23T18:44:52.404406+0000","last_fullsized":"2023-06-23T18:44:52.404406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:53:28.521694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498218+0000","last_change":"2023-06-23T18:44:50.667846+0000","last_active":"2023-06-23T18:44:52.498218+0000","last_peered":"2023-06-23T18:44:52.498218+0000","last_clean":"2023-06-23T18:44:52.498218+0000","last_became_active":"2023-06-23T18:44:50.667545+0000","last_became_peered":"2023-06-23T18:44:50.667545+0000","last_unstale":"2023-06-23T18:44:52.498218+0000","last_undegraded":"2023-06-23T18:44:52.498218+0000","last_fullsized":"2023-06-23T18:44:52.498218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:59:07.537499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.664727+0000","last_change":"2023-06-23T18:44:50.662459+0000","last_active":"2023-06-23T18:44:50.664727+0000","last_peered":"2023-06-23T18:44:50.664727+0000","last_clean":"2023-06-23T18:44:50.664727+0000","last_became_active":"2023-06-23T18:44:50.662128+0000","last_became_peered":"2023-06-23T18:44:50.662128+0000","last_unstale":"2023-06-23T18:44:50.664727+0000","last_undegraded":"2023-06-23T18:44:50.664727+0000","last_fullsized":"2023-06-23T18:44:50.664727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:28:50.984289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498229+0000","last_change":"2023-06-23T18:44:50.670686+0000","last_active":"2023-06-23T18:44:52.498229+0000","last_peered":"2023-06-23T18:44:52.498229+0000","last_clean":"2023-06-23T18:44:52.498229+0000","last_became_active":"2023-06-23T18:44:50.670397+0000","last_became_peered":"2023-06-23T18:44:50.670397+0000","last_unstale":"2023-06-23T18:44:52.498229+0000","last_undegraded":"2023-06-23T18:44:52.498229+0000","last_fullsized":"2023-06-23T18:44:52.498229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:29:44.651970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006353+0000","last_change":"2023-06-23T18:44:50.676320+0000","last_active":"2023-06-23T18:44:52.006353+0000","last_peered":"2023-06-23T18:44:52.006353+0000","last_clean":"2023-06-23T18:44:52.006353+0000","last_became_active":"2023-06-23T18:44:50.676054+0000","last_became_peered":"2023-06-23T18:44:50.676054+0000","last_unstale":"2023-06-23T18:44:52.006353+0000","last_undegraded":"2023-06-23T18:44:52.006353+0000","last_fullsized":"2023-06-23T18:44:52.006353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:59:07.537499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404037+0000","last_change":"2023-06-23T18:44:50.663287+0000","last_active":"2023-06-23T18:44:52.404037+0000","last_peered":"2023-06-23T18:44:52.404037+0000","last_clean":"2023-06-23T18:44:52.404037+0000","last_became_active":"2023-06-23T18:44:50.663006+0000","last_became_peered":"2023-06-23T18:44:50.663006+0000","last_unstale":"2023-06-23T18:44:52.404037+0000","last_undegraded":"2023-06-23T18:44:52.404037+0000","last_fullsized":"2023-06-23T18:44:52.404037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:17:28.994298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.675472+0000","last_change":"2023-06-23T18:44:50.668418+0000","last_active":"2023-06-23T18:44:50.675472+0000","last_peered":"2023-06-23T18:44:50.675472+0000","last_clean":"2023-06-23T18:44:50.675472+0000","last_became_active":"2023-06-23T18:44:50.668029+0000","last_became_peered":"2023-06-23T18:44:50.668029+0000","last_unstale":"2023-06-23T18:44:50.675472+0000","last_undegraded":"2023-06-23T18:44:50.675472+0000","last_fullsized":"2023-06-23T18:44:50.675472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:14:45.542328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006017+0000","last_change":"2023-06-23T18:44:50.675363+0000","last_active":"2023-06-23T18:44:52.006017+0000","last_peered":"2023-06-23T18:44:52.006017+0000","last_clean":"2023-06-23T18:44:52.006017+0000","last_became_active":"2023-06-23T18:44:50.675099+0000","last_became_peered":"2023-06-23T18:44:50.675099+0000","last_unstale":"2023-06-23T18:44:52.006017+0000","last_undegraded":"2023-06-23T18:44:52.006017+0000","last_fullsized":"2023-06-23T18:44:52.006017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:24:00.797602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650898+0000","last_change":"2023-06-23T18:44:50.662603+0000","last_active":"2023-06-23T18:44:51.650898+0000","last_peered":"2023-06-23T18:44:51.650898+0000","last_clean":"2023-06-23T18:44:51.650898+0000","last_became_active":"2023-06-23T18:44:50.662318+0000","last_became_peered":"2023-06-23T18:44:50.662318+0000","last_unstale":"2023-06-23T18:44:51.650898+0000","last_undegraded":"2023-06-23T18:44:51.650898+0000","last_fullsized":"2023-06-23T18:44:51.650898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:23:07.364903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650929+0000","last_change":"2023-06-23T18:44:50.655943+0000","last_active":"2023-06-23T18:44:51.650929+0000","last_peered":"2023-06-23T18:44:51.650929+0000","last_clean":"2023-06-23T18:44:51.650929+0000","last_became_active":"2023-06-23T18:44:50.655672+0000","last_became_peered":"2023-06-23T18:44:50.655672+0000","last_unstale":"2023-06-23T18:44:51.650929+0000","last_undegraded":"2023-06-23T18:44:51.650929+0000","last_fullsized":"2023-06-23T18:44:51.650929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:53:28.521694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.671526+0000","last_change":"2023-06-23T18:44:50.670220+0000","last_active":"2023-06-23T18:44:50.671526+0000","last_peered":"2023-06-23T18:44:50.671526+0000","last_clean":"2023-06-23T18:44:50.671526+0000","last_became_active":"2023-06-23T18:44:50.669773+0000","last_became_peered":"2023-06-23T18:44:50.669773+0000","last_unstale":"2023-06-23T18:44:50.671526+0000","last_undegraded":"2023-06-23T18:44:50.671526+0000","last_fullsized":"2023-06-23T18:44:50.671526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:48:22.694731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498027+0000","last_change":"2023-06-23T18:44:50.246485+0000","last_active":"2023-06-23T18:44:52.498027+0000","last_peered":"2023-06-23T18:44:52.498027+0000","last_clean":"2023-06-23T18:44:52.498027+0000","last_became_active":"2023-06-23T18:44:50.246186+0000","last_became_peered":"2023-06-23T18:44:50.246186+0000","last_unstale":"2023-06-23T18:44:52.498027+0000","last_undegraded":"2023-06-23T18:44:52.498027+0000","last_fullsized":"2023-06-23T18:44:52.498027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:00:28.617628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.674669+0000","last_change":"2023-06-23T18:44:50.665653+0000","last_active":"2023-06-23T18:44:50.674669+0000","last_peered":"2023-06-23T18:44:50.674669+0000","last_clean":"2023-06-23T18:44:50.674669+0000","last_became_active":"2023-06-23T18:44:50.665383+0000","last_became_peered":"2023-06-23T18:44:50.665383+0000","last_unstale":"2023-06-23T18:44:50.674669+0000","last_undegraded":"2023-06-23T18:44:50.674669+0000","last_fullsized":"2023-06-23T18:44:50.674669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:50:10.163258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650418+0000","last_change":"2023-06-23T18:44:50.244604+0000","last_active":"2023-06-23T18:44:51.650418+0000","last_peered":"2023-06-23T18:44:51.650418+0000","last_clean":"2023-06-23T18:44:51.650418+0000","last_became_active":"2023-06-23T18:44:50.244307+0000","last_became_peered":"2023-06-23T18:44:50.244307+0000","last_unstale":"2023-06-23T18:44:51.650418+0000","last_undegraded":"2023-06-23T18:44:51.650418+0000","last_fullsized":"2023-06-23T18:44:51.650418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:04:47.082248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404529+0000","last_change":"2023-06-23T18:44:50.674014+0000","last_active":"2023-06-23T18:44:52.404529+0000","last_peered":"2023-06-23T18:44:52.404529+0000","last_clean":"2023-06-23T18:44:52.404529+0000","last_became_active":"2023-06-23T18:44:50.673751+0000","last_became_peered":"2023-06-23T18:44:50.673751+0000","last_unstale":"2023-06-23T18:44:52.404529+0000","last_undegraded":"2023-06-23T18:44:52.404529+0000","last_fullsized":"2023-06-23T18:44:52.404529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:24:00.797602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.654030+0000","last_change":"2023-06-23T18:44:50.241541+0000","last_active":"2023-06-23T18:44:50.654030+0000","last_peered":"2023-06-23T18:44:50.654030+0000","last_clean":"2023-06-23T18:44:50.654030+0000","last_became_active":"2023-06-23T18:44:50.241250+0000","last_became_peered":"2023-06-23T18:44:50.241250+0000","last_unstale":"2023-06-23T18:44:50.654030+0000","last_undegraded":"2023-06-23T18:44:50.654030+0000","last_fullsized":"2023-06-23T18:44:50.654030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:13:34.719568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655460+0000","last_change":"2023-06-23T18:44:50.665987+0000","last_active":"2023-06-23T18:44:51.655460+0000","last_peered":"2023-06-23T18:44:51.655460+0000","last_clean":"2023-06-23T18:44:51.655460+0000","last_became_active":"2023-06-23T18:44:50.665705+0000","last_became_peered":"2023-06-23T18:44:50.665705+0000","last_unstale":"2023-06-23T18:44:51.655460+0000","last_undegraded":"2023-06-23T18:44:51.655460+0000","last_fullsized":"2023-06-23T18:44:51.655460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:26:23.851192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404593+0000","last_change":"2023-06-23T18:44:50.240166+0000","last_active":"2023-06-23T18:44:52.404593+0000","last_peered":"2023-06-23T18:44:52.404593+0000","last_clean":"2023-06-23T18:44:52.404593+0000","last_became_active":"2023-06-23T18:44:50.239596+0000","last_became_peered":"2023-06-23T18:44:50.239596+0000","last_unstale":"2023-06-23T18:44:52.404593+0000","last_undegraded":"2023-06-23T18:44:52.404593+0000","last_fullsized":"2023-06-23T18:44:52.404593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:43:04.875204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.672940+0000","last_change":"2023-06-23T18:44:50.663993+0000","last_active":"2023-06-23T18:44:50.672940+0000","last_peered":"2023-06-23T18:44:50.672940+0000","last_clean":"2023-06-23T18:44:50.672940+0000","last_became_active":"2023-06-23T18:44:50.663754+0000","last_became_peered":"2023-06-23T18:44:50.663754+0000","last_unstale":"2023-06-23T18:44:50.672940+0000","last_undegraded":"2023-06-23T18:44:50.672940+0000","last_fullsized":"2023-06-23T18:44:50.672940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:31:28.989051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.649059+0000","last_change":"2023-06-23T18:44:50.244382+0000","last_active":"2023-06-23T18:44:50.649059+0000","last_peered":"2023-06-23T18:44:50.649059+0000","last_clean":"2023-06-23T18:44:50.649059+0000","last_became_active":"2023-06-23T18:44:50.244129+0000","last_became_peered":"2023-06-23T18:44:50.244129+0000","last_unstale":"2023-06-23T18:44:50.649059+0000","last_undegraded":"2023-06-23T18:44:50.649059+0000","last_fullsized":"2023-06-23T18:44:50.649059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:50:31.312312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.675589+0000","last_change":"2023-06-23T18:44:50.670667+0000","last_active":"2023-06-23T18:44:50.675589+0000","last_peered":"2023-06-23T18:44:50.675589+0000","last_clean":"2023-06-23T18:44:50.675589+0000","last_became_active":"2023-06-23T18:44:50.670402+0000","last_became_peered":"2023-06-23T18:44:50.670402+0000","last_unstale":"2023-06-23T18:44:50.675589+0000","last_undegraded":"2023-06-23T18:44:50.675589+0000","last_fullsized":"2023-06-23T18:44:50.675589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:51:27.271916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006302+0000","last_change":"2023-06-23T18:44:50.249346+0000","last_active":"2023-06-23T18:44:52.006302+0000","last_peered":"2023-06-23T18:44:52.006302+0000","last_clean":"2023-06-23T18:44:52.006302+0000","last_became_active":"2023-06-23T18:44:50.249071+0000","last_became_peered":"2023-06-23T18:44:50.249071+0000","last_unstale":"2023-06-23T18:44:52.006302+0000","last_undegraded":"2023-06-23T18:44:52.006302+0000","last_fullsized":"2023-06-23T18:44:52.006302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:48:25.639120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650607+0000","last_change":"2023-06-23T18:44:50.663115+0000","last_active":"2023-06-23T18:44:51.650607+0000","last_peered":"2023-06-23T18:44:51.650607+0000","last_clean":"2023-06-23T18:44:51.650607+0000","last_became_active":"2023-06-23T18:44:50.662843+0000","last_became_peered":"2023-06-23T18:44:50.662843+0000","last_unstale":"2023-06-23T18:44:51.650607+0000","last_undegraded":"2023-06-23T18:44:51.650607+0000","last_fullsized":"2023-06-23T18:44:51.650607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:17:28.994298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498336+0000","last_change":"2023-06-23T18:44:50.247158+0000","last_active":"2023-06-23T18:44:52.498336+0000","last_peered":"2023-06-23T18:44:52.498336+0000","last_clean":"2023-06-23T18:44:52.498336+0000","last_became_active":"2023-06-23T18:44:50.246857+0000","last_became_peered":"2023-06-23T18:44:50.246857+0000","last_unstale":"2023-06-23T18:44:52.498336+0000","last_undegraded":"2023-06-23T18:44:52.498336+0000","last_fullsized":"2023-06-23T18:44:52.498336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:04:29.395928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498272+0000","last_change":"2023-06-23T18:44:50.667952+0000","last_active":"2023-06-23T18:44:52.498272+0000","last_peered":"2023-06-23T18:44:52.498272+0000","last_clean":"2023-06-23T18:44:52.498272+0000","last_became_active":"2023-06-23T18:44:50.667653+0000","last_became_peered":"2023-06-23T18:44:50.667653+0000","last_unstale":"2023-06-23T18:44:52.498272+0000","last_undegraded":"2023-06-23T18:44:52.498272+0000","last_fullsized":"2023-06-23T18:44:52.498272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:17:33.321718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006119+0000","last_change":"2023-06-23T18:44:50.248101+0000","last_active":"2023-06-23T18:44:52.006119+0000","last_peered":"2023-06-23T18:44:52.006119+0000","last_clean":"2023-06-23T18:44:52.006119+0000","last_became_active":"2023-06-23T18:44:50.247805+0000","last_became_peered":"2023-06-23T18:44:50.247805+0000","last_unstale":"2023-06-23T18:44:52.006119+0000","last_undegraded":"2023-06-23T18:44:52.006119+0000","last_fullsized":"2023-06-23T18:44:52.006119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:24:19.734731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.675422+0000","last_change":"2023-06-23T18:44:50.667698+0000","last_active":"2023-06-23T18:44:50.675422+0000","last_peered":"2023-06-23T18:44:50.675422+0000","last_clean":"2023-06-23T18:44:50.675422+0000","last_became_active":"2023-06-23T18:44:50.667423+0000","last_became_peered":"2023-06-23T18:44:50.667423+0000","last_unstale":"2023-06-23T18:44:50.675422+0000","last_undegraded":"2023-06-23T18:44:50.675422+0000","last_fullsized":"2023-06-23T18:44:50.675422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:07:37.802543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404201+0000","last_change":"2023-06-23T18:44:50.247136+0000","last_active":"2023-06-23T18:44:52.404201+0000","last_peered":"2023-06-23T18:44:52.404201+0000","last_clean":"2023-06-23T18:44:52.404201+0000","last_became_active":"2023-06-23T18:44:50.246862+0000","last_became_peered":"2023-06-23T18:44:50.246862+0000","last_unstale":"2023-06-23T18:44:52.404201+0000","last_undegraded":"2023-06-23T18:44:52.404201+0000","last_fullsized":"2023-06-23T18:44:52.404201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:33:31.904138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.671507+0000","last_change":"2023-06-23T18:44:50.670045+0000","last_active":"2023-06-23T18:44:50.671507+0000","last_peered":"2023-06-23T18:44:50.671507+0000","last_clean":"2023-06-23T18:44:50.671507+0000","last_became_active":"2023-06-23T18:44:50.669434+0000","last_became_peered":"2023-06-23T18:44:50.669434+0000","last_unstale":"2023-06-23T18:44:50.671507+0000","last_undegraded":"2023-06-23T18:44:50.671507+0000","last_fullsized":"2023-06-23T18:44:50.671507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:03:16.001494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006195+0000","last_change":"2023-06-23T18:44:50.248720+0000","last_active":"2023-06-23T18:44:52.006195+0000","last_peered":"2023-06-23T18:44:52.006195+0000","last_clean":"2023-06-23T18:44:52.006195+0000","last_became_active":"2023-06-23T18:44:50.248413+0000","last_became_peered":"2023-06-23T18:44:50.248413+0000","last_unstale":"2023-06-23T18:44:52.006195+0000","last_undegraded":"2023-06-23T18:44:52.006195+0000","last_fullsized":"2023-06-23T18:44:52.006195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:29:43.646940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404302+0000","last_change":"2023-06-23T18:44:50.670389+0000","last_active":"2023-06-23T18:44:52.404302+0000","last_peered":"2023-06-23T18:44:52.404302+0000","last_clean":"2023-06-23T18:44:52.404302+0000","last_became_active":"2023-06-23T18:44:50.670097+0000","last_became_peered":"2023-06-23T18:44:50.670097+0000","last_unstale":"2023-06-23T18:44:52.404302+0000","last_undegraded":"2023-06-23T18:44:52.404302+0000","last_fullsized":"2023-06-23T18:44:52.404302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:09:27.754720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.654985+0000","last_change":"2023-06-23T18:44:50.248018+0000","last_active":"2023-06-23T18:44:51.654985+0000","last_peered":"2023-06-23T18:44:51.654985+0000","last_clean":"2023-06-23T18:44:51.654985+0000","last_became_active":"2023-06-23T18:44:50.247728+0000","last_became_peered":"2023-06-23T18:44:50.247728+0000","last_unstale":"2023-06-23T18:44:51.654985+0000","last_undegraded":"2023-06-23T18:44:51.654985+0000","last_fullsized":"2023-06-23T18:44:51.654985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:26:27.403377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.675845+0000","last_change":"2023-06-23T18:44:50.671378+0000","last_active":"2023-06-23T18:44:50.675845+0000","last_peered":"2023-06-23T18:44:50.675845+0000","last_clean":"2023-06-23T18:44:50.675845+0000","last_became_active":"2023-06-23T18:44:50.671070+0000","last_became_peered":"2023-06-23T18:44:50.671070+0000","last_unstale":"2023-06-23T18:44:50.675845+0000","last_undegraded":"2023-06-23T18:44:50.675845+0000","last_fullsized":"2023-06-23T18:44:50.675845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:46:59.173048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006489+0000","last_change":"2023-06-23T18:44:50.248058+0000","last_active":"2023-06-23T18:44:52.006489+0000","last_peered":"2023-06-23T18:44:52.006489+0000","last_clean":"2023-06-23T18:44:52.006489+0000","last_became_active":"2023-06-23T18:44:50.247761+0000","last_became_peered":"2023-06-23T18:44:50.247761+0000","last_unstale":"2023-06-23T18:44:52.006489+0000","last_undegraded":"2023-06-23T18:44:52.006489+0000","last_fullsized":"2023-06-23T18:44:52.006489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:51:58.116537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.670988+0000","last_change":"2023-06-23T18:44:50.669693+0000","last_active":"2023-06-23T18:44:50.670988+0000","last_peered":"2023-06-23T18:44:50.670988+0000","last_clean":"2023-06-23T18:44:50.670988+0000","last_became_active":"2023-06-23T18:44:50.669380+0000","last_became_peered":"2023-06-23T18:44:50.669380+0000","last_unstale":"2023-06-23T18:44:50.670988+0000","last_undegraded":"2023-06-23T18:44:50.670988+0000","last_fullsized":"2023-06-23T18:44:50.670988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:07:37.802543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006321+0000","last_change":"2023-06-23T18:44:50.248597+0000","last_active":"2023-06-23T18:44:52.006321+0000","last_peered":"2023-06-23T18:44:52.006321+0000","last_clean":"2023-06-23T18:44:52.006321+0000","last_became_active":"2023-06-23T18:44:50.248309+0000","last_became_peered":"2023-06-23T18:44:50.248309+0000","last_unstale":"2023-06-23T18:44:52.006321+0000","last_undegraded":"2023-06-23T18:44:52.006321+0000","last_fullsized":"2023-06-23T18:44:52.006321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:36:18.947220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.497799+0000","last_change":"2023-06-23T18:44:50.667519+0000","last_active":"2023-06-23T18:44:52.497799+0000","last_peered":"2023-06-23T18:44:52.497799+0000","last_clean":"2023-06-23T18:44:52.497799+0000","last_became_active":"2023-06-23T18:44:50.667042+0000","last_became_peered":"2023-06-23T18:44:50.667042+0000","last_unstale":"2023-06-23T18:44:52.497799+0000","last_undegraded":"2023-06-23T18:44:52.497799+0000","last_fullsized":"2023-06-23T18:44:52.497799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:39:47.275362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006335+0000","last_change":"2023-06-23T18:44:50.247778+0000","last_active":"2023-06-23T18:44:52.006335+0000","last_peered":"2023-06-23T18:44:52.006335+0000","last_clean":"2023-06-23T18:44:52.006335+0000","last_became_active":"2023-06-23T18:44:50.247501+0000","last_became_peered":"2023-06-23T18:44:50.247501+0000","last_unstale":"2023-06-23T18:44:52.006335+0000","last_undegraded":"2023-06-23T18:44:52.006335+0000","last_fullsized":"2023-06-23T18:44:52.006335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:29:14.124932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655300+0000","last_change":"2023-06-23T18:44:50.666494+0000","last_active":"2023-06-23T18:44:51.655300+0000","last_peered":"2023-06-23T18:44:51.655300+0000","last_clean":"2023-06-23T18:44:51.655300+0000","last_became_active":"2023-06-23T18:44:50.666222+0000","last_became_peered":"2023-06-23T18:44:50.666222+0000","last_unstale":"2023-06-23T18:44:51.655300+0000","last_undegraded":"2023-06-23T18:44:51.655300+0000","last_fullsized":"2023-06-23T18:44:51.655300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:01:09.268705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.649178+0000","last_change":"2023-06-23T18:44:50.242391+0000","last_active":"2023-06-23T18:44:50.649178+0000","last_peered":"2023-06-23T18:44:50.649178+0000","last_clean":"2023-06-23T18:44:50.649178+0000","last_became_active":"2023-06-23T18:44:50.242109+0000","last_became_peered":"2023-06-23T18:44:50.242109+0000","last_unstale":"2023-06-23T18:44:50.649178+0000","last_undegraded":"2023-06-23T18:44:50.649178+0000","last_fullsized":"2023-06-23T18:44:50.649178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:13:34.719568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404239+0000","last_change":"2023-06-23T18:44:50.663583+0000","last_active":"2023-06-23T18:44:52.404239+0000","last_peered":"2023-06-23T18:44:52.404239+0000","last_clean":"2023-06-23T18:44:52.404239+0000","last_became_active":"2023-06-23T18:44:50.663317+0000","last_became_peered":"2023-06-23T18:44:50.663317+0000","last_unstale":"2023-06-23T18:44:52.404239+0000","last_undegraded":"2023-06-23T18:44:52.404239+0000","last_fullsized":"2023-06-23T18:44:52.404239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:26:23.851192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.674843+0000","last_change":"2023-06-23T18:44:50.241365+0000","last_active":"2023-06-23T18:44:50.674843+0000","last_peered":"2023-06-23T18:44:50.674843+0000","last_clean":"2023-06-23T18:44:50.674843+0000","last_became_active":"2023-06-23T18:44:50.241047+0000","last_became_peered":"2023-06-23T18:44:50.241047+0000","last_unstale":"2023-06-23T18:44:50.674843+0000","last_undegraded":"2023-06-23T18:44:50.674843+0000","last_fullsized":"2023-06-23T18:44:50.674843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:01:08.263675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498069+0000","last_change":"2023-06-23T18:44:50.675000+0000","last_active":"2023-06-23T18:44:52.498069+0000","last_peered":"2023-06-23T18:44:52.498069+0000","last_clean":"2023-06-23T18:44:52.498069+0000","last_became_active":"2023-06-23T18:44:50.674723+0000","last_became_peered":"2023-06-23T18:44:50.674723+0000","last_unstale":"2023-06-23T18:44:52.498069+0000","last_undegraded":"2023-06-23T18:44:52.498069+0000","last_fullsized":"2023-06-23T18:44:52.498069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:36:19.952251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655092+0000","last_change":"2023-06-23T18:44:50.247990+0000","last_active":"2023-06-23T18:44:51.655092+0000","last_peered":"2023-06-23T18:44:51.655092+0000","last_clean":"2023-06-23T18:44:51.655092+0000","last_became_active":"2023-06-23T18:44:50.247701+0000","last_became_peered":"2023-06-23T18:44:50.247701+0000","last_unstale":"2023-06-23T18:44:51.655092+0000","last_undegraded":"2023-06-23T18:44:51.655092+0000","last_fullsized":"2023-06-23T18:44:51.655092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:30:47.540693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498444+0000","last_change":"2023-06-23T18:44:50.666801+0000","last_active":"2023-06-23T18:44:52.498444+0000","last_peered":"2023-06-23T18:44:52.498444+0000","last_clean":"2023-06-23T18:44:52.498444+0000","last_became_active":"2023-06-23T18:44:50.666395+0000","last_became_peered":"2023-06-23T18:44:50.666395+0000","last_unstale":"2023-06-23T18:44:52.498444+0000","last_undegraded":"2023-06-23T18:44:52.498444+0000","last_fullsized":"2023-06-23T18:44:52.498444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:50:28.729386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498272+0000","last_change":"2023-06-23T18:44:50.240923+0000","last_active":"2023-06-23T18:44:52.498272+0000","last_peered":"2023-06-23T18:44:52.498272+0000","last_clean":"2023-06-23T18:44:52.498272+0000","last_became_active":"2023-06-23T18:44:50.240629+0000","last_became_peered":"2023-06-23T18:44:50.240629+0000","last_unstale":"2023-06-23T18:44:52.498272+0000","last_undegraded":"2023-06-23T18:44:52.498272+0000","last_fullsized":"2023-06-23T18:44:52.498272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:51:58.116537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498420+0000","last_change":"2023-06-23T18:44:50.669953+0000","last_active":"2023-06-23T18:44:52.498420+0000","last_peered":"2023-06-23T18:44:52.498420+0000","last_clean":"2023-06-23T18:44:52.498420+0000","last_became_active":"2023-06-23T18:44:50.668113+0000","last_became_peered":"2023-06-23T18:44:50.668113+0000","last_unstale":"2023-06-23T18:44:52.498420+0000","last_undegraded":"2023-06-23T18:44:52.498420+0000","last_fullsized":"2023-06-23T18:44:52.498420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:20:58.258094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.653863+0000","last_change":"2023-06-23T18:44:50.248367+0000","last_active":"2023-06-23T18:44:50.653863+0000","last_peered":"2023-06-23T18:44:50.653863+0000","last_clean":"2023-06-23T18:44:50.653863+0000","last_became_active":"2023-06-23T18:44:50.248058+0000","last_became_peered":"2023-06-23T18:44:50.248058+0000","last_unstale":"2023-06-23T18:44:50.653863+0000","last_undegraded":"2023-06-23T18:44:50.653863+0000","last_fullsized":"2023-06-23T18:44:50.653863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:03:31.204444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.651039+0000","last_change":"2023-06-23T18:44:50.668275+0000","last_active":"2023-06-23T18:44:51.651039+0000","last_peered":"2023-06-23T18:44:51.651039+0000","last_clean":"2023-06-23T18:44:51.651039+0000","last_became_active":"2023-06-23T18:44:50.668011+0000","last_became_peered":"2023-06-23T18:44:50.668011+0000","last_unstale":"2023-06-23T18:44:51.651039+0000","last_undegraded":"2023-06-23T18:44:51.651039+0000","last_fullsized":"2023-06-23T18:44:51.651039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:11:35.546421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.673003+0000","last_change":"2023-06-23T18:44:50.247291+0000","last_active":"2023-06-23T18:44:50.673003+0000","last_peered":"2023-06-23T18:44:50.673003+0000","last_clean":"2023-06-23T18:44:50.673003+0000","last_became_active":"2023-06-23T18:44:50.246993+0000","last_became_peered":"2023-06-23T18:44:50.246993+0000","last_unstale":"2023-06-23T18:44:50.673003+0000","last_undegraded":"2023-06-23T18:44:50.673003+0000","last_fullsized":"2023-06-23T18:44:50.673003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:04:47.082248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498255+0000","last_change":"2023-06-23T18:44:45.192683+0000","last_active":"2023-06-23T18:44:52.498255+0000","last_peered":"2023-06-23T18:44:52.498255+0000","last_clean":"2023-06-23T18:44:52.498255+0000","last_became_active":"2023-06-23T18:44:45.192364+0000","last_became_peered":"2023-06-23T18:44:45.192364+0000","last_unstale":"2023-06-23T18:44:52.498255+0000","last_undegraded":"2023-06-23T18:44:52.498255+0000","last_fullsized":"2023-06-23T18:44:52.498255+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:18:43.258051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.675528+0000","last_change":"2023-06-23T18:44:50.669848+0000","last_active":"2023-06-23T18:44:50.675528+0000","last_peered":"2023-06-23T18:44:50.675528+0000","last_clean":"2023-06-23T18:44:50.675528+0000","last_became_active":"2023-06-23T18:44:50.669597+0000","last_became_peered":"2023-06-23T18:44:50.669597+0000","last_unstale":"2023-06-23T18:44:50.675528+0000","last_undegraded":"2023-06-23T18:44:50.675528+0000","last_fullsized":"2023-06-23T18:44:50.675528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:50:32.317342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.656646+0000","last_change":"2023-06-23T18:44:45.194010+0000","last_active":"2023-06-23T18:44:50.656646+0000","last_peered":"2023-06-23T18:44:50.656646+0000","last_clean":"2023-06-23T18:44:50.656646+0000","last_became_active":"2023-06-23T18:44:45.193665+0000","last_became_peered":"2023-06-23T18:44:45.193665+0000","last_unstale":"2023-06-23T18:44:50.656646+0000","last_undegraded":"2023-06-23T18:44:50.656646+0000","last_fullsized":"2023-06-23T18:44:50.656646+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:26:22.364118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404476+0000","last_change":"2023-06-23T18:44:50.248035+0000","last_active":"2023-06-23T18:44:52.404476+0000","last_peered":"2023-06-23T18:44:52.404476+0000","last_clean":"2023-06-23T18:44:52.404476+0000","last_became_active":"2023-06-23T18:44:50.247776+0000","last_became_peered":"2023-06-23T18:44:50.247776+0000","last_unstale":"2023-06-23T18:44:52.404476+0000","last_undegraded":"2023-06-23T18:44:52.404476+0000","last_fullsized":"2023-06-23T18:44:52.404476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:27:53.233025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.497839+0000","last_change":"2023-06-23T18:44:50.665741+0000","last_active":"2023-06-23T18:44:52.497839+0000","last_peered":"2023-06-23T18:44:52.497839+0000","last_clean":"2023-06-23T18:44:52.497839+0000","last_became_active":"2023-06-23T18:44:50.665276+0000","last_became_peered":"2023-06-23T18:44:50.665276+0000","last_unstale":"2023-06-23T18:44:52.497839+0000","last_undegraded":"2023-06-23T18:44:52.497839+0000","last_fullsized":"2023-06-23T18:44:52.497839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:24:00.797602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650429+0000","last_change":"2023-06-23T18:44:45.192024+0000","last_active":"2023-06-23T18:44:51.650429+0000","last_peered":"2023-06-23T18:44:51.650429+0000","last_clean":"2023-06-23T18:44:51.650429+0000","last_became_active":"2023-06-23T18:44:45.191752+0000","last_became_peered":"2023-06-23T18:44:45.191752+0000","last_unstale":"2023-06-23T18:44:51.650429+0000","last_undegraded":"2023-06-23T18:44:51.650429+0000","last_fullsized":"2023-06-23T18:44:51.650429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:01:03.224415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006092+0000","last_change":"2023-06-23T18:44:45.193018+0000","last_active":"2023-06-23T18:44:52.006092+0000","last_peered":"2023-06-23T18:44:52.006092+0000","last_clean":"2023-06-23T18:44:52.006092+0000","last_became_active":"2023-06-23T18:44:45.192689+0000","last_became_peered":"2023-06-23T18:44:45.192689+0000","last_unstale":"2023-06-23T18:44:52.006092+0000","last_undegraded":"2023-06-23T18:44:52.006092+0000","last_fullsized":"2023-06-23T18:44:52.006092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:30:31.807933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404052+0000","last_change":"2023-06-23T18:44:50.244324+0000","last_active":"2023-06-23T18:44:52.404052+0000","last_peered":"2023-06-23T18:44:52.404052+0000","last_clean":"2023-06-23T18:44:52.404052+0000","last_became_active":"2023-06-23T18:44:50.242219+0000","last_became_peered":"2023-06-23T18:44:50.242219+0000","last_unstale":"2023-06-23T18:44:52.404052+0000","last_undegraded":"2023-06-23T18:44:52.404052+0000","last_fullsized":"2023-06-23T18:44:52.404052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:57:45.432002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404339+0000","last_change":"2023-06-23T18:44:50.660290+0000","last_active":"2023-06-23T18:44:52.404339+0000","last_peered":"2023-06-23T18:44:52.404339+0000","last_clean":"2023-06-23T18:44:52.404339+0000","last_became_active":"2023-06-23T18:44:50.660095+0000","last_became_peered":"2023-06-23T18:44:50.660095+0000","last_unstale":"2023-06-23T18:44:52.404339+0000","last_undegraded":"2023-06-23T18:44:52.404339+0000","last_fullsized":"2023-06-23T18:44:52.404339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:23:07.364903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.005876+0000","last_change":"2023-06-23T18:44:45.577146+0000","last_active":"2023-06-23T18:44:52.005876+0000","last_peered":"2023-06-23T18:44:52.005876+0000","last_clean":"2023-06-23T18:44:52.005876+0000","last_became_active":"2023-06-23T18:44:45.576835+0000","last_became_peered":"2023-06-23T18:44:45.576835+0000","last_unstale":"2023-06-23T18:44:52.005876+0000","last_undegraded":"2023-06-23T18:44:52.005876+0000","last_fullsized":"2023-06-23T18:44:52.005876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:39:41.231072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650345+0000","last_change":"2023-06-23T18:44:50.242675+0000","last_active":"2023-06-23T18:44:51.650345+0000","last_peered":"2023-06-23T18:44:51.650345+0000","last_clean":"2023-06-23T18:44:51.650345+0000","last_became_active":"2023-06-23T18:44:50.242356+0000","last_became_peered":"2023-06-23T18:44:50.242356+0000","last_unstale":"2023-06-23T18:44:51.650345+0000","last_undegraded":"2023-06-23T18:44:51.650345+0000","last_fullsized":"2023-06-23T18:44:51.650345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:30:47.540693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650895+0000","last_change":"2023-06-23T18:44:50.661341+0000","last_active":"2023-06-23T18:44:51.650895+0000","last_peered":"2023-06-23T18:44:51.650895+0000","last_clean":"2023-06-23T18:44:51.650895+0000","last_became_active":"2023-06-23T18:44:50.661088+0000","last_became_peered":"2023-06-23T18:44:50.661088+0000","last_unstale":"2023-06-23T18:44:51.650895+0000","last_undegraded":"2023-06-23T18:44:51.650895+0000","last_fullsized":"2023-06-23T18:44:51.650895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:06:39.243693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.005910+0000","last_change":"2023-06-23T18:44:45.577304+0000","last_active":"2023-06-23T18:44:52.005910+0000","last_peered":"2023-06-23T18:44:52.005910+0000","last_clean":"2023-06-23T18:44:52.005910+0000","last_became_active":"2023-06-23T18:44:45.576846+0000","last_became_peered":"2023-06-23T18:44:45.576846+0000","last_unstale":"2023-06-23T18:44:52.005910+0000","last_undegraded":"2023-06-23T18:44:52.005910+0000","last_fullsized":"2023-06-23T18:44:52.005910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:27:48.193765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.653293+0000","last_change":"2023-06-23T18:44:50.240634+0000","last_active":"2023-06-23T18:44:50.653293+0000","last_peered":"2023-06-23T18:44:50.653293+0000","last_clean":"2023-06-23T18:44:50.653293+0000","last_became_active":"2023-06-23T18:44:50.240328+0000","last_became_peered":"2023-06-23T18:44:50.240328+0000","last_unstale":"2023-06-23T18:44:50.653293+0000","last_undegraded":"2023-06-23T18:44:50.653293+0000","last_fullsized":"2023-06-23T18:44:50.653293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:20:58.095182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655442+0000","last_change":"2023-06-23T18:44:50.668726+0000","last_active":"2023-06-23T18:44:51.655442+0000","last_peered":"2023-06-23T18:44:51.655442+0000","last_clean":"2023-06-23T18:44:51.655442+0000","last_became_active":"2023-06-23T18:44:50.668435+0000","last_became_peered":"2023-06-23T18:44:50.668435+0000","last_unstale":"2023-06-23T18:44:51.655442+0000","last_undegraded":"2023-06-23T18:44:51.655442+0000","last_fullsized":"2023-06-23T18:44:51.655442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:33:32.909168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.648469+0000","last_change":"2023-06-23T18:44:45.577154+0000","last_active":"2023-06-23T18:44:50.648469+0000","last_peered":"2023-06-23T18:44:50.648469+0000","last_clean":"2023-06-23T18:44:50.648469+0000","last_became_active":"2023-06-23T18:44:45.576819+0000","last_became_peered":"2023-06-23T18:44:45.576819+0000","last_unstale":"2023-06-23T18:44:50.648469+0000","last_undegraded":"2023-06-23T18:44:50.648469+0000","last_fullsized":"2023-06-23T18:44:50.648469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:31:22.944761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498150+0000","last_change":"2023-06-23T18:44:50.248143+0000","last_active":"2023-06-23T18:44:52.498150+0000","last_peered":"2023-06-23T18:44:52.498150+0000","last_clean":"2023-06-23T18:44:52.498150+0000","last_became_active":"2023-06-23T18:44:50.247890+0000","last_became_peered":"2023-06-23T18:44:50.247890+0000","last_unstale":"2023-06-23T18:44:52.498150+0000","last_undegraded":"2023-06-23T18:44:52.498150+0000","last_fullsized":"2023-06-23T18:44:52.498150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:29:14.124932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650785+0000","last_change":"2023-06-23T18:44:50.661047+0000","last_active":"2023-06-23T18:44:51.650785+0000","last_peered":"2023-06-23T18:44:51.650785+0000","last_clean":"2023-06-23T18:44:51.650785+0000","last_became_active":"2023-06-23T18:44:50.660762+0000","last_became_peered":"2023-06-23T18:44:50.660762+0000","last_unstale":"2023-06-23T18:44:51.650785+0000","last_undegraded":"2023-06-23T18:44:51.650785+0000","last_fullsized":"2023-06-23T18:44:51.650785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:09:27.754720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655193+0000","last_change":"2023-06-23T18:44:45.577135+0000","last_active":"2023-06-23T18:44:51.655193+0000","last_peered":"2023-06-23T18:44:51.655193+0000","last_clean":"2023-06-23T18:44:51.655193+0000","last_became_active":"2023-06-23T18:44:45.576834+0000","last_became_peered":"2023-06-23T18:44:45.576834+0000","last_unstale":"2023-06-23T18:44:51.655193+0000","last_undegraded":"2023-06-23T18:44:51.655193+0000","last_fullsized":"2023-06-23T18:44:51.655193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:04:42.042988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650649+0000","last_change":"2023-06-23T18:44:50.244343+0000","last_active":"2023-06-23T18:44:51.650649+0000","last_peered":"2023-06-23T18:44:51.650649+0000","last_clean":"2023-06-23T18:44:51.650649+0000","last_became_active":"2023-06-23T18:44:50.244035+0000","last_became_peered":"2023-06-23T18:44:50.244035+0000","last_unstale":"2023-06-23T18:44:51.650649+0000","last_undegraded":"2023-06-23T18:44:51.650649+0000","last_fullsized":"2023-06-23T18:44:51.650649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:33:31.904138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404433+0000","last_change":"2023-06-23T18:44:50.658487+0000","last_active":"2023-06-23T18:44:52.404433+0000","last_peered":"2023-06-23T18:44:52.404433+0000","last_clean":"2023-06-23T18:44:52.404433+0000","last_became_active":"2023-06-23T18:44:50.656913+0000","last_became_peered":"2023-06-23T18:44:50.656913+0000","last_unstale":"2023-06-23T18:44:52.404433+0000","last_undegraded":"2023-06-23T18:44:52.404433+0000","last_fullsized":"2023-06-23T18:44:52.404433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:39:47.275362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655308+0000","last_change":"2023-06-23T18:44:45.192545+0000","last_active":"2023-06-23T18:44:51.655308+0000","last_peered":"2023-06-23T18:44:51.655308+0000","last_clean":"2023-06-23T18:44:51.655308+0000","last_became_active":"2023-06-23T18:44:45.192124+0000","last_became_peered":"2023-06-23T18:44:45.192124+0000","last_unstale":"2023-06-23T18:44:51.655308+0000","last_undegraded":"2023-06-23T18:44:51.655308+0000","last_fullsized":"2023-06-23T18:44:51.655308+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:57:40.392742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.649503+0000","last_change":"2023-06-23T18:44:50.245977+0000","last_active":"2023-06-23T18:44:50.649503+0000","last_peered":"2023-06-23T18:44:50.649503+0000","last_clean":"2023-06-23T18:44:50.649503+0000","last_became_active":"2023-06-23T18:44:50.245656+0000","last_became_peered":"2023-06-23T18:44:50.245656+0000","last_unstale":"2023-06-23T18:44:50.649503+0000","last_undegraded":"2023-06-23T18:44:50.649503+0000","last_fullsized":"2023-06-23T18:44:50.649503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:11:39.393019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650648+0000","last_change":"2023-06-23T18:44:50.662985+0000","last_active":"2023-06-23T18:44:51.650648+0000","last_peered":"2023-06-23T18:44:51.650648+0000","last_clean":"2023-06-23T18:44:51.650648+0000","last_became_active":"2023-06-23T18:44:50.659614+0000","last_became_peered":"2023-06-23T18:44:50.659614+0000","last_unstale":"2023-06-23T18:44:51.650648+0000","last_undegraded":"2023-06-23T18:44:51.650648+0000","last_fullsized":"2023-06-23T18:44:51.650648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:26:23.851192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404590+0000","last_change":"2023-06-23T18:44:50.246331+0000","last_active":"2023-06-23T18:44:52.404590+0000","last_peered":"2023-06-23T18:44:52.404590+0000","last_clean":"2023-06-23T18:44:52.404590+0000","last_became_active":"2023-06-23T18:44:50.244789+0000","last_became_peered":"2023-06-23T18:44:50.244789+0000","last_unstale":"2023-06-23T18:44:52.404590+0000","last_undegraded":"2023-06-23T18:44:52.404590+0000","last_fullsized":"2023-06-23T18:44:52.404590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:24:19.734731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.664759+0000","last_change":"2023-06-23T18:44:50.656054+0000","last_active":"2023-06-23T18:44:50.664759+0000","last_peered":"2023-06-23T18:44:50.664759+0000","last_clean":"2023-06-23T18:44:50.664759+0000","last_became_active":"2023-06-23T18:44:50.655781+0000","last_became_peered":"2023-06-23T18:44:50.655781+0000","last_unstale":"2023-06-23T18:44:50.664759+0000","last_undegraded":"2023-06-23T18:44:50.664759+0000","last_fullsized":"2023-06-23T18:44:50.664759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:25:05.609795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.655672+0000","last_change":"2023-06-23T18:44:50.242527+0000","last_active":"2023-06-23T18:44:50.655672+0000","last_peered":"2023-06-23T18:44:50.655672+0000","last_clean":"2023-06-23T18:44:50.655672+0000","last_became_active":"2023-06-23T18:44:50.242265+0000","last_became_peered":"2023-06-23T18:44:50.242265+0000","last_unstale":"2023-06-23T18:44:50.655672+0000","last_undegraded":"2023-06-23T18:44:50.655672+0000","last_fullsized":"2023-06-23T18:44:50.655672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:51:26.266885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.497890+0000","last_change":"2023-06-23T18:44:50.673258+0000","last_active":"2023-06-23T18:44:52.497890+0000","last_peered":"2023-06-23T18:44:52.497890+0000","last_clean":"2023-06-23T18:44:52.497890+0000","last_became_active":"2023-06-23T18:44:50.672993+0000","last_became_peered":"2023-06-23T18:44:50.672993+0000","last_unstale":"2023-06-23T18:44:52.497890+0000","last_undegraded":"2023-06-23T18:44:52.497890+0000","last_fullsized":"2023-06-23T18:44:52.497890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:30:37.852223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.660246+0000","last_change":"2023-06-23T18:44:50.239578+0000","last_active":"2023-06-23T18:44:50.660246+0000","last_peered":"2023-06-23T18:44:50.660246+0000","last_clean":"2023-06-23T18:44:50.660246+0000","last_became_active":"2023-06-23T18:44:50.239290+0000","last_became_peered":"2023-06-23T18:44:50.239290+0000","last_unstale":"2023-06-23T18:44:50.660246+0000","last_undegraded":"2023-06-23T18:44:50.660246+0000","last_fullsized":"2023-06-23T18:44:50.660246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:14:44.537297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498376+0000","last_change":"2023-06-23T18:44:50.672381+0000","last_active":"2023-06-23T18:44:52.498376+0000","last_peered":"2023-06-23T18:44:52.498376+0000","last_clean":"2023-06-23T18:44:52.498376+0000","last_became_active":"2023-06-23T18:44:50.672098+0000","last_became_peered":"2023-06-23T18:44:50.672098+0000","last_unstale":"2023-06-23T18:44:52.498376+0000","last_undegraded":"2023-06-23T18:44:52.498376+0000","last_fullsized":"2023-06-23T18:44:52.498376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:59:11.512811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.669720+0000","last_change":"2023-06-23T18:44:50.240690+0000","last_active":"2023-06-23T18:44:50.669720+0000","last_peered":"2023-06-23T18:44:50.669720+0000","last_clean":"2023-06-23T18:44:50.669720+0000","last_became_active":"2023-06-23T18:44:50.240111+0000","last_became_peered":"2023-06-23T18:44:50.240111+0000","last_unstale":"2023-06-23T18:44:50.669720+0000","last_undegraded":"2023-06-23T18:44:50.669720+0000","last_fullsized":"2023-06-23T18:44:50.669720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:30:47.540693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.675397+0000","last_change":"2023-06-23T18:44:50.667526+0000","last_active":"2023-06-23T18:44:50.675397+0000","last_peered":"2023-06-23T18:44:50.675397+0000","last_clean":"2023-06-23T18:44:50.675397+0000","last_became_active":"2023-06-23T18:44:50.667214+0000","last_became_peered":"2023-06-23T18:44:50.667214+0000","last_unstale":"2023-06-23T18:44:50.675397+0000","last_undegraded":"2023-06-23T18:44:50.675397+0000","last_fullsized":"2023-06-23T18:44:50.675397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:11:40.398049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404617+0000","last_change":"2023-06-23T18:44:50.244989+0000","last_active":"2023-06-23T18:44:52.404617+0000","last_peered":"2023-06-23T18:44:52.404617+0000","last_clean":"2023-06-23T18:44:52.404617+0000","last_became_active":"2023-06-23T18:44:50.241979+0000","last_became_peered":"2023-06-23T18:44:50.241979+0000","last_unstale":"2023-06-23T18:44:52.404617+0000","last_undegraded":"2023-06-23T18:44:52.404617+0000","last_fullsized":"2023-06-23T18:44:52.404617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:30:36.847193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.497733+0000","last_change":"2023-06-23T18:44:50.670305+0000","last_active":"2023-06-23T18:44:52.497733+0000","last_peered":"2023-06-23T18:44:52.497733+0000","last_clean":"2023-06-23T18:44:52.497733+0000","last_became_active":"2023-06-23T18:44:50.668141+0000","last_became_peered":"2023-06-23T18:44:50.668141+0000","last_unstale":"2023-06-23T18:44:52.497733+0000","last_undegraded":"2023-06-23T18:44:52.497733+0000","last_fullsized":"2023-06-23T18:44:52.497733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:11:35.546421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655061+0000","last_change":"2023-06-23T18:44:50.656461+0000","last_active":"2023-06-23T18:44:51.655061+0000","last_peered":"2023-06-23T18:44:51.655061+0000","last_clean":"2023-06-23T18:44:51.655061+0000","last_became_active":"2023-06-23T18:44:50.656193+0000","last_became_peered":"2023-06-23T18:44:50.656193+0000","last_unstale":"2023-06-23T18:44:51.655061+0000","last_undegraded":"2023-06-23T18:44:51.655061+0000","last_fullsized":"2023-06-23T18:44:51.655061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:46:59.173048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.675437+0000","last_change":"2023-06-23T18:44:50.668275+0000","last_active":"2023-06-23T18:44:50.675437+0000","last_peered":"2023-06-23T18:44:50.675437+0000","last_clean":"2023-06-23T18:44:50.675437+0000","last_became_active":"2023-06-23T18:44:50.667755+0000","last_became_peered":"2023-06-23T18:44:50.667755+0000","last_unstale":"2023-06-23T18:44:50.675437+0000","last_undegraded":"2023-06-23T18:44:50.675437+0000","last_fullsized":"2023-06-23T18:44:50.675437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:03:16.001494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.497838+0000","last_change":"2023-06-23T18:44:50.671148+0000","last_active":"2023-06-23T18:44:52.497838+0000","last_peered":"2023-06-23T18:44:52.497838+0000","last_clean":"2023-06-23T18:44:52.497838+0000","last_became_active":"2023-06-23T18:44:50.667939+0000","last_became_peered":"2023-06-23T18:44:50.667939+0000","last_unstale":"2023-06-23T18:44:52.497838+0000","last_undegraded":"2023-06-23T18:44:52.497838+0000","last_fullsized":"2023-06-23T18:44:52.497838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:27:54.238055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.676332+0000","last_change":"2023-06-23T18:44:50.675550+0000","last_active":"2023-06-23T18:44:50.676332+0000","last_peered":"2023-06-23T18:44:50.676332+0000","last_clean":"2023-06-23T18:44:50.676332+0000","last_became_active":"2023-06-23T18:44:50.674409+0000","last_became_peered":"2023-06-23T18:44:50.674409+0000","last_unstale":"2023-06-23T18:44:50.676332+0000","last_undegraded":"2023-06-23T18:44:50.676332+0000","last_fullsized":"2023-06-23T18:44:50.676332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:48:22.694731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650600+0000","last_change":"2023-06-23T18:44:50.672283+0000","last_active":"2023-06-23T18:44:51.650600+0000","last_peered":"2023-06-23T18:44:51.650600+0000","last_clean":"2023-06-23T18:44:51.650600+0000","last_became_active":"2023-06-23T18:44:50.672102+0000","last_became_peered":"2023-06-23T18:44:50.672102+0000","last_unstale":"2023-06-23T18:44:51.650600+0000","last_undegraded":"2023-06-23T18:44:51.650600+0000","last_fullsized":"2023-06-23T18:44:51.650600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:57:46.437032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":839680,"data_stored":671247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":79099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":669467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":79681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":200704,"data_stored":71485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":208896,"data_stored":72536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":80719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":73098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T18:44:54.820 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T18:44:54.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.972+0000 7f9b2ba31700 1 Processor -- start 2023-06-23T18:44:54.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.972+0000 7f9b2ba31700 1 -- start start 2023-06-23T18:44:54.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.973+0000 7f9b2ba31700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9b2406b0e0 0x7f9b2414e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:54.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.973+0000 7f9b2ba31700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b240b37a0 con 0x7f9b2406f9d0 2023-06-23T18:44:54.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.973+0000 7f9b2ba31700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b24066a40 con 0x7f9b24070570 2023-06-23T18:44:54.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.973+0000 7f9b2ba31700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b2406fe40 con 0x7f9b2406b0e0 2023-06-23T18:44:54.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.973+0000 7f9b297cd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9b2406b0e0 0x7f9b2414e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:54.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.973+0000 7f9b28fcc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9b2406f9d0 0x7f9b24148780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48510/0 (socket says 172.21.15.52:48510) 2023-06-23T18:44:54.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.973+0000 7f9b28fcc700 1 -- 172.21.15.52:0/3742494191 learned_addr learned my addr 172.21.15.52:0/3742494191 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:54.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.973+0000 7f9b297cd700 1 -- 172.21.15.52:0/3742494191 >> v1:172.21.15.89:6789/0 conn(0x7f9b24070570 legacy=0x7f9b24159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:54.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.973+0000 7f9b297cd700 1 -- 172.21.15.52:0/3742494191 >> v1:172.21.15.52:6789/0 conn(0x7f9b2406f9d0 legacy=0x7f9b24148780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:54.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.973+0000 7f9b297cd700 1 -- 172.21.15.52:0/3742494191 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b24071eb0 con 0x7f9b2406b0e0 2023-06-23T18:44:54.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.973+0000 7f9b1bfff700 1 -- 172.21.15.52:0/3742494191 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944310023 0 0) 0x7f9b240b37a0 con 0x7f9b2406f9d0 2023-06-23T18:44:54.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.974+0000 7f9b297cd700 1 --2- 172.21.15.52:0/3742494191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b2406b0e0 0x7f9b2414e8d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9b20009840 tx=0x7f9b20009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9bfed3ea7e5410f server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:54.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.974+0000 7f9b1bfff700 1 -- 172.21.15.52:0/3742494191 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b20004230 con 0x7f9b2406b0e0 2023-06-23T18:44:54.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.974+0000 7f9b1bfff700 1 -- 172.21.15.52:0/3742494191 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b20004390 con 0x7f9b2406b0e0 2023-06-23T18:44:54.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.974+0000 7f9b1bfff700 1 -- 172.21.15.52:0/3742494191 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b200036a0 con 0x7f9b2406b0e0 2023-06-23T18:44:54.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.974+0000 7f9b2ba31700 1 -- 172.21.15.52:0/3742494191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b2406b0e0 msgr2=0x7f9b2414e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:54.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.974+0000 7f9b2ba31700 1 --2- 172.21.15.52:0/3742494191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b2406b0e0 0x7f9b2414e8d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9b20009840 tx=0x7f9b20009b50 comp rx=0 tx=0).stop 2023-06-23T18:44:54.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.974+0000 7f9b2ba31700 1 -- 172.21.15.52:0/3742494191 shutdown_connections 2023-06-23T18:44:54.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.974+0000 7f9b2ba31700 1 --2- 172.21.15.52:0/3742494191 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b2406b0e0 0x7f9b2414e8d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.974+0000 7f9b2ba31700 1 -- 172.21.15.52:0/3742494191 >> 172.21.15.52:0/3742494191 conn(0x7f9b240bd690 msgr2=0x7f9b240b9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:54.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.974+0000 7f9b2ba31700 1 -- 172.21.15.52:0/3742494191 shutdown_connections 2023-06-23T18:44:54.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.974+0000 7f9b2ba31700 1 -- 172.21.15.52:0/3742494191 wait complete. 2023-06-23T18:44:54.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.975+0000 7f9b2ba31700 1 Processor -- start 2023-06-23T18:44:54.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.975+0000 7f9b2ba31700 1 -- start start 2023-06-23T18:44:54.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.976+0000 7f9b2ba31700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b2406b0e0 0x7f9b2414bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:54.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.976+0000 7f9b2ba31700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b2406f9d0 0x7f9b241424f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:54.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.976+0000 7f9b2ba31700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b24070570 0x7f9b24142a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:54.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.976+0000 7f9b2ba31700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b24149410 con 0x7f9b2406f9d0 2023-06-23T18:44:54.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.976+0000 7f9b2ba31700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2414c080 con 0x7f9b2406b0e0 2023-06-23T18:44:54.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.976+0000 7f9b2ba31700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b240b3ed0 con 0x7f9b24070570 2023-06-23T18:44:54.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.976+0000 7f9b28fcc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b2406f9d0 0x7f9b241424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.976+0000 7f9b28fcc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b2406f9d0 0x7f9b241424f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:47508/0 (socket says 172.21.15.52:47508) 2023-06-23T18:44:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.976+0000 7f9b28fcc700 1 -- 172.21.15.52:0/3729705061 learned_addr learned my addr 172.21.15.52:0/3729705061 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.976+0000 7f9b297cd700 1 --2- 172.21.15.52:0/3729705061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b2406b0e0 0x7f9b2414bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.976+0000 7f9b29fce700 1 --2- 172.21.15.52:0/3729705061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b24070570 0x7f9b24142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.976+0000 7f9b28fcc700 1 -- 172.21.15.52:0/3729705061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b24070570 msgr2=0x7f9b24142a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.976+0000 7f9b28fcc700 1 --2- 172.21.15.52:0/3729705061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b24070570 0x7f9b24142a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.976+0000 7f9b28fcc700 1 -- 172.21.15.52:0/3729705061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b2406b0e0 msgr2=0x7f9b2414bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:54.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.976+0000 7f9b28fcc700 1 --2- 172.21.15.52:0/3729705061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b2406b0e0 0x7f9b2414bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:54.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.976+0000 7f9b28fcc700 1 -- 172.21.15.52:0/3729705061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b200094a0 con 0x7f9b2406f9d0 2023-06-23T18:44:54.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.976+0000 7f9b297cd700 1 --2- 172.21.15.52:0/3729705061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b2406b0e0 0x7f9b2414bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:44:54.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.976+0000 7f9b29fce700 1 --2- 172.21.15.52:0/3729705061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b24070570 0x7f9b24142a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:44:54.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.977+0000 7f9b28fcc700 1 --2- 172.21.15.52:0/3729705061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b2406f9d0 0x7f9b241424f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400c540 tx=0x7f9b1400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:54.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.977+0000 7f9b19ffb700 1 -- 172.21.15.52:0/3729705061 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b14004c80 con 0x7f9b2406f9d0 2023-06-23T18:44:54.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.977+0000 7f9b19ffb700 1 -- 172.21.15.52:0/3729705061 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b14004de0 con 0x7f9b2406f9d0 2023-06-23T18:44:54.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.977+0000 7f9b2ba31700 1 -- 172.21.15.52:0/3729705061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b24143150 con 0x7f9b2406f9d0 2023-06-23T18:44:54.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.977+0000 7f9b19ffb700 1 -- 172.21.15.52:0/3729705061 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b14007310 con 0x7f9b2406f9d0 2023-06-23T18:44:54.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.977+0000 7f9b2ba31700 1 -- 172.21.15.52:0/3729705061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b240b43c0 con 0x7f9b2406f9d0 2023-06-23T18:44:54.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.978+0000 7f9b2ba31700 1 -- 172.21.15.52:0/3729705061 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b24070e20 con 0x7f9b2406f9d0 2023-06-23T18:44:54.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.978+0000 7f9b19ffb700 1 -- 172.21.15.52:0/3729705061 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9b14007470 con 0x7f9b2406f9d0 2023-06-23T18:44:54.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.979+0000 7f9b19ffb700 1 --2- 172.21.15.52:0/3729705061 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9b0806ace0 0x7f9b0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:54.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.979+0000 7f9b19ffb700 1 -- 172.21.15.52:0/3729705061 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9b14089250 con 0x7f9b2406f9d0 2023-06-23T18:44:54.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.979+0000 7f9b297cd700 1 --2- 172.21.15.52:0/3729705061 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9b0806ace0 0x7f9b0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:54.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.979+0000 7f9b297cd700 1 --2- 172.21.15.52:0/3729705061 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9b0806ace0 0x7f9b0806d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9b20000c00 tx=0x7f9b2001c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:54.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:54.983+0000 7f9b19ffb700 1 -- 172.21.15.52:0/3729705061 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9b14054300 con 0x7f9b2406f9d0 2023-06-23T18:44:55.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.174+0000 7f9b2ba31700 1 -- 172.21.15.52:0/3729705061 --> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9b24070050 con 0x7f9b0806ace0 2023-06-23T18:44:55.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.182+0000 7f9b19ffb700 1 -- 172.21.15.52:0/3729705061 <== mgr.4106 v2:172.21.15.89:6832/397406548 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286914 (secure 0 0 0) 0x7f9b20003850 con 0x7f9b0806ace0 2023-06-23T18:44:55.190 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:44:55.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.185+0000 7f9b2ba31700 1 -- 172.21.15.52:0/3729705061 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9b0806ace0 msgr2=0x7f9b0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:55.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.185+0000 7f9b2ba31700 1 --2- 172.21.15.52:0/3729705061 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9b0806ace0 0x7f9b0806d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9b20000c00 tx=0x7f9b2001c040 comp rx=0 tx=0).stop 2023-06-23T18:44:55.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.186+0000 7f9b2ba31700 1 -- 172.21.15.52:0/3729705061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b2406f9d0 msgr2=0x7f9b241424f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:55.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.186+0000 7f9b2ba31700 1 --2- 172.21.15.52:0/3729705061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b2406f9d0 0x7f9b241424f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400c540 tx=0x7f9b1400c900 comp rx=0 tx=0).stop 2023-06-23T18:44:55.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.186+0000 7f9b2ba31700 1 -- 172.21.15.52:0/3729705061 shutdown_connections 2023-06-23T18:44:55.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.186+0000 7f9b2ba31700 1 --2- 172.21.15.52:0/3729705061 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9b0806ace0 0x7f9b0806d190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:55.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.186+0000 7f9b2ba31700 1 --2- 172.21.15.52:0/3729705061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b24070570 0x7f9b24142a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:55.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.186+0000 7f9b2ba31700 1 --2- 172.21.15.52:0/3729705061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b2406b0e0 0x7f9b2414bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:55.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.186+0000 7f9b2ba31700 1 --2- 172.21.15.52:0/3729705061 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b2406f9d0 0x7f9b241424f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:55.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.186+0000 7f9b2ba31700 1 -- 172.21.15.52:0/3729705061 >> 172.21.15.52:0/3729705061 conn(0x7f9b240bd690 msgr2=0x7f9b240bbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:55.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.186+0000 7f9b2ba31700 1 -- 172.21.15.52:0/3729705061 shutdown_connections 2023-06-23T18:44:55.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.186+0000 7f9b2ba31700 1 -- 172.21.15.52:0/3729705061 wait complete. 2023-06-23T18:44:55.194 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-06-23T18:44:55.202 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-06-23T18:44:53.776338+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218496,"kb_used_data":2880,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756224,"statfs":{"total":773094113280,"available":772870373376,"internally_reserved":0,"allocated":2949120,"data_stored":1797332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.558628"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.670832+0000","last_change":"2023-06-23T18:44:50.669535+0000","last_active":"2023-06-23T18:44:50.670832+0000","last_peered":"2023-06-23T18:44:50.670832+0000","last_clean":"2023-06-23T18:44:50.670832+0000","last_became_active":"2023-06-23T18:44:50.669314+0000","last_became_peered":"2023-06-23T18:44:50.669314+0000","last_unstale":"2023-06-23T18:44:50.670832+0000","last_undegraded":"2023-06-23T18:44:50.670832+0000","last_fullsized":"2023-06-23T18:44:50.670832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:33:18.398833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.663610+0000","last_change":"2023-06-23T18:44:50.655548+0000","last_active":"2023-06-23T18:44:50.663610+0000","last_peered":"2023-06-23T18:44:50.663610+0000","last_clean":"2023-06-23T18:44:50.663610+0000","last_became_active":"2023-06-23T18:44:50.655143+0000","last_became_peered":"2023-06-23T18:44:50.655143+0000","last_unstale":"2023-06-23T18:44:50.663610+0000","last_undegraded":"2023-06-23T18:44:50.663610+0000","last_fullsized":"2023-06-23T18:44:50.663610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:03:32.209474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498122+0000","last_change":"2023-06-23T18:44:50.667478+0000","last_active":"2023-06-23T18:44:52.498122+0000","last_peered":"2023-06-23T18:44:52.498122+0000","last_clean":"2023-06-23T18:44:52.498122+0000","last_became_active":"2023-06-23T18:44:50.667142+0000","last_became_peered":"2023-06-23T18:44:50.667142+0000","last_unstale":"2023-06-23T18:44:52.498122+0000","last_undegraded":"2023-06-23T18:44:52.498122+0000","last_fullsized":"2023-06-23T18:44:52.498122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:48:26.644150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655406+0000","last_change":"2023-06-23T18:44:50.663624+0000","last_active":"2023-06-23T18:44:51.655406+0000","last_peered":"2023-06-23T18:44:51.655406+0000","last_clean":"2023-06-23T18:44:51.655406+0000","last_became_active":"2023-06-23T18:44:50.663376+0000","last_became_peered":"2023-06-23T18:44:50.663376+0000","last_unstale":"2023-06-23T18:44:51.655406+0000","last_undegraded":"2023-06-23T18:44:51.655406+0000","last_fullsized":"2023-06-23T18:44:51.655406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:17:28.994298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404393+0000","last_change":"2023-06-23T18:44:50.671557+0000","last_active":"2023-06-23T18:44:52.404393+0000","last_peered":"2023-06-23T18:44:52.404393+0000","last_clean":"2023-06-23T18:44:52.404393+0000","last_became_active":"2023-06-23T18:44:50.671298+0000","last_became_peered":"2023-06-23T18:44:50.671298+0000","last_unstale":"2023-06-23T18:44:52.404393+0000","last_undegraded":"2023-06-23T18:44:52.404393+0000","last_fullsized":"2023-06-23T18:44:52.404393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:06:39.243693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498058+0000","last_change":"2023-06-23T18:44:50.664406+0000","last_active":"2023-06-23T18:44:52.498058+0000","last_peered":"2023-06-23T18:44:52.498058+0000","last_clean":"2023-06-23T18:44:52.498058+0000","last_became_active":"2023-06-23T18:44:50.664144+0000","last_became_peered":"2023-06-23T18:44:50.664144+0000","last_unstale":"2023-06-23T18:44:52.498058+0000","last_undegraded":"2023-06-23T18:44:52.498058+0000","last_fullsized":"2023-06-23T18:44:52.498058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:43:05.880234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006057+0000","last_change":"2023-06-23T18:44:50.669048+0000","last_active":"2023-06-23T18:44:52.006057+0000","last_peered":"2023-06-23T18:44:52.006057+0000","last_clean":"2023-06-23T18:44:52.006057+0000","last_became_active":"2023-06-23T18:44:50.668771+0000","last_became_peered":"2023-06-23T18:44:50.668771+0000","last_unstale":"2023-06-23T18:44:52.006057+0000","last_undegraded":"2023-06-23T18:44:52.006057+0000","last_fullsized":"2023-06-23T18:44:52.006057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:43:05.880234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.669844+0000","last_change":"2023-06-23T18:44:50.667476+0000","last_active":"2023-06-23T18:44:50.669844+0000","last_peered":"2023-06-23T18:44:50.669844+0000","last_clean":"2023-06-23T18:44:50.669844+0000","last_became_active":"2023-06-23T18:44:50.667193+0000","last_became_peered":"2023-06-23T18:44:50.667193+0000","last_unstale":"2023-06-23T18:44:50.669844+0000","last_undegraded":"2023-06-23T18:44:50.669844+0000","last_fullsized":"2023-06-23T18:44:50.669844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:50:10.163258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404434+0000","last_change":"2023-06-23T18:44:50.659873+0000","last_active":"2023-06-23T18:44:52.404434+0000","last_peered":"2023-06-23T18:44:52.404434+0000","last_clean":"2023-06-23T18:44:52.404434+0000","last_became_active":"2023-06-23T18:44:50.659596+0000","last_became_peered":"2023-06-23T18:44:50.659596+0000","last_unstale":"2023-06-23T18:44:52.404434+0000","last_undegraded":"2023-06-23T18:44:52.404434+0000","last_fullsized":"2023-06-23T18:44:52.404434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:11:35.546421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.664373+0000","last_change":"2023-06-23T18:44:50.662516+0000","last_active":"2023-06-23T18:44:50.664373+0000","last_peered":"2023-06-23T18:44:50.664373+0000","last_clean":"2023-06-23T18:44:50.664373+0000","last_became_active":"2023-06-23T18:44:50.662228+0000","last_became_peered":"2023-06-23T18:44:50.662228+0000","last_unstale":"2023-06-23T18:44:50.664373+0000","last_undegraded":"2023-06-23T18:44:50.664373+0000","last_fullsized":"2023-06-23T18:44:50.664373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:26:28.408408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498265+0000","last_change":"2023-06-23T18:44:50.669567+0000","last_active":"2023-06-23T18:44:52.498265+0000","last_peered":"2023-06-23T18:44:52.498265+0000","last_clean":"2023-06-23T18:44:52.498265+0000","last_became_active":"2023-06-23T18:44:50.667154+0000","last_became_peered":"2023-06-23T18:44:50.667154+0000","last_unstale":"2023-06-23T18:44:52.498265+0000","last_undegraded":"2023-06-23T18:44:52.498265+0000","last_fullsized":"2023-06-23T18:44:52.498265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:34:35.075905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.670274+0000","last_change":"2023-06-23T18:44:50.667100+0000","last_active":"2023-06-23T18:44:50.670274+0000","last_peered":"2023-06-23T18:44:50.670274+0000","last_clean":"2023-06-23T18:44:50.670274+0000","last_became_active":"2023-06-23T18:44:50.666768+0000","last_became_peered":"2023-06-23T18:44:50.666768+0000","last_unstale":"2023-06-23T18:44:50.670274+0000","last_undegraded":"2023-06-23T18:44:50.670274+0000","last_fullsized":"2023-06-23T18:44:50.670274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:36:48.977717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.671460+0000","last_change":"2023-06-23T18:44:50.670413+0000","last_active":"2023-06-23T18:44:50.671460+0000","last_peered":"2023-06-23T18:44:50.671460+0000","last_clean":"2023-06-23T18:44:50.671460+0000","last_became_active":"2023-06-23T18:44:50.670105+0000","last_became_peered":"2023-06-23T18:44:50.670105+0000","last_unstale":"2023-06-23T18:44:50.671460+0000","last_undegraded":"2023-06-23T18:44:50.671460+0000","last_fullsized":"2023-06-23T18:44:50.671460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:34:24.673029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.663297+0000","last_change":"2023-06-23T18:44:50.655737+0000","last_active":"2023-06-23T18:44:50.663297+0000","last_peered":"2023-06-23T18:44:50.663297+0000","last_clean":"2023-06-23T18:44:50.663297+0000","last_became_active":"2023-06-23T18:44:50.655253+0000","last_became_peered":"2023-06-23T18:44:50.655253+0000","last_unstale":"2023-06-23T18:44:50.663297+0000","last_undegraded":"2023-06-23T18:44:50.663297+0000","last_fullsized":"2023-06-23T18:44:50.663297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:20:59.100212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006225+0000","last_change":"2023-06-23T18:44:50.669573+0000","last_active":"2023-06-23T18:44:52.006225+0000","last_peered":"2023-06-23T18:44:52.006225+0000","last_clean":"2023-06-23T18:44:52.006225+0000","last_became_active":"2023-06-23T18:44:50.668886+0000","last_became_peered":"2023-06-23T18:44:50.668886+0000","last_unstale":"2023-06-23T18:44:52.006225+0000","last_undegraded":"2023-06-23T18:44:52.006225+0000","last_fullsized":"2023-06-23T18:44:52.006225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:00:29.622659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.497857+0000","last_change":"2023-06-23T18:44:50.664890+0000","last_active":"2023-06-23T18:44:52.497857+0000","last_peered":"2023-06-23T18:44:52.497857+0000","last_clean":"2023-06-23T18:44:52.497857+0000","last_became_active":"2023-06-23T18:44:50.664571+0000","last_became_peered":"2023-06-23T18:44:50.664571+0000","last_unstale":"2023-06-23T18:44:52.497857+0000","last_undegraded":"2023-06-23T18:44:52.497857+0000","last_fullsized":"2023-06-23T18:44:52.497857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:24:20.739761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404406+0000","last_change":"2023-06-23T18:44:50.672231+0000","last_active":"2023-06-23T18:44:52.404406+0000","last_peered":"2023-06-23T18:44:52.404406+0000","last_clean":"2023-06-23T18:44:52.404406+0000","last_became_active":"2023-06-23T18:44:50.671979+0000","last_became_peered":"2023-06-23T18:44:50.671979+0000","last_unstale":"2023-06-23T18:44:52.404406+0000","last_undegraded":"2023-06-23T18:44:52.404406+0000","last_fullsized":"2023-06-23T18:44:52.404406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:53:28.521694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498218+0000","last_change":"2023-06-23T18:44:50.667846+0000","last_active":"2023-06-23T18:44:52.498218+0000","last_peered":"2023-06-23T18:44:52.498218+0000","last_clean":"2023-06-23T18:44:52.498218+0000","last_became_active":"2023-06-23T18:44:50.667545+0000","last_became_peered":"2023-06-23T18:44:50.667545+0000","last_unstale":"2023-06-23T18:44:52.498218+0000","last_undegraded":"2023-06-23T18:44:52.498218+0000","last_fullsized":"2023-06-23T18:44:52.498218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:59:07.537499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.664727+0000","last_change":"2023-06-23T18:44:50.662459+0000","last_active":"2023-06-23T18:44:50.664727+0000","last_peered":"2023-06-23T18:44:50.664727+0000","last_clean":"2023-06-23T18:44:50.664727+0000","last_became_active":"2023-06-23T18:44:50.662128+0000","last_became_peered":"2023-06-23T18:44:50.662128+0000","last_unstale":"2023-06-23T18:44:50.664727+0000","last_undegraded":"2023-06-23T18:44:50.664727+0000","last_fullsized":"2023-06-23T18:44:50.664727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:28:50.984289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498229+0000","last_change":"2023-06-23T18:44:50.670686+0000","last_active":"2023-06-23T18:44:52.498229+0000","last_peered":"2023-06-23T18:44:52.498229+0000","last_clean":"2023-06-23T18:44:52.498229+0000","last_became_active":"2023-06-23T18:44:50.670397+0000","last_became_peered":"2023-06-23T18:44:50.670397+0000","last_unstale":"2023-06-23T18:44:52.498229+0000","last_undegraded":"2023-06-23T18:44:52.498229+0000","last_fullsized":"2023-06-23T18:44:52.498229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:29:44.651970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006353+0000","last_change":"2023-06-23T18:44:50.676320+0000","last_active":"2023-06-23T18:44:52.006353+0000","last_peered":"2023-06-23T18:44:52.006353+0000","last_clean":"2023-06-23T18:44:52.006353+0000","last_became_active":"2023-06-23T18:44:50.676054+0000","last_became_peered":"2023-06-23T18:44:50.676054+0000","last_unstale":"2023-06-23T18:44:52.006353+0000","last_undegraded":"2023-06-23T18:44:52.006353+0000","last_fullsized":"2023-06-23T18:44:52.006353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:59:07.537499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404037+0000","last_change":"2023-06-23T18:44:50.663287+0000","last_active":"2023-06-23T18:44:52.404037+0000","last_peered":"2023-06-23T18:44:52.404037+0000","last_clean":"2023-06-23T18:44:52.404037+0000","last_became_active":"2023-06-23T18:44:50.663006+0000","last_became_peered":"2023-06-23T18:44:50.663006+0000","last_unstale":"2023-06-23T18:44:52.404037+0000","last_undegraded":"2023-06-23T18:44:52.404037+0000","last_fullsized":"2023-06-23T18:44:52.404037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:17:28.994298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.675472+0000","last_change":"2023-06-23T18:44:50.668418+0000","last_active":"2023-06-23T18:44:50.675472+0000","last_peered":"2023-06-23T18:44:50.675472+0000","last_clean":"2023-06-23T18:44:50.675472+0000","last_became_active":"2023-06-23T18:44:50.668029+0000","last_became_peered":"2023-06-23T18:44:50.668029+0000","last_unstale":"2023-06-23T18:44:50.675472+0000","last_undegraded":"2023-06-23T18:44:50.675472+0000","last_fullsized":"2023-06-23T18:44:50.675472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:14:45.542328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006017+0000","last_change":"2023-06-23T18:44:50.675363+0000","last_active":"2023-06-23T18:44:52.006017+0000","last_peered":"2023-06-23T18:44:52.006017+0000","last_clean":"2023-06-23T18:44:52.006017+0000","last_became_active":"2023-06-23T18:44:50.675099+0000","last_became_peered":"2023-06-23T18:44:50.675099+0000","last_unstale":"2023-06-23T18:44:52.006017+0000","last_undegraded":"2023-06-23T18:44:52.006017+0000","last_fullsized":"2023-06-23T18:44:52.006017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:24:00.797602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650898+0000","last_change":"2023-06-23T18:44:50.662603+0000","last_active":"2023-06-23T18:44:51.650898+0000","last_peered":"2023-06-23T18:44:51.650898+0000","last_clean":"2023-06-23T18:44:51.650898+0000","last_became_active":"2023-06-23T18:44:50.662318+0000","last_became_peered":"2023-06-23T18:44:50.662318+0000","last_unstale":"2023-06-23T18:44:51.650898+0000","last_undegraded":"2023-06-23T18:44:51.650898+0000","last_fullsized":"2023-06-23T18:44:51.650898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:23:07.364903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650929+0000","last_change":"2023-06-23T18:44:50.655943+0000","last_active":"2023-06-23T18:44:51.650929+0000","last_peered":"2023-06-23T18:44:51.650929+0000","last_clean":"2023-06-23T18:44:51.650929+0000","last_became_active":"2023-06-23T18:44:50.655672+0000","last_became_peered":"2023-06-23T18:44:50.655672+0000","last_unstale":"2023-06-23T18:44:51.650929+0000","last_undegraded":"2023-06-23T18:44:51.650929+0000","last_fullsized":"2023-06-23T18:44:51.650929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:53:28.521694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.671526+0000","last_change":"2023-06-23T18:44:50.670220+0000","last_active":"2023-06-23T18:44:50.671526+0000","last_peered":"2023-06-23T18:44:50.671526+0000","last_clean":"2023-06-23T18:44:50.671526+0000","last_became_active":"2023-06-23T18:44:50.669773+0000","last_became_peered":"2023-06-23T18:44:50.669773+0000","last_unstale":"2023-06-23T18:44:50.671526+0000","last_undegraded":"2023-06-23T18:44:50.671526+0000","last_fullsized":"2023-06-23T18:44:50.671526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:48:22.694731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498027+0000","last_change":"2023-06-23T18:44:50.246485+0000","last_active":"2023-06-23T18:44:52.498027+0000","last_peered":"2023-06-23T18:44:52.498027+0000","last_clean":"2023-06-23T18:44:52.498027+0000","last_became_active":"2023-06-23T18:44:50.246186+0000","last_became_peered":"2023-06-23T18:44:50.246186+0000","last_unstale":"2023-06-23T18:44:52.498027+0000","last_undegraded":"2023-06-23T18:44:52.498027+0000","last_fullsized":"2023-06-23T18:44:52.498027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:00:28.617628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.674669+0000","last_change":"2023-06-23T18:44:50.665653+0000","last_active":"2023-06-23T18:44:50.674669+0000","last_peered":"2023-06-23T18:44:50.674669+0000","last_clean":"2023-06-23T18:44:50.674669+0000","last_became_active":"2023-06-23T18:44:50.665383+0000","last_became_peered":"2023-06-23T18:44:50.665383+0000","last_unstale":"2023-06-23T18:44:50.674669+0000","last_undegraded":"2023-06-23T18:44:50.674669+0000","last_fullsized":"2023-06-23T18:44:50.674669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:50:10.163258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650418+0000","last_change":"2023-06-23T18:44:50.244604+0000","last_active":"2023-06-23T18:44:51.650418+0000","last_peered":"2023-06-23T18:44:51.650418+0000","last_clean":"2023-06-23T18:44:51.650418+0000","last_became_active":"2023-06-23T18:44:50.244307+0000","last_became_peered":"2023-06-23T18:44:50.244307+0000","last_unstale":"2023-06-23T18:44:51.650418+0000","last_undegraded":"2023-06-23T18:44:51.650418+0000","last_fullsized":"2023-06-23T18:44:51.650418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:04:47.082248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404529+0000","last_change":"2023-06-23T18:44:50.674014+0000","last_active":"2023-06-23T18:44:52.404529+0000","last_peered":"2023-06-23T18:44:52.404529+0000","last_clean":"2023-06-23T18:44:52.404529+0000","last_became_active":"2023-06-23T18:44:50.673751+0000","last_became_peered":"2023-06-23T18:44:50.673751+0000","last_unstale":"2023-06-23T18:44:52.404529+0000","last_undegraded":"2023-06-23T18:44:52.404529+0000","last_fullsized":"2023-06-23T18:44:52.404529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:24:00.797602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.654030+0000","last_change":"2023-06-23T18:44:50.241541+0000","last_active":"2023-06-23T18:44:50.654030+0000","last_peered":"2023-06-23T18:44:50.654030+0000","last_clean":"2023-06-23T18:44:50.654030+0000","last_became_active":"2023-06-23T18:44:50.241250+0000","last_became_peered":"2023-06-23T18:44:50.241250+0000","last_unstale":"2023-06-23T18:44:50.654030+0000","last_undegraded":"2023-06-23T18:44:50.654030+0000","last_fullsized":"2023-06-23T18:44:50.654030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:13:34.719568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655460+0000","last_change":"2023-06-23T18:44:50.665987+0000","last_active":"2023-06-23T18:44:51.655460+0000","last_peered":"2023-06-23T18:44:51.655460+0000","last_clean":"2023-06-23T18:44:51.655460+0000","last_became_active":"2023-06-23T18:44:50.665705+0000","last_became_peered":"2023-06-23T18:44:50.665705+0000","last_unstale":"2023-06-23T18:44:51.655460+0000","last_undegraded":"2023-06-23T18:44:51.655460+0000","last_fullsized":"2023-06-23T18:44:51.655460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:26:23.851192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404593+0000","last_change":"2023-06-23T18:44:50.240166+0000","last_active":"2023-06-23T18:44:52.404593+0000","last_peered":"2023-06-23T18:44:52.404593+0000","last_clean":"2023-06-23T18:44:52.404593+0000","last_became_active":"2023-06-23T18:44:50.239596+0000","last_became_peered":"2023-06-23T18:44:50.239596+0000","last_unstale":"2023-06-23T18:44:52.404593+0000","last_undegraded":"2023-06-23T18:44:52.404593+0000","last_fullsized":"2023-06-23T18:44:52.404593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:43:04.875204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.672940+0000","last_change":"2023-06-23T18:44:50.663993+0000","last_active":"2023-06-23T18:44:50.672940+0000","last_peered":"2023-06-23T18:44:50.672940+0000","last_clean":"2023-06-23T18:44:50.672940+0000","last_became_active":"2023-06-23T18:44:50.663754+0000","last_became_peered":"2023-06-23T18:44:50.663754+0000","last_unstale":"2023-06-23T18:44:50.672940+0000","last_undegraded":"2023-06-23T18:44:50.672940+0000","last_fullsized":"2023-06-23T18:44:50.672940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:31:28.989051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.649059+0000","last_change":"2023-06-23T18:44:50.244382+0000","last_active":"2023-06-23T18:44:50.649059+0000","last_peered":"2023-06-23T18:44:50.649059+0000","last_clean":"2023-06-23T18:44:50.649059+0000","last_became_active":"2023-06-23T18:44:50.244129+0000","last_became_peered":"2023-06-23T18:44:50.244129+0000","last_unstale":"2023-06-23T18:44:50.649059+0000","last_undegraded":"2023-06-23T18:44:50.649059+0000","last_fullsized":"2023-06-23T18:44:50.649059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:50:31.312312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.675589+0000","last_change":"2023-06-23T18:44:50.670667+0000","last_active":"2023-06-23T18:44:50.675589+0000","last_peered":"2023-06-23T18:44:50.675589+0000","last_clean":"2023-06-23T18:44:50.675589+0000","last_became_active":"2023-06-23T18:44:50.670402+0000","last_became_peered":"2023-06-23T18:44:50.670402+0000","last_unstale":"2023-06-23T18:44:50.675589+0000","last_undegraded":"2023-06-23T18:44:50.675589+0000","last_fullsized":"2023-06-23T18:44:50.675589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:51:27.271916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006302+0000","last_change":"2023-06-23T18:44:50.249346+0000","last_active":"2023-06-23T18:44:52.006302+0000","last_peered":"2023-06-23T18:44:52.006302+0000","last_clean":"2023-06-23T18:44:52.006302+0000","last_became_active":"2023-06-23T18:44:50.249071+0000","last_became_peered":"2023-06-23T18:44:50.249071+0000","last_unstale":"2023-06-23T18:44:52.006302+0000","last_undegraded":"2023-06-23T18:44:52.006302+0000","last_fullsized":"2023-06-23T18:44:52.006302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:48:25.639120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650607+0000","last_change":"2023-06-23T18:44:50.663115+0000","last_active":"2023-06-23T18:44:51.650607+0000","last_peered":"2023-06-23T18:44:51.650607+0000","last_clean":"2023-06-23T18:44:51.650607+0000","last_became_active":"2023-06-23T18:44:50.662843+0000","last_became_peered":"2023-06-23T18:44:50.662843+0000","last_unstale":"2023-06-23T18:44:51.650607+0000","last_undegraded":"2023-06-23T18:44:51.650607+0000","last_fullsized":"2023-06-23T18:44:51.650607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:17:28.994298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498336+0000","last_change":"2023-06-23T18:44:50.247158+0000","last_active":"2023-06-23T18:44:52.498336+0000","last_peered":"2023-06-23T18:44:52.498336+0000","last_clean":"2023-06-23T18:44:52.498336+0000","last_became_active":"2023-06-23T18:44:50.246857+0000","last_became_peered":"2023-06-23T18:44:50.246857+0000","last_unstale":"2023-06-23T18:44:52.498336+0000","last_undegraded":"2023-06-23T18:44:52.498336+0000","last_fullsized":"2023-06-23T18:44:52.498336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:04:29.395928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498272+0000","last_change":"2023-06-23T18:44:50.667952+0000","last_active":"2023-06-23T18:44:52.498272+0000","last_peered":"2023-06-23T18:44:52.498272+0000","last_clean":"2023-06-23T18:44:52.498272+0000","last_became_active":"2023-06-23T18:44:50.667653+0000","last_became_peered":"2023-06-23T18:44:50.667653+0000","last_unstale":"2023-06-23T18:44:52.498272+0000","last_undegraded":"2023-06-23T18:44:52.498272+0000","last_fullsized":"2023-06-23T18:44:52.498272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:17:33.321718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006119+0000","last_change":"2023-06-23T18:44:50.248101+0000","last_active":"2023-06-23T18:44:52.006119+0000","last_peered":"2023-06-23T18:44:52.006119+0000","last_clean":"2023-06-23T18:44:52.006119+0000","last_became_active":"2023-06-23T18:44:50.247805+0000","last_became_peered":"2023-06-23T18:44:50.247805+0000","last_unstale":"2023-06-23T18:44:52.006119+0000","last_undegraded":"2023-06-23T18:44:52.006119+0000","last_fullsized":"2023-06-23T18:44:52.006119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:24:19.734731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.675422+0000","last_change":"2023-06-23T18:44:50.667698+0000","last_active":"2023-06-23T18:44:50.675422+0000","last_peered":"2023-06-23T18:44:50.675422+0000","last_clean":"2023-06-23T18:44:50.675422+0000","last_became_active":"2023-06-23T18:44:50.667423+0000","last_became_peered":"2023-06-23T18:44:50.667423+0000","last_unstale":"2023-06-23T18:44:50.675422+0000","last_undegraded":"2023-06-23T18:44:50.675422+0000","last_fullsized":"2023-06-23T18:44:50.675422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:07:37.802543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404201+0000","last_change":"2023-06-23T18:44:50.247136+0000","last_active":"2023-06-23T18:44:52.404201+0000","last_peered":"2023-06-23T18:44:52.404201+0000","last_clean":"2023-06-23T18:44:52.404201+0000","last_became_active":"2023-06-23T18:44:50.246862+0000","last_became_peered":"2023-06-23T18:44:50.246862+0000","last_unstale":"2023-06-23T18:44:52.404201+0000","last_undegraded":"2023-06-23T18:44:52.404201+0000","last_fullsized":"2023-06-23T18:44:52.404201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:33:31.904138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.671507+0000","last_change":"2023-06-23T18:44:50.670045+0000","last_active":"2023-06-23T18:44:50.671507+0000","last_peered":"2023-06-23T18:44:50.671507+0000","last_clean":"2023-06-23T18:44:50.671507+0000","last_became_active":"2023-06-23T18:44:50.669434+0000","last_became_peered":"2023-06-23T18:44:50.669434+0000","last_unstale":"2023-06-23T18:44:50.671507+0000","last_undegraded":"2023-06-23T18:44:50.671507+0000","last_fullsized":"2023-06-23T18:44:50.671507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:03:16.001494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006195+0000","last_change":"2023-06-23T18:44:50.248720+0000","last_active":"2023-06-23T18:44:52.006195+0000","last_peered":"2023-06-23T18:44:52.006195+0000","last_clean":"2023-06-23T18:44:52.006195+0000","last_became_active":"2023-06-23T18:44:50.248413+0000","last_became_peered":"2023-06-23T18:44:50.248413+0000","last_unstale":"2023-06-23T18:44:52.006195+0000","last_undegraded":"2023-06-23T18:44:52.006195+0000","last_fullsized":"2023-06-23T18:44:52.006195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:29:43.646940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404302+0000","last_change":"2023-06-23T18:44:50.670389+0000","last_active":"2023-06-23T18:44:52.404302+0000","last_peered":"2023-06-23T18:44:52.404302+0000","last_clean":"2023-06-23T18:44:52.404302+0000","last_became_active":"2023-06-23T18:44:50.670097+0000","last_became_peered":"2023-06-23T18:44:50.670097+0000","last_unstale":"2023-06-23T18:44:52.404302+0000","last_undegraded":"2023-06-23T18:44:52.404302+0000","last_fullsized":"2023-06-23T18:44:52.404302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:09:27.754720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.654985+0000","last_change":"2023-06-23T18:44:50.248018+0000","last_active":"2023-06-23T18:44:51.654985+0000","last_peered":"2023-06-23T18:44:51.654985+0000","last_clean":"2023-06-23T18:44:51.654985+0000","last_became_active":"2023-06-23T18:44:50.247728+0000","last_became_peered":"2023-06-23T18:44:50.247728+0000","last_unstale":"2023-06-23T18:44:51.654985+0000","last_undegraded":"2023-06-23T18:44:51.654985+0000","last_fullsized":"2023-06-23T18:44:51.654985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:26:27.403377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.675845+0000","last_change":"2023-06-23T18:44:50.671378+0000","last_active":"2023-06-23T18:44:50.675845+0000","last_peered":"2023-06-23T18:44:50.675845+0000","last_clean":"2023-06-23T18:44:50.675845+0000","last_became_active":"2023-06-23T18:44:50.671070+0000","last_became_peered":"2023-06-23T18:44:50.671070+0000","last_unstale":"2023-06-23T18:44:50.675845+0000","last_undegraded":"2023-06-23T18:44:50.675845+0000","last_fullsized":"2023-06-23T18:44:50.675845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:46:59.173048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006489+0000","last_change":"2023-06-23T18:44:50.248058+0000","last_active":"2023-06-23T18:44:52.006489+0000","last_peered":"2023-06-23T18:44:52.006489+0000","last_clean":"2023-06-23T18:44:52.006489+0000","last_became_active":"2023-06-23T18:44:50.247761+0000","last_became_peered":"2023-06-23T18:44:50.247761+0000","last_unstale":"2023-06-23T18:44:52.006489+0000","last_undegraded":"2023-06-23T18:44:52.006489+0000","last_fullsized":"2023-06-23T18:44:52.006489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:51:58.116537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.670988+0000","last_change":"2023-06-23T18:44:50.669693+0000","last_active":"2023-06-23T18:44:50.670988+0000","last_peered":"2023-06-23T18:44:50.670988+0000","last_clean":"2023-06-23T18:44:50.670988+0000","last_became_active":"2023-06-23T18:44:50.669380+0000","last_became_peered":"2023-06-23T18:44:50.669380+0000","last_unstale":"2023-06-23T18:44:50.670988+0000","last_undegraded":"2023-06-23T18:44:50.670988+0000","last_fullsized":"2023-06-23T18:44:50.670988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:07:37.802543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006321+0000","last_change":"2023-06-23T18:44:50.248597+0000","last_active":"2023-06-23T18:44:52.006321+0000","last_peered":"2023-06-23T18:44:52.006321+0000","last_clean":"2023-06-23T18:44:52.006321+0000","last_became_active":"2023-06-23T18:44:50.248309+0000","last_became_peered":"2023-06-23T18:44:50.248309+0000","last_unstale":"2023-06-23T18:44:52.006321+0000","last_undegraded":"2023-06-23T18:44:52.006321+0000","last_fullsized":"2023-06-23T18:44:52.006321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:36:18.947220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.497799+0000","last_change":"2023-06-23T18:44:50.667519+0000","last_active":"2023-06-23T18:44:52.497799+0000","last_peered":"2023-06-23T18:44:52.497799+0000","last_clean":"2023-06-23T18:44:52.497799+0000","last_became_active":"2023-06-23T18:44:50.667042+0000","last_became_peered":"2023-06-23T18:44:50.667042+0000","last_unstale":"2023-06-23T18:44:52.497799+0000","last_undegraded":"2023-06-23T18:44:52.497799+0000","last_fullsized":"2023-06-23T18:44:52.497799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:39:47.275362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006335+0000","last_change":"2023-06-23T18:44:50.247778+0000","last_active":"2023-06-23T18:44:52.006335+0000","last_peered":"2023-06-23T18:44:52.006335+0000","last_clean":"2023-06-23T18:44:52.006335+0000","last_became_active":"2023-06-23T18:44:50.247501+0000","last_became_peered":"2023-06-23T18:44:50.247501+0000","last_unstale":"2023-06-23T18:44:52.006335+0000","last_undegraded":"2023-06-23T18:44:52.006335+0000","last_fullsized":"2023-06-23T18:44:52.006335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:29:14.124932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655300+0000","last_change":"2023-06-23T18:44:50.666494+0000","last_active":"2023-06-23T18:44:51.655300+0000","last_peered":"2023-06-23T18:44:51.655300+0000","last_clean":"2023-06-23T18:44:51.655300+0000","last_became_active":"2023-06-23T18:44:50.666222+0000","last_became_peered":"2023-06-23T18:44:50.666222+0000","last_unstale":"2023-06-23T18:44:51.655300+0000","last_undegraded":"2023-06-23T18:44:51.655300+0000","last_fullsized":"2023-06-23T18:44:51.655300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:01:09.268705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.649178+0000","last_change":"2023-06-23T18:44:50.242391+0000","last_active":"2023-06-23T18:44:50.649178+0000","last_peered":"2023-06-23T18:44:50.649178+0000","last_clean":"2023-06-23T18:44:50.649178+0000","last_became_active":"2023-06-23T18:44:50.242109+0000","last_became_peered":"2023-06-23T18:44:50.242109+0000","last_unstale":"2023-06-23T18:44:50.649178+0000","last_undegraded":"2023-06-23T18:44:50.649178+0000","last_fullsized":"2023-06-23T18:44:50.649178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:13:34.719568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404239+0000","last_change":"2023-06-23T18:44:50.663583+0000","last_active":"2023-06-23T18:44:52.404239+0000","last_peered":"2023-06-23T18:44:52.404239+0000","last_clean":"2023-06-23T18:44:52.404239+0000","last_became_active":"2023-06-23T18:44:50.663317+0000","last_became_peered":"2023-06-23T18:44:50.663317+0000","last_unstale":"2023-06-23T18:44:52.404239+0000","last_undegraded":"2023-06-23T18:44:52.404239+0000","last_fullsized":"2023-06-23T18:44:52.404239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:26:23.851192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.674843+0000","last_change":"2023-06-23T18:44:50.241365+0000","last_active":"2023-06-23T18:44:50.674843+0000","last_peered":"2023-06-23T18:44:50.674843+0000","last_clean":"2023-06-23T18:44:50.674843+0000","last_became_active":"2023-06-23T18:44:50.241047+0000","last_became_peered":"2023-06-23T18:44:50.241047+0000","last_unstale":"2023-06-23T18:44:50.674843+0000","last_undegraded":"2023-06-23T18:44:50.674843+0000","last_fullsized":"2023-06-23T18:44:50.674843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:01:08.263675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498069+0000","last_change":"2023-06-23T18:44:50.675000+0000","last_active":"2023-06-23T18:44:52.498069+0000","last_peered":"2023-06-23T18:44:52.498069+0000","last_clean":"2023-06-23T18:44:52.498069+0000","last_became_active":"2023-06-23T18:44:50.674723+0000","last_became_peered":"2023-06-23T18:44:50.674723+0000","last_unstale":"2023-06-23T18:44:52.498069+0000","last_undegraded":"2023-06-23T18:44:52.498069+0000","last_fullsized":"2023-06-23T18:44:52.498069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:36:19.952251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655092+0000","last_change":"2023-06-23T18:44:50.247990+0000","last_active":"2023-06-23T18:44:51.655092+0000","last_peered":"2023-06-23T18:44:51.655092+0000","last_clean":"2023-06-23T18:44:51.655092+0000","last_became_active":"2023-06-23T18:44:50.247701+0000","last_became_peered":"2023-06-23T18:44:50.247701+0000","last_unstale":"2023-06-23T18:44:51.655092+0000","last_undegraded":"2023-06-23T18:44:51.655092+0000","last_fullsized":"2023-06-23T18:44:51.655092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:30:47.540693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498444+0000","last_change":"2023-06-23T18:44:50.666801+0000","last_active":"2023-06-23T18:44:52.498444+0000","last_peered":"2023-06-23T18:44:52.498444+0000","last_clean":"2023-06-23T18:44:52.498444+0000","last_became_active":"2023-06-23T18:44:50.666395+0000","last_became_peered":"2023-06-23T18:44:50.666395+0000","last_unstale":"2023-06-23T18:44:52.498444+0000","last_undegraded":"2023-06-23T18:44:52.498444+0000","last_fullsized":"2023-06-23T18:44:52.498444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:50:28.729386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498272+0000","last_change":"2023-06-23T18:44:50.240923+0000","last_active":"2023-06-23T18:44:52.498272+0000","last_peered":"2023-06-23T18:44:52.498272+0000","last_clean":"2023-06-23T18:44:52.498272+0000","last_became_active":"2023-06-23T18:44:50.240629+0000","last_became_peered":"2023-06-23T18:44:50.240629+0000","last_unstale":"2023-06-23T18:44:52.498272+0000","last_undegraded":"2023-06-23T18:44:52.498272+0000","last_fullsized":"2023-06-23T18:44:52.498272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:51:58.116537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498420+0000","last_change":"2023-06-23T18:44:50.669953+0000","last_active":"2023-06-23T18:44:52.498420+0000","last_peered":"2023-06-23T18:44:52.498420+0000","last_clean":"2023-06-23T18:44:52.498420+0000","last_became_active":"2023-06-23T18:44:50.668113+0000","last_became_peered":"2023-06-23T18:44:50.668113+0000","last_unstale":"2023-06-23T18:44:52.498420+0000","last_undegraded":"2023-06-23T18:44:52.498420+0000","last_fullsized":"2023-06-23T18:44:52.498420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:20:58.258094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.653863+0000","last_change":"2023-06-23T18:44:50.248367+0000","last_active":"2023-06-23T18:44:50.653863+0000","last_peered":"2023-06-23T18:44:50.653863+0000","last_clean":"2023-06-23T18:44:50.653863+0000","last_became_active":"2023-06-23T18:44:50.248058+0000","last_became_peered":"2023-06-23T18:44:50.248058+0000","last_unstale":"2023-06-23T18:44:50.653863+0000","last_undegraded":"2023-06-23T18:44:50.653863+0000","last_fullsized":"2023-06-23T18:44:50.653863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:03:31.204444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.651039+0000","last_change":"2023-06-23T18:44:50.668275+0000","last_active":"2023-06-23T18:44:51.651039+0000","last_peered":"2023-06-23T18:44:51.651039+0000","last_clean":"2023-06-23T18:44:51.651039+0000","last_became_active":"2023-06-23T18:44:50.668011+0000","last_became_peered":"2023-06-23T18:44:50.668011+0000","last_unstale":"2023-06-23T18:44:51.651039+0000","last_undegraded":"2023-06-23T18:44:51.651039+0000","last_fullsized":"2023-06-23T18:44:51.651039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:11:35.546421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.673003+0000","last_change":"2023-06-23T18:44:50.247291+0000","last_active":"2023-06-23T18:44:50.673003+0000","last_peered":"2023-06-23T18:44:50.673003+0000","last_clean":"2023-06-23T18:44:50.673003+0000","last_became_active":"2023-06-23T18:44:50.246993+0000","last_became_peered":"2023-06-23T18:44:50.246993+0000","last_unstale":"2023-06-23T18:44:50.673003+0000","last_undegraded":"2023-06-23T18:44:50.673003+0000","last_fullsized":"2023-06-23T18:44:50.673003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:04:47.082248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498255+0000","last_change":"2023-06-23T18:44:45.192683+0000","last_active":"2023-06-23T18:44:52.498255+0000","last_peered":"2023-06-23T18:44:52.498255+0000","last_clean":"2023-06-23T18:44:52.498255+0000","last_became_active":"2023-06-23T18:44:45.192364+0000","last_became_peered":"2023-06-23T18:44:45.192364+0000","last_unstale":"2023-06-23T18:44:52.498255+0000","last_undegraded":"2023-06-23T18:44:52.498255+0000","last_fullsized":"2023-06-23T18:44:52.498255+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:18:43.258051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.675528+0000","last_change":"2023-06-23T18:44:50.669848+0000","last_active":"2023-06-23T18:44:50.675528+0000","last_peered":"2023-06-23T18:44:50.675528+0000","last_clean":"2023-06-23T18:44:50.675528+0000","last_became_active":"2023-06-23T18:44:50.669597+0000","last_became_peered":"2023-06-23T18:44:50.669597+0000","last_unstale":"2023-06-23T18:44:50.675528+0000","last_undegraded":"2023-06-23T18:44:50.675528+0000","last_fullsized":"2023-06-23T18:44:50.675528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:50:32.317342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.656646+0000","last_change":"2023-06-23T18:44:45.194010+0000","last_active":"2023-06-23T18:44:50.656646+0000","last_peered":"2023-06-23T18:44:50.656646+0000","last_clean":"2023-06-23T18:44:50.656646+0000","last_became_active":"2023-06-23T18:44:45.193665+0000","last_became_peered":"2023-06-23T18:44:45.193665+0000","last_unstale":"2023-06-23T18:44:50.656646+0000","last_undegraded":"2023-06-23T18:44:50.656646+0000","last_fullsized":"2023-06-23T18:44:50.656646+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:26:22.364118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404476+0000","last_change":"2023-06-23T18:44:50.248035+0000","last_active":"2023-06-23T18:44:52.404476+0000","last_peered":"2023-06-23T18:44:52.404476+0000","last_clean":"2023-06-23T18:44:52.404476+0000","last_became_active":"2023-06-23T18:44:50.247776+0000","last_became_peered":"2023-06-23T18:44:50.247776+0000","last_unstale":"2023-06-23T18:44:52.404476+0000","last_undegraded":"2023-06-23T18:44:52.404476+0000","last_fullsized":"2023-06-23T18:44:52.404476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:27:53.233025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.497839+0000","last_change":"2023-06-23T18:44:50.665741+0000","last_active":"2023-06-23T18:44:52.497839+0000","last_peered":"2023-06-23T18:44:52.497839+0000","last_clean":"2023-06-23T18:44:52.497839+0000","last_became_active":"2023-06-23T18:44:50.665276+0000","last_became_peered":"2023-06-23T18:44:50.665276+0000","last_unstale":"2023-06-23T18:44:52.497839+0000","last_undegraded":"2023-06-23T18:44:52.497839+0000","last_fullsized":"2023-06-23T18:44:52.497839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:24:00.797602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650429+0000","last_change":"2023-06-23T18:44:45.192024+0000","last_active":"2023-06-23T18:44:51.650429+0000","last_peered":"2023-06-23T18:44:51.650429+0000","last_clean":"2023-06-23T18:44:51.650429+0000","last_became_active":"2023-06-23T18:44:45.191752+0000","last_became_peered":"2023-06-23T18:44:45.191752+0000","last_unstale":"2023-06-23T18:44:51.650429+0000","last_undegraded":"2023-06-23T18:44:51.650429+0000","last_fullsized":"2023-06-23T18:44:51.650429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:01:03.224415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006092+0000","last_change":"2023-06-23T18:44:45.193018+0000","last_active":"2023-06-23T18:44:52.006092+0000","last_peered":"2023-06-23T18:44:52.006092+0000","last_clean":"2023-06-23T18:44:52.006092+0000","last_became_active":"2023-06-23T18:44:45.192689+0000","last_became_peered":"2023-06-23T18:44:45.192689+0000","last_unstale":"2023-06-23T18:44:52.006092+0000","last_undegraded":"2023-06-23T18:44:52.006092+0000","last_fullsized":"2023-06-23T18:44:52.006092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:30:31.807933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404052+0000","last_change":"2023-06-23T18:44:50.244324+0000","last_active":"2023-06-23T18:44:52.404052+0000","last_peered":"2023-06-23T18:44:52.404052+0000","last_clean":"2023-06-23T18:44:52.404052+0000","last_became_active":"2023-06-23T18:44:50.242219+0000","last_became_peered":"2023-06-23T18:44:50.242219+0000","last_unstale":"2023-06-23T18:44:52.404052+0000","last_undegraded":"2023-06-23T18:44:52.404052+0000","last_fullsized":"2023-06-23T18:44:52.404052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:57:45.432002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404339+0000","last_change":"2023-06-23T18:44:50.660290+0000","last_active":"2023-06-23T18:44:52.404339+0000","last_peered":"2023-06-23T18:44:52.404339+0000","last_clean":"2023-06-23T18:44:52.404339+0000","last_became_active":"2023-06-23T18:44:50.660095+0000","last_became_peered":"2023-06-23T18:44:50.660095+0000","last_unstale":"2023-06-23T18:44:52.404339+0000","last_undegraded":"2023-06-23T18:44:52.404339+0000","last_fullsized":"2023-06-23T18:44:52.404339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:23:07.364903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.005876+0000","last_change":"2023-06-23T18:44:45.577146+0000","last_active":"2023-06-23T18:44:52.005876+0000","last_peered":"2023-06-23T18:44:52.005876+0000","last_clean":"2023-06-23T18:44:52.005876+0000","last_became_active":"2023-06-23T18:44:45.576835+0000","last_became_peered":"2023-06-23T18:44:45.576835+0000","last_unstale":"2023-06-23T18:44:52.005876+0000","last_undegraded":"2023-06-23T18:44:52.005876+0000","last_fullsized":"2023-06-23T18:44:52.005876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:39:41.231072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650345+0000","last_change":"2023-06-23T18:44:50.242675+0000","last_active":"2023-06-23T18:44:51.650345+0000","last_peered":"2023-06-23T18:44:51.650345+0000","last_clean":"2023-06-23T18:44:51.650345+0000","last_became_active":"2023-06-23T18:44:50.242356+0000","last_became_peered":"2023-06-23T18:44:50.242356+0000","last_unstale":"2023-06-23T18:44:51.650345+0000","last_undegraded":"2023-06-23T18:44:51.650345+0000","last_fullsized":"2023-06-23T18:44:51.650345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:30:47.540693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650895+0000","last_change":"2023-06-23T18:44:50.661341+0000","last_active":"2023-06-23T18:44:51.650895+0000","last_peered":"2023-06-23T18:44:51.650895+0000","last_clean":"2023-06-23T18:44:51.650895+0000","last_became_active":"2023-06-23T18:44:50.661088+0000","last_became_peered":"2023-06-23T18:44:50.661088+0000","last_unstale":"2023-06-23T18:44:51.650895+0000","last_undegraded":"2023-06-23T18:44:51.650895+0000","last_fullsized":"2023-06-23T18:44:51.650895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:06:39.243693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.005910+0000","last_change":"2023-06-23T18:44:45.577304+0000","last_active":"2023-06-23T18:44:52.005910+0000","last_peered":"2023-06-23T18:44:52.005910+0000","last_clean":"2023-06-23T18:44:52.005910+0000","last_became_active":"2023-06-23T18:44:45.576846+0000","last_became_peered":"2023-06-23T18:44:45.576846+0000","last_unstale":"2023-06-23T18:44:52.005910+0000","last_undegraded":"2023-06-23T18:44:52.005910+0000","last_fullsized":"2023-06-23T18:44:52.005910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:27:48.193765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.653293+0000","last_change":"2023-06-23T18:44:50.240634+0000","last_active":"2023-06-23T18:44:50.653293+0000","last_peered":"2023-06-23T18:44:50.653293+0000","last_clean":"2023-06-23T18:44:50.653293+0000","last_became_active":"2023-06-23T18:44:50.240328+0000","last_became_peered":"2023-06-23T18:44:50.240328+0000","last_unstale":"2023-06-23T18:44:50.653293+0000","last_undegraded":"2023-06-23T18:44:50.653293+0000","last_fullsized":"2023-06-23T18:44:50.653293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:20:58.095182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655442+0000","last_change":"2023-06-23T18:44:50.668726+0000","last_active":"2023-06-23T18:44:51.655442+0000","last_peered":"2023-06-23T18:44:51.655442+0000","last_clean":"2023-06-23T18:44:51.655442+0000","last_became_active":"2023-06-23T18:44:50.668435+0000","last_became_peered":"2023-06-23T18:44:50.668435+0000","last_unstale":"2023-06-23T18:44:51.655442+0000","last_undegraded":"2023-06-23T18:44:51.655442+0000","last_fullsized":"2023-06-23T18:44:51.655442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:33:32.909168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.648469+0000","last_change":"2023-06-23T18:44:45.577154+0000","last_active":"2023-06-23T18:44:50.648469+0000","last_peered":"2023-06-23T18:44:50.648469+0000","last_clean":"2023-06-23T18:44:50.648469+0000","last_became_active":"2023-06-23T18:44:45.576819+0000","last_became_peered":"2023-06-23T18:44:45.576819+0000","last_unstale":"2023-06-23T18:44:50.648469+0000","last_undegraded":"2023-06-23T18:44:50.648469+0000","last_fullsized":"2023-06-23T18:44:50.648469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:31:22.944761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498150+0000","last_change":"2023-06-23T18:44:50.248143+0000","last_active":"2023-06-23T18:44:52.498150+0000","last_peered":"2023-06-23T18:44:52.498150+0000","last_clean":"2023-06-23T18:44:52.498150+0000","last_became_active":"2023-06-23T18:44:50.247890+0000","last_became_peered":"2023-06-23T18:44:50.247890+0000","last_unstale":"2023-06-23T18:44:52.498150+0000","last_undegraded":"2023-06-23T18:44:52.498150+0000","last_fullsized":"2023-06-23T18:44:52.498150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:29:14.124932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650785+0000","last_change":"2023-06-23T18:44:50.661047+0000","last_active":"2023-06-23T18:44:51.650785+0000","last_peered":"2023-06-23T18:44:51.650785+0000","last_clean":"2023-06-23T18:44:51.650785+0000","last_became_active":"2023-06-23T18:44:50.660762+0000","last_became_peered":"2023-06-23T18:44:50.660762+0000","last_unstale":"2023-06-23T18:44:51.650785+0000","last_undegraded":"2023-06-23T18:44:51.650785+0000","last_fullsized":"2023-06-23T18:44:51.650785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:09:27.754720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655193+0000","last_change":"2023-06-23T18:44:45.577135+0000","last_active":"2023-06-23T18:44:51.655193+0000","last_peered":"2023-06-23T18:44:51.655193+0000","last_clean":"2023-06-23T18:44:51.655193+0000","last_became_active":"2023-06-23T18:44:45.576834+0000","last_became_peered":"2023-06-23T18:44:45.576834+0000","last_unstale":"2023-06-23T18:44:51.655193+0000","last_undegraded":"2023-06-23T18:44:51.655193+0000","last_fullsized":"2023-06-23T18:44:51.655193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:04:42.042988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650649+0000","last_change":"2023-06-23T18:44:50.244343+0000","last_active":"2023-06-23T18:44:51.650649+0000","last_peered":"2023-06-23T18:44:51.650649+0000","last_clean":"2023-06-23T18:44:51.650649+0000","last_became_active":"2023-06-23T18:44:50.244035+0000","last_became_peered":"2023-06-23T18:44:50.244035+0000","last_unstale":"2023-06-23T18:44:51.650649+0000","last_undegraded":"2023-06-23T18:44:51.650649+0000","last_fullsized":"2023-06-23T18:44:51.650649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:33:31.904138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404433+0000","last_change":"2023-06-23T18:44:50.658487+0000","last_active":"2023-06-23T18:44:52.404433+0000","last_peered":"2023-06-23T18:44:52.404433+0000","last_clean":"2023-06-23T18:44:52.404433+0000","last_became_active":"2023-06-23T18:44:50.656913+0000","last_became_peered":"2023-06-23T18:44:50.656913+0000","last_unstale":"2023-06-23T18:44:52.404433+0000","last_undegraded":"2023-06-23T18:44:52.404433+0000","last_fullsized":"2023-06-23T18:44:52.404433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:39:47.275362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655308+0000","last_change":"2023-06-23T18:44:45.192545+0000","last_active":"2023-06-23T18:44:51.655308+0000","last_peered":"2023-06-23T18:44:51.655308+0000","last_clean":"2023-06-23T18:44:51.655308+0000","last_became_active":"2023-06-23T18:44:45.192124+0000","last_became_peered":"2023-06-23T18:44:45.192124+0000","last_unstale":"2023-06-23T18:44:51.655308+0000","last_undegraded":"2023-06-23T18:44:51.655308+0000","last_fullsized":"2023-06-23T18:44:51.655308+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:57:40.392742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.649503+0000","last_change":"2023-06-23T18:44:50.245977+0000","last_active":"2023-06-23T18:44:50.649503+0000","last_peered":"2023-06-23T18:44:50.649503+0000","last_clean":"2023-06-23T18:44:50.649503+0000","last_became_active":"2023-06-23T18:44:50.245656+0000","last_became_peered":"2023-06-23T18:44:50.245656+0000","last_unstale":"2023-06-23T18:44:50.649503+0000","last_undegraded":"2023-06-23T18:44:50.649503+0000","last_fullsized":"2023-06-23T18:44:50.649503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:11:39.393019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650648+0000","last_change":"2023-06-23T18:44:50.662985+0000","last_active":"2023-06-23T18:44:51.650648+0000","last_peered":"2023-06-23T18:44:51.650648+0000","last_clean":"2023-06-23T18:44:51.650648+0000","last_became_active":"2023-06-23T18:44:50.659614+0000","last_became_peered":"2023-06-23T18:44:50.659614+0000","last_unstale":"2023-06-23T18:44:51.650648+0000","last_undegraded":"2023-06-23T18:44:51.650648+0000","last_fullsized":"2023-06-23T18:44:51.650648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:26:23.851192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404590+0000","last_change":"2023-06-23T18:44:50.246331+0000","last_active":"2023-06-23T18:44:52.404590+0000","last_peered":"2023-06-23T18:44:52.404590+0000","last_clean":"2023-06-23T18:44:52.404590+0000","last_became_active":"2023-06-23T18:44:50.244789+0000","last_became_peered":"2023-06-23T18:44:50.244789+0000","last_unstale":"2023-06-23T18:44:52.404590+0000","last_undegraded":"2023-06-23T18:44:52.404590+0000","last_fullsized":"2023-06-23T18:44:52.404590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:24:19.734731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.664759+0000","last_change":"2023-06-23T18:44:50.656054+0000","last_active":"2023-06-23T18:44:50.664759+0000","last_peered":"2023-06-23T18:44:50.664759+0000","last_clean":"2023-06-23T18:44:50.664759+0000","last_became_active":"2023-06-23T18:44:50.655781+0000","last_became_peered":"2023-06-23T18:44:50.655781+0000","last_unstale":"2023-06-23T18:44:50.664759+0000","last_undegraded":"2023-06-23T18:44:50.664759+0000","last_fullsized":"2023-06-23T18:44:50.664759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:25:05.609795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.655672+0000","last_change":"2023-06-23T18:44:50.242527+0000","last_active":"2023-06-23T18:44:50.655672+0000","last_peered":"2023-06-23T18:44:50.655672+0000","last_clean":"2023-06-23T18:44:50.655672+0000","last_became_active":"2023-06-23T18:44:50.242265+0000","last_became_peered":"2023-06-23T18:44:50.242265+0000","last_unstale":"2023-06-23T18:44:50.655672+0000","last_undegraded":"2023-06-23T18:44:50.655672+0000","last_fullsized":"2023-06-23T18:44:50.655672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:51:26.266885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.497890+0000","last_change":"2023-06-23T18:44:50.673258+0000","last_active":"2023-06-23T18:44:52.497890+0000","last_peered":"2023-06-23T18:44:52.497890+0000","last_clean":"2023-06-23T18:44:52.497890+0000","last_became_active":"2023-06-23T18:44:50.672993+0000","last_became_peered":"2023-06-23T18:44:50.672993+0000","last_unstale":"2023-06-23T18:44:52.497890+0000","last_undegraded":"2023-06-23T18:44:52.497890+0000","last_fullsized":"2023-06-23T18:44:52.497890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:30:37.852223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.660246+0000","last_change":"2023-06-23T18:44:50.239578+0000","last_active":"2023-06-23T18:44:50.660246+0000","last_peered":"2023-06-23T18:44:50.660246+0000","last_clean":"2023-06-23T18:44:50.660246+0000","last_became_active":"2023-06-23T18:44:50.239290+0000","last_became_peered":"2023-06-23T18:44:50.239290+0000","last_unstale":"2023-06-23T18:44:50.660246+0000","last_undegraded":"2023-06-23T18:44:50.660246+0000","last_fullsized":"2023-06-23T18:44:50.660246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:14:44.537297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498376+0000","last_change":"2023-06-23T18:44:50.672381+0000","last_active":"2023-06-23T18:44:52.498376+0000","last_peered":"2023-06-23T18:44:52.498376+0000","last_clean":"2023-06-23T18:44:52.498376+0000","last_became_active":"2023-06-23T18:44:50.672098+0000","last_became_peered":"2023-06-23T18:44:50.672098+0000","last_unstale":"2023-06-23T18:44:52.498376+0000","last_undegraded":"2023-06-23T18:44:52.498376+0000","last_fullsized":"2023-06-23T18:44:52.498376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:59:11.512811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.669720+0000","last_change":"2023-06-23T18:44:50.240690+0000","last_active":"2023-06-23T18:44:50.669720+0000","last_peered":"2023-06-23T18:44:50.669720+0000","last_clean":"2023-06-23T18:44:50.669720+0000","last_became_active":"2023-06-23T18:44:50.240111+0000","last_became_peered":"2023-06-23T18:44:50.240111+0000","last_unstale":"2023-06-23T18:44:50.669720+0000","last_undegraded":"2023-06-23T18:44:50.669720+0000","last_fullsized":"2023-06-23T18:44:50.669720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:30:47.540693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.675397+0000","last_change":"2023-06-23T18:44:50.667526+0000","last_active":"2023-06-23T18:44:50.675397+0000","last_peered":"2023-06-23T18:44:50.675397+0000","last_clean":"2023-06-23T18:44:50.675397+0000","last_became_active":"2023-06-23T18:44:50.667214+0000","last_became_peered":"2023-06-23T18:44:50.667214+0000","last_unstale":"2023-06-23T18:44:50.675397+0000","last_undegraded":"2023-06-23T18:44:50.675397+0000","last_fullsized":"2023-06-23T18:44:50.675397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:11:40.398049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404617+0000","last_change":"2023-06-23T18:44:50.244989+0000","last_active":"2023-06-23T18:44:52.404617+0000","last_peered":"2023-06-23T18:44:52.404617+0000","last_clean":"2023-06-23T18:44:52.404617+0000","last_became_active":"2023-06-23T18:44:50.241979+0000","last_became_peered":"2023-06-23T18:44:50.241979+0000","last_unstale":"2023-06-23T18:44:52.404617+0000","last_undegraded":"2023-06-23T18:44:52.404617+0000","last_fullsized":"2023-06-23T18:44:52.404617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:30:36.847193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.497733+0000","last_change":"2023-06-23T18:44:50.670305+0000","last_active":"2023-06-23T18:44:52.497733+0000","last_peered":"2023-06-23T18:44:52.497733+0000","last_clean":"2023-06-23T18:44:52.497733+0000","last_became_active":"2023-06-23T18:44:50.668141+0000","last_became_peered":"2023-06-23T18:44:50.668141+0000","last_unstale":"2023-06-23T18:44:52.497733+0000","last_undegraded":"2023-06-23T18:44:52.497733+0000","last_fullsized":"2023-06-23T18:44:52.497733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:11:35.546421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655061+0000","last_change":"2023-06-23T18:44:50.656461+0000","last_active":"2023-06-23T18:44:51.655061+0000","last_peered":"2023-06-23T18:44:51.655061+0000","last_clean":"2023-06-23T18:44:51.655061+0000","last_became_active":"2023-06-23T18:44:50.656193+0000","last_became_peered":"2023-06-23T18:44:50.656193+0000","last_unstale":"2023-06-23T18:44:51.655061+0000","last_undegraded":"2023-06-23T18:44:51.655061+0000","last_fullsized":"2023-06-23T18:44:51.655061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:46:59.173048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.675437+0000","last_change":"2023-06-23T18:44:50.668275+0000","last_active":"2023-06-23T18:44:50.675437+0000","last_peered":"2023-06-23T18:44:50.675437+0000","last_clean":"2023-06-23T18:44:50.675437+0000","last_became_active":"2023-06-23T18:44:50.667755+0000","last_became_peered":"2023-06-23T18:44:50.667755+0000","last_unstale":"2023-06-23T18:44:50.675437+0000","last_undegraded":"2023-06-23T18:44:50.675437+0000","last_fullsized":"2023-06-23T18:44:50.675437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:03:16.001494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.497838+0000","last_change":"2023-06-23T18:44:50.671148+0000","last_active":"2023-06-23T18:44:52.497838+0000","last_peered":"2023-06-23T18:44:52.497838+0000","last_clean":"2023-06-23T18:44:52.497838+0000","last_became_active":"2023-06-23T18:44:50.667939+0000","last_became_peered":"2023-06-23T18:44:50.667939+0000","last_unstale":"2023-06-23T18:44:52.497838+0000","last_undegraded":"2023-06-23T18:44:52.497838+0000","last_fullsized":"2023-06-23T18:44:52.497838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:27:54.238055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-06-23T18:44:50.676332+0000","last_change":"2023-06-23T18:44:50.675550+0000","last_active":"2023-06-23T18:44:50.676332+0000","last_peered":"2023-06-23T18:44:50.676332+0000","last_clean":"2023-06-23T18:44:50.676332+0000","last_became_active":"2023-06-23T18:44:50.674409+0000","last_became_peered":"2023-06-23T18:44:50.674409+0000","last_unstale":"2023-06-23T18:44:50.676332+0000","last_undegraded":"2023-06-23T18:44:50.676332+0000","last_fullsized":"2023-06-23T18:44:50.676332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:48:22.694731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650600+0000","last_change":"2023-06-23T18:44:50.672283+0000","last_active":"2023-06-23T18:44:51.650600+0000","last_peered":"2023-06-23T18:44:51.650600+0000","last_clean":"2023-06-23T18:44:51.650600+0000","last_became_active":"2023-06-23T18:44:50.672102+0000","last_became_peered":"2023-06-23T18:44:50.672102+0000","last_unstale":"2023-06-23T18:44:51.650600+0000","last_undegraded":"2023-06-23T18:44:51.650600+0000","last_fullsized":"2023-06-23T18:44:51.650600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:57:46.437032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":839680,"data_stored":671247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":79099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":669467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":79681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":200704,"data_stored":71485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":208896,"data_stored":72536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":80719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":73098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T18:44:55.208 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-23T18:44:55.209 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-06-23T18:44:55.209 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-06-23T18:44:55.209 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-06-23T18:44:55.210 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-06-23T18:44:55.330 INFO:tasks.ceph.mds.c.smithi052.stderr:2023-06-23T18:44:55.326+0000 7fdbf03c6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-23T18:44:55.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.364+0000 7f7cf0c72700 1 Processor -- start 2023-06-23T18:44:55.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.364+0000 7f7cf0c72700 1 -- start start 2023-06-23T18:44:55.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.365+0000 7f7cf0c72700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7cec1415b0 0x7f7cec06af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:55.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.365+0000 7f7cf0c72700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f7cec14f9f0 0x7f7cec151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:55.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.365+0000 7f7cf0c72700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cec071150 con 0x7f7cec1474c0 2023-06-23T18:44:55.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.365+0000 7f7cf0c72700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cec0719f0 con 0x7f7cec14f9f0 2023-06-23T18:44:55.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.365+0000 7f7cf0c72700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec0b4280 con 0x7f7cec1415b0 2023-06-23T18:44:55.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.365+0000 7f7ce3fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7cec1474c0 0x7f7cec147910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44712/0 (socket says 172.21.15.52:44712) 2023-06-23T18:44:55.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.365+0000 7f7ce3fff700 1 -- 172.21.15.52:0/399315204 learned_addr learned my addr 172.21.15.52:0/399315204 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:55.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.365+0000 7f7cead9d700 1 --2- 172.21.15.52:0/399315204 >> v2:172.21.15.52:3300/0 conn(0x7f7cec14f9f0 0x7f7cec151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:55.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.366+0000 7f7cea59c700 1 --2- 172.21.15.52:0/399315204 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7cec1415b0 0x7f7cec06af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:55.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.366+0000 7f7cead9d700 1 -- 172.21.15.52:0/399315204 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7cec1415b0 msgr2=0x7f7cec06af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:55.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.366+0000 7f7cead9d700 1 --2- 172.21.15.52:0/399315204 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7cec1415b0 0x7f7cec06af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:55.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.366+0000 7f7cead9d700 1 -- 172.21.15.52:0/399315204 >> v1:172.21.15.52:6789/0 conn(0x7f7cec1474c0 legacy=0x7f7cec147910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:55.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.366+0000 7f7ce9d9b700 1 -- 172.21.15.52:0/399315204 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762960013 0 0) 0x7f7cec071150 con 0x7f7cec1474c0 2023-06-23T18:44:55.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.366+0000 7f7cead9d700 1 -- 172.21.15.52:0/399315204 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cec0713a0 con 0x7f7cec14f9f0 2023-06-23T18:44:55.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.366+0000 7f7cea59c700 1 --2- 172.21.15.52:0/399315204 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7cec1415b0 0x7f7cec06af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:44:55.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.366+0000 7f7cead9d700 1 --2- 172.21.15.52:0/399315204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cec14f9f0 0x7f7cec151dd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4009d90 tx=0x7f7ce400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2b563b5baa2eee server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:55.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.366+0000 7f7ce9d9b700 1 -- 172.21.15.52:0/399315204 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce400e070 con 0x7f7cec14f9f0 2023-06-23T18:44:55.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.366+0000 7f7ce9d9b700 1 -- 172.21.15.52:0/399315204 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce400bbd0 con 0x7f7cec14f9f0 2023-06-23T18:44:55.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.366+0000 7f7ce9d9b700 1 -- 172.21.15.52:0/399315204 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4012430 con 0x7f7cec14f9f0 2023-06-23T18:44:55.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.367+0000 7f7cf0c72700 1 -- 172.21.15.52:0/399315204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cec14f9f0 msgr2=0x7f7cec151dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:55.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.367+0000 7f7cf0c72700 1 --2- 172.21.15.52:0/399315204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cec14f9f0 0x7f7cec151dd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4009d90 tx=0x7f7ce400b330 comp rx=0 tx=0).stop 2023-06-23T18:44:55.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.367+0000 7f7cf0c72700 1 -- 172.21.15.52:0/399315204 shutdown_connections 2023-06-23T18:44:55.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.367+0000 7f7cf0c72700 1 --2- 172.21.15.52:0/399315204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cec14f9f0 0x7f7cec151dd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:55.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.367+0000 7f7cf0c72700 1 --2- 172.21.15.52:0/399315204 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7cec1415b0 0x7f7cec06af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:55.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.367+0000 7f7cf0c72700 1 -- 172.21.15.52:0/399315204 >> 172.21.15.52:0/399315204 conn(0x7f7cec0bd690 msgr2=0x7f7cec0b9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:55.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.367+0000 7f7cf0c72700 1 -- 172.21.15.52:0/399315204 shutdown_connections 2023-06-23T18:44:55.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.367+0000 7f7cf0c72700 1 -- 172.21.15.52:0/399315204 wait complete. 2023-06-23T18:44:55.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.368+0000 7f7cf0c72700 1 Processor -- start 2023-06-23T18:44:55.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.368+0000 7f7cf0c72700 1 -- start start 2023-06-23T18:44:55.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.369+0000 7f7cf0c72700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7cec1415b0 0x7f7cec1dbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:55.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.369+0000 7f7cf0c72700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7cec1474c0 0x7f7cec0b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:55.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.369+0000 7f7cf0c72700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cec14f9f0 0x7f7cec135f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:55.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.369+0000 7f7cf0c72700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec142700 con 0x7f7cec14f9f0 2023-06-23T18:44:55.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.369+0000 7f7cf0c72700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec1dc160 con 0x7f7cec1415b0 2023-06-23T18:44:55.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.369+0000 7f7cf0c72700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec1df2a0 con 0x7f7cec1474c0 2023-06-23T18:44:55.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.369+0000 7f7cead9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cec14f9f0 0x7f7cec135f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:55.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.369+0000 7f7cead9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cec14f9f0 0x7f7cec135f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51788/0 (socket says 172.21.15.52:51788) 2023-06-23T18:44:55.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.369+0000 7f7cead9d700 1 -- 172.21.15.52:0/1017358831 learned_addr learned my addr 172.21.15.52:0/1017358831 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:55.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.369+0000 7f7ce3fff700 1 --2- 172.21.15.52:0/1017358831 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7cec1474c0 0x7f7cec0b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:55.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.369+0000 7f7cea59c700 1 --2- 172.21.15.52:0/1017358831 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7cec1415b0 0x7f7cec1dbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:55.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.369+0000 7f7cead9d700 1 -- 172.21.15.52:0/1017358831 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7cec1474c0 msgr2=0x7f7cec0b6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:55.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.369+0000 7f7cead9d700 1 --2- 172.21.15.52:0/1017358831 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7cec1474c0 0x7f7cec0b6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:55.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.369+0000 7f7cead9d700 1 -- 172.21.15.52:0/1017358831 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7cec1415b0 msgr2=0x7f7cec1dbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:55.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.369+0000 7f7cead9d700 1 --2- 172.21.15.52:0/1017358831 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7cec1415b0 0x7f7cec1dbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:55.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.369+0000 7f7cead9d700 1 -- 172.21.15.52:0/1017358831 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce4009a70 con 0x7f7cec14f9f0 2023-06-23T18:44:55.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.369+0000 7f7cead9d700 1 --2- 172.21.15.52:0/1017358831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cec14f9f0 0x7f7cec135f10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7ce400b730 tx=0x7f7ce4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:55.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.369+0000 7f7ce2ffd700 1 -- 172.21.15.52:0/1017358831 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4012430 con 0x7f7cec14f9f0 2023-06-23T18:44:55.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.369+0000 7f7ce2ffd700 1 -- 172.21.15.52:0/1017358831 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce4020070 con 0x7f7cec14f9f0 2023-06-23T18:44:55.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.369+0000 7f7cf0c72700 1 -- 172.21.15.52:0/1017358831 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cec1df580 con 0x7f7cec14f9f0 2023-06-23T18:44:55.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.369+0000 7f7ce2ffd700 1 -- 172.21.15.52:0/1017358831 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4004280 con 0x7f7cec14f9f0 2023-06-23T18:44:55.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.369+0000 7f7cf0c72700 1 -- 172.21.15.52:0/1017358831 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cec144920 con 0x7f7cec14f9f0 2023-06-23T18:44:55.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.370+0000 7f7ce0ff9700 1 -- 172.21.15.52:0/1017358831 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc40052e0 con 0x7f7cec14f9f0 2023-06-23T18:44:55.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.371+0000 7f7ce2ffd700 1 -- 172.21.15.52:0/1017358831 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7ce40043e0 con 0x7f7cec14f9f0 2023-06-23T18:44:55.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.371+0000 7f7ce2ffd700 1 --2- 172.21.15.52:0/1017358831 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7ccc06ad10 0x7f7ccc06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:55.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.371+0000 7f7ce2ffd700 1 -- 172.21.15.52:0/1017358831 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7ce4022070 con 0x7f7cec14f9f0 2023-06-23T18:44:55.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.371+0000 7f7cea59c700 1 --2- 172.21.15.52:0/1017358831 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7ccc06ad10 0x7f7ccc06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:55.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.372+0000 7f7cea59c700 1 --2- 172.21.15.52:0/1017358831 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7ccc06ad10 0x7f7ccc06d1c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc006f10 tx=0x7f7cdc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:55.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.376+0000 7f7ce2ffd700 1 -- 172.21.15.52:0/1017358831 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7ce4056770 con 0x7f7cec14f9f0 2023-06-23T18:44:55.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.636+0000 7f7ce0ff9700 1 -- 172.21.15.52:0/1017358831 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f7cc4005590 con 0x7f7cec14f9f0 2023-06-23T18:44:55.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.639+0000 7f7ce2ffd700 1 -- 172.21.15.52:0/1017358831 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170839 (secure 0 0 0) 0x7f7ce401a380 con 0x7f7cec14f9f0 2023-06-23T18:44:55.646 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:44:55.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.642+0000 7f7ce0ff9700 1 -- 172.21.15.52:0/1017358831 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7ccc06ad10 msgr2=0x7f7ccc06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:55.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.642+0000 7f7ce0ff9700 1 --2- 172.21.15.52:0/1017358831 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7ccc06ad10 0x7f7ccc06d1c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc006f10 tx=0x7f7cdc008040 comp rx=0 tx=0).stop 2023-06-23T18:44:55.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.642+0000 7f7ce0ff9700 1 -- 172.21.15.52:0/1017358831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cec14f9f0 msgr2=0x7f7cec135f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:55.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.642+0000 7f7ce0ff9700 1 --2- 172.21.15.52:0/1017358831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cec14f9f0 0x7f7cec135f10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7ce400b730 tx=0x7f7ce4004ad0 comp rx=0 tx=0).stop 2023-06-23T18:44:55.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.642+0000 7f7ce0ff9700 1 -- 172.21.15.52:0/1017358831 shutdown_connections 2023-06-23T18:44:55.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.642+0000 7f7ce0ff9700 1 --2- 172.21.15.52:0/1017358831 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7ccc06ad10 0x7f7ccc06d1c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:55.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.642+0000 7f7ce0ff9700 1 --2- 172.21.15.52:0/1017358831 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7cec14f9f0 0x7f7cec135f10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:55.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.642+0000 7f7ce0ff9700 1 --2- 172.21.15.52:0/1017358831 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7cec1415b0 0x7f7cec1dbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:55.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.642+0000 7f7ce0ff9700 1 --2- 172.21.15.52:0/1017358831 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7cec1474c0 0x7f7cec0b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:55.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.642+0000 7f7ce0ff9700 1 -- 172.21.15.52:0/1017358831 >> 172.21.15.52:0/1017358831 conn(0x7f7cec0bd690 msgr2=0x7f7cec136a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:55.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.642+0000 7f7ce0ff9700 1 -- 172.21.15.52:0/1017358831 shutdown_connections 2023-06-23T18:44:55.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.642+0000 7f7ce0ff9700 1 -- 172.21.15.52:0/1017358831 wait complete. 2023-06-23T18:44:55.658 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"active_gid":4106,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":397406548},{"type":"v1","addr":"172.21.15.89:6833","nonce":397406548}]},"active_addr":"172.21.15.89:6833/397406548","active_change":"2023-06-23T18:44:37.768570+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":1509672285}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":3318003465}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":1386837665}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":3238312754}]}]} 2023-06-23T18:44:55.663 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-06-23T18:44:55.663 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-06-23T18:44:55.664 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:44:55.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.785+0000 7f9b07a3b700 1 Processor -- start 2023-06-23T18:44:55.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.785+0000 7f9b07a3b700 1 -- start start 2023-06-23T18:44:55.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.786+0000 7f9b07a3b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b000b8c70 0x7f9b00148480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:55.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.786+0000 7f9b07a3b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9b001489c0 0x7f9b00152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:55.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.786+0000 7f9b07a3b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b000b53b0 con 0x7f9b001426a0 2023-06-23T18:44:55.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.786+0000 7f9b07a3b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b000b4750 con 0x7f9b001489c0 2023-06-23T18:44:55.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.786+0000 7f9b07a3b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b000722f0 con 0x7f9b000b8c70 2023-06-23T18:44:55.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.786+0000 7f9b04fd6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b000b8c70 0x7f9b00148480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:55.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.786+0000 7f9b05fd8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9b001489c0 0x7f9b00152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:55.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.786+0000 7f9b04fd6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b000b8c70 0x7f9b00148480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.52:48840/0 (socket says 172.21.15.52:48840) 2023-06-23T18:44:55.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.786+0000 7f9b04fd6700 1 -- 172.21.15.52:0/1735552534 learned_addr learned my addr 172.21.15.52:0/1735552534 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:55.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.787+0000 7f9b04fd6700 1 -- 172.21.15.52:0/1735552534 >> v2:172.21.15.89:3300/0 conn(0x7f9b001489c0 msgr2=0x7f9b00152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:55.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.787+0000 7f9b04fd6700 1 --2- 172.21.15.52:0/1735552534 >> v2:172.21.15.89:3300/0 conn(0x7f9b001489c0 0x7f9b00152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:55.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.787+0000 7f9b04fd6700 1 -- 172.21.15.52:0/1735552534 >> v1:172.21.15.89:6789/0 conn(0x7f9b001426a0 legacy=0x7f9b00071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:55.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.787+0000 7f9b04fd6700 1 -- 172.21.15.52:0/1735552534 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b00142a70 con 0x7f9b000b8c70 2023-06-23T18:44:55.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.787+0000 7f9b05fd8700 1 --2- 172.21.15.52:0/1735552534 >> v2:172.21.15.89:3300/0 conn(0x7f9b001489c0 0x7f9b00152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:55.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.787+0000 7f9b04fd6700 1 --2- 172.21.15.52:0/1735552534 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b000b8c70 0x7f9b00148480 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9af00098f0 tx=0x7f9af0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5a283330a1fbcd5 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:55.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.787+0000 7f9af7fff700 1 -- 172.21.15.52:0/1735552534 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af0011830 con 0x7f9b000b8c70 2023-06-23T18:44:55.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.787+0000 7f9af7fff700 1 -- 172.21.15.52:0/1735552534 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af0011990 con 0x7f9b000b8c70 2023-06-23T18:44:55.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.787+0000 7f9af7fff700 1 -- 172.21.15.52:0/1735552534 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af0011d20 con 0x7f9b000b8c70 2023-06-23T18:44:55.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.788+0000 7f9b07a3b700 1 -- 172.21.15.52:0/1735552534 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b000b8c70 msgr2=0x7f9b00148480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:55.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.788+0000 7f9b07a3b700 1 --2- 172.21.15.52:0/1735552534 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b000b8c70 0x7f9b00148480 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9af00098f0 tx=0x7f9af0009c00 comp rx=0 tx=0).stop 2023-06-23T18:44:55.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.788+0000 7f9b07a3b700 1 -- 172.21.15.52:0/1735552534 shutdown_connections 2023-06-23T18:44:55.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.788+0000 7f9b07a3b700 1 --2- 172.21.15.52:0/1735552534 >> v2:172.21.15.89:3300/0 conn(0x7f9b001489c0 0x7f9b00152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:55.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.788+0000 7f9b07a3b700 1 --2- 172.21.15.52:0/1735552534 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b000b8c70 0x7f9b00148480 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:55.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.788+0000 7f9b07a3b700 1 -- 172.21.15.52:0/1735552534 >> 172.21.15.52:0/1735552534 conn(0x7f9b000bd690 msgr2=0x7f9b000b9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:55.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.788+0000 7f9b07a3b700 1 -- 172.21.15.52:0/1735552534 shutdown_connections 2023-06-23T18:44:55.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.788+0000 7f9b07a3b700 1 -- 172.21.15.52:0/1735552534 wait complete. 2023-06-23T18:44:55.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.789+0000 7f9b07a3b700 1 Processor -- start 2023-06-23T18:44:55.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.789+0000 7f9b07a3b700 1 -- start start 2023-06-23T18:44:55.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.790+0000 7f9b07a3b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b000b8c70 0x7f9b0013e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:55.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.790+0000 7f9b07a3b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b001426a0 0x7f9b0013d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:55.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.790+0000 7f9b07a3b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b001489c0 0x7f9b001e38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:55.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.790+0000 7f9b07a3b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0013d830 con 0x7f9b001426a0 2023-06-23T18:44:55.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.790+0000 7f9b07a3b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b001dfce0 con 0x7f9b000b8c70 2023-06-23T18:44:55.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.790+0000 7f9b07a3b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b00145d50 con 0x7f9b001489c0 2023-06-23T18:44:55.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.790+0000 7f9b04fd6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b001426a0 0x7f9b0013d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:55.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.790+0000 7f9b04fd6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b001426a0 0x7f9b0013d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51794/0 (socket says 172.21.15.52:51794) 2023-06-23T18:44:55.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.790+0000 7f9b04fd6700 1 -- 172.21.15.52:0/2947765759 learned_addr learned my addr 172.21.15.52:0/2947765759 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:55.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.790+0000 7f9b05fd8700 1 --2- 172.21.15.52:0/2947765759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b001489c0 0x7f9b001e38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:55.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.790+0000 7f9b057d7700 1 --2- 172.21.15.52:0/2947765759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b000b8c70 0x7f9b0013e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:55.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.791+0000 7f9b04fd6700 1 -- 172.21.15.52:0/2947765759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b001489c0 msgr2=0x7f9b001e38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:55.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.791+0000 7f9b04fd6700 1 --2- 172.21.15.52:0/2947765759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b001489c0 0x7f9b001e38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:55.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.791+0000 7f9b04fd6700 1 -- 172.21.15.52:0/2947765759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b000b8c70 msgr2=0x7f9b0013e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:55.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.791+0000 7f9b04fd6700 1 --2- 172.21.15.52:0/2947765759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b000b8c70 0x7f9b0013e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:55.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.791+0000 7f9b04fd6700 1 -- 172.21.15.52:0/2947765759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af8009a70 con 0x7f9b001426a0 2023-06-23T18:44:55.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.791+0000 7f9b04fd6700 1 --2- 172.21.15.52:0/2947765759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b001426a0 0x7f9b0013d2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9af0009c40 tx=0x7f9af0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:55.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.791+0000 7f9af5ffb700 1 -- 172.21.15.52:0/2947765759 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af00045d0 con 0x7f9b001426a0 2023-06-23T18:44:55.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.791+0000 7f9af5ffb700 1 -- 172.21.15.52:0/2947765759 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af001f070 con 0x7f9b001426a0 2023-06-23T18:44:55.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.791+0000 7f9b07a3b700 1 -- 172.21.15.52:0/2947765759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af0009550 con 0x7f9b001426a0 2023-06-23T18:44:55.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.791+0000 7f9af5ffb700 1 -- 172.21.15.52:0/2947765759 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af00038c0 con 0x7f9b001426a0 2023-06-23T18:44:55.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.791+0000 7f9b07a3b700 1 -- 172.21.15.52:0/2947765759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b00145a70 con 0x7f9b001426a0 2023-06-23T18:44:55.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.792+0000 7f9b07a3b700 1 -- 172.21.15.52:0/2947765759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b001e36f0 con 0x7f9b001426a0 2023-06-23T18:44:55.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.793+0000 7f9af5ffb700 1 -- 172.21.15.52:0/2947765759 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9af0003a20 con 0x7f9b001426a0 2023-06-23T18:44:55.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.793+0000 7f9af5ffb700 1 --2- 172.21.15.52:0/2947765759 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9ae406ace0 0x7f9ae406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:55.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.793+0000 7f9af5ffb700 1 -- 172.21.15.52:0/2947765759 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9af0021070 con 0x7f9b001426a0 2023-06-23T18:44:55.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.793+0000 7f9b057d7700 1 --2- 172.21.15.52:0/2947765759 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9ae406ace0 0x7f9ae406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:55.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.794+0000 7f9b057d7700 1 --2- 172.21.15.52:0/2947765759 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9ae406ace0 0x7f9ae406d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9afc007fd0 tx=0x7f9afc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:55.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.798+0000 7f9af5ffb700 1 -- 172.21.15.52:0/2947765759 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9af0055d50 con 0x7f9b001426a0 2023-06-23T18:44:55.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.995+0000 7f9b07a3b700 1 -- 172.21.15.52:0/2947765759 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b0004e1d0 con 0x7f9b001426a0 2023-06-23T18:44:56.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.996+0000 7f9af5ffb700 1 -- 172.21.15.52:0/2947765759 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7f9af0015090 con 0x7f9b001426a0 2023-06-23T18:44:56.001 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:44:56.001 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","created":"2023-06-23T18:44:31.918434+0000","modified":"2023-06-23T18:44:51.644330+0000","last_up_change":"2023-06-23T18:44:42.169624+0000","last_in_change":"2023-06-23T18:44:34.510501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-23T18:44:43.346578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-23T18:44:43.829719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:44:48.517897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:44:49.621134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c371fb28-1b15-4e43-8d5a-43e402920ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6812","nonce":1066999520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6815","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6818","nonce":1066999520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6829","nonce":1066999520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6823","nonce":1066999520}]},"public_addr":"172.21.15.52:6812/1066999520","cluster_addr":"172.21.15.52:6818/1066999520","heartbeat_back_addr":"172.21.15.52:6829/1066999520","heartbeat_front_addr":"172.21.15.52:6823/1066999520","state":["exists","up"]},{"osd":1,"uuid":"4a142f04-33eb-47ec-9cc5-b08b44d82658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6813","nonce":2360219751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6819","nonce":2360219751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6830","nonce":2360219751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6825","nonce":2360219751}]},"public_addr":"172.21.15.52:6813/2360219751","cluster_addr":"172.21.15.52:6819/2360219751","heartbeat_back_addr":"172.21.15.52:6830/2360219751","heartbeat_front_addr":"172.21.15.52:6825/2360219751","state":["exists","up"]},{"osd":2,"uuid":"d7bb089d-4c55-4370-ba59-7fe88c39512a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6801","nonce":835073005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6803","nonce":835073005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6807","nonce":835073005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6805","nonce":835073005}]},"public_addr":"172.21.15.52:6801/835073005","cluster_addr":"172.21.15.52:6803/835073005","heartbeat_back_addr":"172.21.15.52:6807/835073005","heartbeat_front_addr":"172.21.15.52:6805/835073005","state":["exists","up"]},{"osd":3,"uuid":"4bcdcdc3-6a8f-468e-877e-57f76079ac3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6811","nonce":2852700864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6817","nonce":2852700864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6831","nonce":2852700864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6824","nonce":2852700864}]},"public_addr":"172.21.15.52:6811/2852700864","cluster_addr":"172.21.15.52:6817/2852700864","heartbeat_back_addr":"172.21.15.52:6831/2852700864","heartbeat_front_addr":"172.21.15.52:6824/2852700864","state":["exists","up"]},{"osd":4,"uuid":"cac63000-ae94-4b08-93e6-a99119640b63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6809","nonce":2538664679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6811","nonce":2538664679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6815","nonce":2538664679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6813","nonce":2538664679}]},"public_addr":"172.21.15.89:6809/2538664679","cluster_addr":"172.21.15.89:6811/2538664679","heartbeat_back_addr":"172.21.15.89:6815/2538664679","heartbeat_front_addr":"172.21.15.89:6813/2538664679","state":["exists","up"]},{"osd":5,"uuid":"45c53102-18a6-4fd7-9c25-8ea5e1ef6851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6801","nonce":1683710352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6803","nonce":1683710352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6807","nonce":1683710352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6805","nonce":1683710352}]},"public_addr":"172.21.15.89:6801/1683710352","cluster_addr":"172.21.15.89:6803/1683710352","heartbeat_back_addr":"172.21.15.89:6807/1683710352","heartbeat_front_addr":"172.21.15.89:6805/1683710352","state":["exists","up"]},{"osd":6,"uuid":"abee09d1-8eba-484f-a25c-871c1fe2e843","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6817","nonce":3890899288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6819","nonce":3890899288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6823","nonce":3890899288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6821","nonce":3890899288}]},"public_addr":"172.21.15.89:6817/3890899288","cluster_addr":"172.21.15.89:6819/3890899288","heartbeat_back_addr":"172.21.15.89:6823/3890899288","heartbeat_front_addr":"172.21.15.89:6821/3890899288","state":["exists","up"]},{"osd":7,"uuid":"5acf9e2e-00dd-4f9b-a7d9-3d820f695de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6825","nonce":2989085420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6827","nonce":2989085420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6831","nonce":2989085420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6829","nonce":2989085420}]},"public_addr":"172.21.15.89:6825/2989085420","cluster_addr":"172.21.15.89:6827/2989085420","heartbeat_back_addr":"172.21.15.89:6831/2989085420","heartbeat_front_addr":"172.21.15.89:6829/2989085420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.663866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.710904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.619347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.660102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.686933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.724635+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.669111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.678740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:44:56.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.998+0000 7f9b07a3b700 1 -- 172.21.15.52:0/2947765759 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9ae406ace0 msgr2=0x7f9ae406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.998+0000 7f9b07a3b700 1 --2- 172.21.15.52:0/2947765759 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9ae406ace0 0x7f9ae406d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9afc007fd0 tx=0x7f9afc009040 comp rx=0 tx=0).stop 2023-06-23T18:44:56.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.998+0000 7f9b07a3b700 1 -- 172.21.15.52:0/2947765759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b001426a0 msgr2=0x7f9b0013d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.998+0000 7f9b07a3b700 1 --2- 172.21.15.52:0/2947765759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b001426a0 0x7f9b0013d2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9af0009c40 tx=0x7f9af0004750 comp rx=0 tx=0).stop 2023-06-23T18:44:56.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.998+0000 7f9b07a3b700 1 -- 172.21.15.52:0/2947765759 shutdown_connections 2023-06-23T18:44:56.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.998+0000 7f9b07a3b700 1 --2- 172.21.15.52:0/2947765759 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9ae406ace0 0x7f9ae406d190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.998+0000 7f9b07a3b700 1 --2- 172.21.15.52:0/2947765759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9b001489c0 0x7f9b001e38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.998+0000 7f9b07a3b700 1 --2- 172.21.15.52:0/2947765759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9b000b8c70 0x7f9b0013e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.998+0000 7f9b07a3b700 1 --2- 172.21.15.52:0/2947765759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b001426a0 0x7f9b0013d2f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.998+0000 7f9b07a3b700 1 -- 172.21.15.52:0/2947765759 >> 172.21.15.52:0/2947765759 conn(0x7f9b000bd690 msgr2=0x7f9b000b5860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:56.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.998+0000 7f9b07a3b700 1 -- 172.21.15.52:0/2947765759 shutdown_connections 2023-06-23T18:44:56.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:55.998+0000 7f9b07a3b700 1 -- 172.21.15.52:0/2947765759 wait complete. 2023-06-23T18:44:56.015 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-06-23T18:44:56.015 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:44:56.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.136+0000 7fe4d5d87700 1 Processor -- start 2023-06-23T18:44:56.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.136+0000 7fe4d5d87700 1 -- start start 2023-06-23T18:44:56.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.137+0000 7fe4d5d87700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe4d006a0d0 0x7fe4d00bc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.137+0000 7fe4d5d87700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4d01444a0 0x7fe4d00b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.137+0000 7fe4d5d87700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d00b7aa0 con 0x7fe4d00b5a20 2023-06-23T18:44:56.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.137+0000 7fe4d5d87700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4d00b5f30 con 0x7fe4d006a0d0 2023-06-23T18:44:56.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.137+0000 7fe4d5d87700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d00b6210 con 0x7fe4d01444a0 2023-06-23T18:44:56.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.137+0000 7fe4cf7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe4d006a0d0 0x7fe4d00bc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.137+0000 7fe4cffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe4d00b5a20 0x7fe4d00bb020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44722/0 (socket says 172.21.15.52:44722) 2023-06-23T18:44:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.137+0000 7fe4cffff700 1 -- 172.21.15.52:0/1660270838 learned_addr learned my addr 172.21.15.52:0/1660270838 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.137+0000 7fe4ceffd700 1 --2- 172.21.15.52:0/1660270838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4d01444a0 0x7fe4d00b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.137+0000 7fe4cf7fe700 1 -- 172.21.15.52:0/1660270838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4d01444a0 msgr2=0x7fe4d00b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.137+0000 7fe4cf7fe700 1 --2- 172.21.15.52:0/1660270838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4d01444a0 0x7fe4d00b54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.137+0000 7fe4cf7fe700 1 -- 172.21.15.52:0/1660270838 >> v1:172.21.15.52:6789/0 conn(0x7fe4d00b5a20 legacy=0x7fe4d00bb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.137+0000 7fe4cf7fe700 1 -- 172.21.15.52:0/1660270838 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d00b64f0 con 0x7fe4d006a0d0 2023-06-23T18:44:56.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.137+0000 7fe4ce7fc700 1 -- 172.21.15.52:0/1660270838 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965356804 0 0) 0x7fe4d00b7aa0 con 0x7fe4d00b5a20 2023-06-23T18:44:56.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.137+0000 7fe4cf7fe700 1 --2- 172.21.15.52:0/1660270838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4d006a0d0 0x7fe4d00bc8b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0009840 tx=0x7fe4c0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=138ab95522f06744 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.137+0000 7fe4ce7fc700 1 -- 172.21.15.52:0/1660270838 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0011830 con 0x7fe4d006a0d0 2023-06-23T18:44:56.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.137+0000 7fe4ce7fc700 1 -- 172.21.15.52:0/1660270838 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c0011990 con 0x7fe4d006a0d0 2023-06-23T18:44:56.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.138+0000 7fe4ce7fc700 1 -- 172.21.15.52:0/1660270838 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0011d20 con 0x7fe4d006a0d0 2023-06-23T18:44:56.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.138+0000 7fe4d5d87700 1 -- 172.21.15.52:0/1660270838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4d006a0d0 msgr2=0x7fe4d00bc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.138+0000 7fe4d5d87700 1 --2- 172.21.15.52:0/1660270838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4d006a0d0 0x7fe4d00bc8b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0009840 tx=0x7fe4c0009b50 comp rx=0 tx=0).stop 2023-06-23T18:44:56.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.138+0000 7fe4d5d87700 1 -- 172.21.15.52:0/1660270838 shutdown_connections 2023-06-23T18:44:56.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.138+0000 7fe4d5d87700 1 --2- 172.21.15.52:0/1660270838 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4d006a0d0 0x7fe4d00bc8b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.138+0000 7fe4d5d87700 1 --2- 172.21.15.52:0/1660270838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4d01444a0 0x7fe4d00b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.138+0000 7fe4d5d87700 1 -- 172.21.15.52:0/1660270838 >> 172.21.15.52:0/1660270838 conn(0x7fe4d006bb90 msgr2=0x7fe4d006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:56.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.138+0000 7fe4d5d87700 1 -- 172.21.15.52:0/1660270838 shutdown_connections 2023-06-23T18:44:56.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.138+0000 7fe4d5d87700 1 -- 172.21.15.52:0/1660270838 wait complete. 2023-06-23T18:44:56.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.139+0000 7fe4d5d87700 1 Processor -- start 2023-06-23T18:44:56.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.139+0000 7fe4d5d87700 1 -- start start 2023-06-23T18:44:56.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.140+0000 7fe4d5d87700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4d006a0d0 0x7fe4d013cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.140+0000 7fe4d5d87700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4d00b5a20 0x7fe4d01e32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.140+0000 7fe4d5d87700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4d01444a0 0x7fe4d013b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.140+0000 7fe4d5d87700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d013cda0 con 0x7fe4d00b5a20 2023-06-23T18:44:56.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.140+0000 7fe4d5d87700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d00b85b0 con 0x7fe4d006a0d0 2023-06-23T18:44:56.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.140+0000 7fe4d5d87700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d013d4c0 con 0x7fe4d01444a0 2023-06-23T18:44:56.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.140+0000 7fe4ceffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4d00b5a20 0x7fe4d01e32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.140+0000 7fe4ceffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4d00b5a20 0x7fe4d01e32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51810/0 (socket says 172.21.15.52:51810) 2023-06-23T18:44:56.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.140+0000 7fe4ceffd700 1 -- 172.21.15.52:0/4079216720 learned_addr learned my addr 172.21.15.52:0/4079216720 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:56.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.140+0000 7fe4cffff700 1 --2- 172.21.15.52:0/4079216720 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4d01444a0 0x7fe4d013b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.140+0000 7fe4cf7fe700 1 --2- 172.21.15.52:0/4079216720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4d006a0d0 0x7fe4d013cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.140+0000 7fe4ceffd700 1 -- 172.21.15.52:0/4079216720 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4d01444a0 msgr2=0x7fe4d013b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.140+0000 7fe4ceffd700 1 --2- 172.21.15.52:0/4079216720 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4d01444a0 0x7fe4d013b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.140+0000 7fe4ceffd700 1 -- 172.21.15.52:0/4079216720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4d006a0d0 msgr2=0x7fe4d013cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.140+0000 7fe4ceffd700 1 --2- 172.21.15.52:0/4079216720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4d006a0d0 0x7fe4d013cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.140+0000 7fe4ceffd700 1 -- 172.21.15.52:0/4079216720 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c00094a0 con 0x7fe4d00b5a20 2023-06-23T18:44:56.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.140+0000 7fe4cf7fe700 1 --2- 172.21.15.52:0/4079216720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4d006a0d0 0x7fe4d013cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:44:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.140+0000 7fe4cffff700 1 --2- 172.21.15.52:0/4079216720 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4d01444a0 0x7fe4d013b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:44:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.141+0000 7fe4ceffd700 1 --2- 172.21.15.52:0/4079216720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4d00b5a20 0x7fe4d01e32f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800d800 tx=0x7fe4b800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.141+0000 7fe4c7fff700 1 -- 172.21.15.52:0/4079216720 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b80125f0 con 0x7fe4d00b5a20 2023-06-23T18:44:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.141+0000 7fe4c7fff700 1 -- 172.21.15.52:0/4079216720 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b8012750 con 0x7fe4d00b5a20 2023-06-23T18:44:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.141+0000 7fe4d5d87700 1 -- 172.21.15.52:0/4079216720 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d0147c00 con 0x7fe4d00b5a20 2023-06-23T18:44:56.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.141+0000 7fe4c7fff700 1 -- 172.21.15.52:0/4079216720 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8012b00 con 0x7fe4d00b5a20 2023-06-23T18:44:56.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.141+0000 7fe4d5d87700 1 -- 172.21.15.52:0/4079216720 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d006c280 con 0x7fe4d00b5a20 2023-06-23T18:44:56.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.142+0000 7fe4d5d87700 1 -- 172.21.15.52:0/4079216720 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d004e1d0 con 0x7fe4d00b5a20 2023-06-23T18:44:56.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.142+0000 7fe4c7fff700 1 -- 172.21.15.52:0/4079216720 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe4b8012c60 con 0x7fe4d00b5a20 2023-06-23T18:44:56.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.143+0000 7fe4c7fff700 1 --2- 172.21.15.52:0/4079216720 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe4b006ace0 0x7fe4b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.143+0000 7fe4c7fff700 1 -- 172.21.15.52:0/4079216720 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe4b8089840 con 0x7fe4d00b5a20 2023-06-23T18:44:56.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.143+0000 7fe4cf7fe700 1 --2- 172.21.15.52:0/4079216720 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe4b006ace0 0x7fe4b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.143+0000 7fe4cf7fe700 1 --2- 172.21.15.52:0/4079216720 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe4b006ace0 0x7fe4b006d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00090b0 tx=0x7fe4c0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.147+0000 7fe4c7fff700 1 -- 172.21.15.52:0/4079216720 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe4b80548f0 con 0x7fe4d00b5a20 2023-06-23T18:44:56.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.346+0000 7fe4d5d87700 1 -- 172.21.15.52:0/4079216720 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4d00b6870 con 0x7fe4d00b5a20 2023-06-23T18:44:56.352 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.348+0000 7fe4c7fff700 1 -- 172.21.15.52:0/4079216720 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7fe4b8057f10 con 0x7fe4d00b5a20 2023-06-23T18:44:56.353 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:44:56.353 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","created":"2023-06-23T18:44:31.918434+0000","modified":"2023-06-23T18:44:51.644330+0000","last_up_change":"2023-06-23T18:44:42.169624+0000","last_in_change":"2023-06-23T18:44:34.510501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-23T18:44:43.346578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-23T18:44:43.829719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:44:48.517897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:44:49.621134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c371fb28-1b15-4e43-8d5a-43e402920ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6812","nonce":1066999520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6815","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6818","nonce":1066999520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6829","nonce":1066999520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6823","nonce":1066999520}]},"public_addr":"172.21.15.52:6812/1066999520","cluster_addr":"172.21.15.52:6818/1066999520","heartbeat_back_addr":"172.21.15.52:6829/1066999520","heartbeat_front_addr":"172.21.15.52:6823/1066999520","state":["exists","up"]},{"osd":1,"uuid":"4a142f04-33eb-47ec-9cc5-b08b44d82658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6813","nonce":2360219751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6819","nonce":2360219751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6830","nonce":2360219751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6825","nonce":2360219751}]},"public_addr":"172.21.15.52:6813/2360219751","cluster_addr":"172.21.15.52:6819/2360219751","heartbeat_back_addr":"172.21.15.52:6830/2360219751","heartbeat_front_addr":"172.21.15.52:6825/2360219751","state":["exists","up"]},{"osd":2,"uuid":"d7bb089d-4c55-4370-ba59-7fe88c39512a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6801","nonce":835073005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6803","nonce":835073005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6807","nonce":835073005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6805","nonce":835073005}]},"public_addr":"172.21.15.52:6801/835073005","cluster_addr":"172.21.15.52:6803/835073005","heartbeat_back_addr":"172.21.15.52:6807/835073005","heartbeat_front_addr":"172.21.15.52:6805/835073005","state":["exists","up"]},{"osd":3,"uuid":"4bcdcdc3-6a8f-468e-877e-57f76079ac3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6811","nonce":2852700864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6817","nonce":2852700864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6831","nonce":2852700864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6824","nonce":2852700864}]},"public_addr":"172.21.15.52:6811/2852700864","cluster_addr":"172.21.15.52:6817/2852700864","heartbeat_back_addr":"172.21.15.52:6831/2852700864","heartbeat_front_addr":"172.21.15.52:6824/2852700864","state":["exists","up"]},{"osd":4,"uuid":"cac63000-ae94-4b08-93e6-a99119640b63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6809","nonce":2538664679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6811","nonce":2538664679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6815","nonce":2538664679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6813","nonce":2538664679}]},"public_addr":"172.21.15.89:6809/2538664679","cluster_addr":"172.21.15.89:6811/2538664679","heartbeat_back_addr":"172.21.15.89:6815/2538664679","heartbeat_front_addr":"172.21.15.89:6813/2538664679","state":["exists","up"]},{"osd":5,"uuid":"45c53102-18a6-4fd7-9c25-8ea5e1ef6851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6801","nonce":1683710352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6803","nonce":1683710352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6807","nonce":1683710352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6805","nonce":1683710352}]},"public_addr":"172.21.15.89:6801/1683710352","cluster_addr":"172.21.15.89:6803/1683710352","heartbeat_back_addr":"172.21.15.89:6807/1683710352","heartbeat_front_addr":"172.21.15.89:6805/1683710352","state":["exists","up"]},{"osd":6,"uuid":"abee09d1-8eba-484f-a25c-871c1fe2e843","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6817","nonce":3890899288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6819","nonce":3890899288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6823","nonce":3890899288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6821","nonce":3890899288}]},"public_addr":"172.21.15.89:6817/3890899288","cluster_addr":"172.21.15.89:6819/3890899288","heartbeat_back_addr":"172.21.15.89:6823/3890899288","heartbeat_front_addr":"172.21.15.89:6821/3890899288","state":["exists","up"]},{"osd":7,"uuid":"5acf9e2e-00dd-4f9b-a7d9-3d820f695de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6825","nonce":2989085420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6827","nonce":2989085420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6831","nonce":2989085420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6829","nonce":2989085420}]},"public_addr":"172.21.15.89:6825/2989085420","cluster_addr":"172.21.15.89:6827/2989085420","heartbeat_back_addr":"172.21.15.89:6831/2989085420","heartbeat_front_addr":"172.21.15.89:6829/2989085420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.663866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.710904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.619347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.660102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.686933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.724635+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.669111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.678740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:44:56.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.350+0000 7fe4d5d87700 1 -- 172.21.15.52:0/4079216720 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe4b006ace0 msgr2=0x7fe4b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.350+0000 7fe4d5d87700 1 --2- 172.21.15.52:0/4079216720 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe4b006ace0 0x7fe4b006d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00090b0 tx=0x7fe4c0008030 comp rx=0 tx=0).stop 2023-06-23T18:44:56.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.350+0000 7fe4d5d87700 1 -- 172.21.15.52:0/4079216720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4d00b5a20 msgr2=0x7fe4d01e32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.350+0000 7fe4d5d87700 1 --2- 172.21.15.52:0/4079216720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4d00b5a20 0x7fe4d01e32f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800d800 tx=0x7fe4b800dbc0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.350+0000 7fe4d5d87700 1 -- 172.21.15.52:0/4079216720 shutdown_connections 2023-06-23T18:44:56.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.350+0000 7fe4d5d87700 1 --2- 172.21.15.52:0/4079216720 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe4b006ace0 0x7fe4b006d190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.350+0000 7fe4d5d87700 1 --2- 172.21.15.52:0/4079216720 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4d01444a0 0x7fe4d013b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.350+0000 7fe4d5d87700 1 --2- 172.21.15.52:0/4079216720 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4d006a0d0 0x7fe4d013cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.350+0000 7fe4d5d87700 1 --2- 172.21.15.52:0/4079216720 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe4d00b5a20 0x7fe4d01e32f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.350+0000 7fe4d5d87700 1 -- 172.21.15.52:0/4079216720 >> 172.21.15.52:0/4079216720 conn(0x7fe4d006bb90 msgr2=0x7fe4d00bed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:56.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.350+0000 7fe4d5d87700 1 -- 172.21.15.52:0/4079216720 shutdown_connections 2023-06-23T18:44:56.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.350+0000 7fe4d5d87700 1 -- 172.21.15.52:0/4079216720 wait complete. 2023-06-23T18:44:56.367 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-06-23T18:44:56.368 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-06-23T18:44:56.368 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-06-23T18:44:56.369 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-06-23T18:44:56.369 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-06-23T18:44:56.370 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-06-23T18:44:56.370 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-06-23T18:44:56.370 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-06-23T18:44:56.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.574+0000 7fe96b6e9700 1 Processor -- start 2023-06-23T18:44:56.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.575+0000 7fe96b6e9700 1 -- start start 2023-06-23T18:44:56.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.576+0000 7fe96b6e9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe964071a80 0x7fe96406f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.576+0000 7fe96b6e9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe964143f60 con 0x7fe964143b90 2023-06-23T18:44:56.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.576+0000 7fe96b6e9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9640716f0 con 0x7fe96406fe70 2023-06-23T18:44:56.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.576+0000 7fe96b6e9700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe964071f60 con 0x7fe964071a80 2023-06-23T18:44:56.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.579+0000 7fe969c86700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fe96406fe70 0x7fe964150d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.52:53320/0 (socket says 172.21.15.52:53320) 2023-06-23T18:44:56.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.579+0000 7fe969c86700 1 -- 172.21.15.52:0/3664609102 learned_addr learned my addr 172.21.15.52:0/3664609102 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:56.588 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.579+0000 7fe95bfff700 1 -- 172.21.15.52:0/3664609102 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2873686431 0 0) 0x7fe9640716f0 con 0x7fe96406fe70 2023-06-23T18:44:56.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.579+0000 7fe95bfff700 1 -- 172.21.15.52:0/3664609102 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9500046c0 con 0x7fe96406fe70 2023-06-23T18:44:56.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.580+0000 7fe968c84700 1 --2- 172.21.15.52:0/3664609102 >> v2:172.21.15.89:3300/0 conn(0x7fe964071a80 0x7fe96406f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.580+0000 7fe968c84700 1 -- 172.21.15.52:0/3664609102 >> v1:172.21.15.89:6789/0 conn(0x7fe96406fe70 legacy=0x7fe964150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.580+0000 7fe968c84700 1 -- 172.21.15.52:0/3664609102 >> v1:172.21.15.52:6789/0 conn(0x7fe964143b90 legacy=0x7fe9641464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:56.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.580+0000 7fe968c84700 1 -- 172.21.15.52:0/3664609102 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96406f4a0 con 0x7fe964071a80 2023-06-23T18:44:56.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.581+0000 7fe968c84700 1 --2- 172.21.15.52:0/3664609102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe964071a80 0x7fe96406f930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe960009840 tx=0x7fe960009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf0fc4a8ec34b8bc server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.581+0000 7fe95bfff700 1 -- 172.21.15.52:0/3664609102 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe960004230 con 0x7fe964071a80 2023-06-23T18:44:56.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.581+0000 7fe95bfff700 1 -- 172.21.15.52:0/3664609102 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe960004390 con 0x7fe964071a80 2023-06-23T18:44:56.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.581+0000 7fe95bfff700 1 -- 172.21.15.52:0/3664609102 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9600036c0 con 0x7fe964071a80 2023-06-23T18:44:56.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.583+0000 7fe96b6e9700 1 -- 172.21.15.52:0/3664609102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe964071a80 msgr2=0x7fe96406f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.583+0000 7fe96b6e9700 1 --2- 172.21.15.52:0/3664609102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe964071a80 0x7fe96406f930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe960009840 tx=0x7fe960009b50 comp rx=0 tx=0).stop 2023-06-23T18:44:56.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.584+0000 7f0d815de700 1 Processor -- start 2023-06-23T18:44:56.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.584+0000 7f0d815de700 1 -- start start 2023-06-23T18:44:56.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.586+0000 7fe96b6e9700 1 -- 172.21.15.52:0/3664609102 shutdown_connections 2023-06-23T18:44:56.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.586+0000 7fe96b6e9700 1 --2- 172.21.15.52:0/3664609102 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe964071a80 0x7fe96406f930 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.586+0000 7fe96b6e9700 1 -- 172.21.15.52:0/3664609102 >> 172.21.15.52:0/3664609102 conn(0x7fe9640bc170 msgr2=0x7fe9640bc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:56.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.585+0000 7f0d815de700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0d7c0b6af0 0x7f0d7c1484c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.585+0000 7f0d815de700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0d7c0b3570 0x7f0d7c148a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.585+0000 7f0d815de700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d7c0b8230 con 0x7f0d7c0714c0 2023-06-23T18:44:56.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.585+0000 7f0d815de700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d7c0b4910 con 0x7f0d7c0b6af0 2023-06-23T18:44:56.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.585+0000 7f0d815de700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d7c0b3c20 con 0x7f0d7c0b3570 2023-06-23T18:44:56.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.585+0000 7f0d7a7fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0d7c0b6af0 0x7f0d7c1484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.585+0000 7f0d7a7fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0d7c0b6af0 0x7f0d7c1484c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51818/0 (socket says 172.21.15.52:51818) 2023-06-23T18:44:56.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.585+0000 7f0d7a7fc700 1 -- 172.21.15.52:0/3775810272 learned_addr learned my addr 172.21.15.52:0/3775810272 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:56.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.585+0000 7f0d7a7fc700 1 -- 172.21.15.52:0/3775810272 >> v2:172.21.15.89:3300/0 conn(0x7f0d7c0b3570 msgr2=0x7f0d7c148a00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-23T18:44:56.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.585+0000 7f0d7a7fc700 1 --2- 172.21.15.52:0/3775810272 >> v2:172.21.15.89:3300/0 conn(0x7f0d7c0b3570 0x7f0d7c148a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.585+0000 7f0d7a7fc700 1 -- 172.21.15.52:0/3775810272 >> v1:172.21.15.52:6789/0 conn(0x7f0d7c0714c0 legacy=0x7f0d7c145480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:56.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.585+0000 7f0d7a7fc700 1 -- 172.21.15.52:0/3775810272 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c0b8510 con 0x7f0d7c0b6af0 2023-06-23T18:44:56.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.586+0000 7f0d7a7fc700 1 --2- 172.21.15.52:0/3775810272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d7c0b6af0 0x7f0d7c1484c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0b44f0 tx=0x7f0d6c0147e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31657f6d378d592 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.586+0000 7fe96b6e9700 1 -- 172.21.15.52:0/3664609102 shutdown_connections 2023-06-23T18:44:56.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.586+0000 7fe96b6e9700 1 -- 172.21.15.52:0/3664609102 wait complete. 2023-06-23T18:44:56.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.586+0000 7f0d79ffb700 1 -- 172.21.15.52:0/3775810272 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c005e30 con 0x7f0d7c0b6af0 2023-06-23T18:44:56.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.586+0000 7f0d79ffb700 1 -- 172.21.15.52:0/3775810272 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6c00f0c0 con 0x7f0d7c0b6af0 2023-06-23T18:44:56.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.586+0000 7f0d79ffb700 1 -- 172.21.15.52:0/3775810272 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c004250 con 0x7f0d7c0b6af0 2023-06-23T18:44:56.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.587+0000 7f0d815de700 1 -- 172.21.15.52:0/3775810272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d7c0b6af0 msgr2=0x7f0d7c1484c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.587+0000 7f0d815de700 1 --2- 172.21.15.52:0/3775810272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d7c0b6af0 0x7f0d7c1484c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0b44f0 tx=0x7f0d6c0147e0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.587+0000 7f0d815de700 1 -- 172.21.15.52:0/3775810272 shutdown_connections 2023-06-23T18:44:56.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.587+0000 7f0d815de700 1 --2- 172.21.15.52:0/3775810272 >> v2:172.21.15.89:3300/0 conn(0x7f0d7c0b3570 0x7f0d7c148a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.587+0000 7f0d815de700 1 --2- 172.21.15.52:0/3775810272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d7c0b6af0 0x7f0d7c1484c0 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c0b44f0 tx=0x7f0d6c0147e0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.587+0000 7f0d815de700 1 -- 172.21.15.52:0/3775810272 >> 172.21.15.52:0/3775810272 conn(0x7f0d7c0bc170 msgr2=0x7f0d7c0bc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:56.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.588+0000 7fe96b6e9700 1 Processor -- start 2023-06-23T18:44:56.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.588+0000 7f834fe95700 1 Processor -- start 2023-06-23T18:44:56.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.588+0000 7fe96b6e9700 1 -- start start 2023-06-23T18:44:56.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.589+0000 7f834fe95700 1 -- start start 2023-06-23T18:44:56.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.589+0000 7fe96b6e9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe96406fe70 0x7fe964142be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.589+0000 7fe96b6e9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe964071a80 0x7fe9640b5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.589+0000 7fe96b6e9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe964143b90 0x7fe96413a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.589+0000 7fe96b6e9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe964143120 con 0x7fe964071a80 2023-06-23T18:44:56.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.589+0000 7fe96b6e9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9640b6290 con 0x7fe964143b90 2023-06-23T18:44:56.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.589+0000 7fe96b6e9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9641efad0 con 0x7fe96406fe70 2023-06-23T18:44:56.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.589+0000 7fe968c84700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe964071a80 0x7fe9640b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.589+0000 7fe968c84700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe964071a80 0x7fe9640b5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51830/0 (socket says 172.21.15.52:51830) 2023-06-23T18:44:56.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.589+0000 7fe968c84700 1 -- 172.21.15.52:0/4083400539 learned_addr learned my addr 172.21.15.52:0/4083400539 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:56.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.589+0000 7fe968c84700 1 -- 172.21.15.52:0/4083400539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe96406fe70 msgr2=0x7fe964142be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.589+0000 7fe968c84700 1 --2- 172.21.15.52:0/4083400539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe96406fe70 0x7fe964142be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.589+0000 7fe968c84700 1 -- 172.21.15.52:0/4083400539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe964143b90 msgr2=0x7fe96413a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.589+0000 7fe968c84700 1 --2- 172.21.15.52:0/4083400539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe964143b90 0x7fe96413a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.590+0000 7fe968c84700 1 -- 172.21.15.52:0/4083400539 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9600094a0 con 0x7fe964071a80 2023-06-23T18:44:56.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.590+0000 7f834fe95700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83480b8660 0x7f834814a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.590+0000 7f834fe95700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f834814a9e0 0x7f8348154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.590+0000 7f834fe95700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f834806ffd0 con 0x7f8348071920 2023-06-23T18:44:56.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.590+0000 7f834fe95700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f834814ae20 con 0x7f834814a9e0 2023-06-23T18:44:56.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.590+0000 7f834fe95700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834806f6a0 con 0x7f83480b8660 2023-06-23T18:44:56.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.590+0000 7fe968c84700 1 --2- 172.21.15.52:0/4083400539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe964071a80 0x7fe9640b5280 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe960009ea0 tx=0x7fe960004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.590+0000 7f834d430700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83480b8660 0x7f834814a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.590+0000 7f834d430700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83480b8660 0x7f834814a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.52:48898/0 (socket says 172.21.15.52:48898) 2023-06-23T18:44:56.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.590+0000 7f834d430700 1 -- 172.21.15.52:0/2831473230 learned_addr learned my addr 172.21.15.52:0/2831473230 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:56.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.590+0000 7f834e432700 1 --2- 172.21.15.52:0/2831473230 >> v2:172.21.15.52:3300/0 conn(0x7f834814a9e0 0x7f8348154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.590+0000 7f834d430700 1 -- 172.21.15.52:0/2831473230 >> v2:172.21.15.52:3300/0 conn(0x7f834814a9e0 msgr2=0x7f8348154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:56.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.590+0000 7f834d430700 1 --2- 172.21.15.52:0/2831473230 >> v2:172.21.15.52:3300/0 conn(0x7f834814a9e0 0x7f8348154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.590+0000 7f834d430700 1 -- 172.21.15.52:0/2831473230 >> v1:172.21.15.89:6789/0 conn(0x7f8348071920 legacy=0x7f8348144270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:56.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.590+0000 7f834d430700 1 -- 172.21.15.52:0/2831473230 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834806f980 con 0x7f83480b8660 2023-06-23T18:44:56.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.590+0000 7fe959ffb700 1 -- 172.21.15.52:0/4083400539 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe960011630 con 0x7fe964071a80 2023-06-23T18:44:56.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.591+0000 7fe959ffb700 1 -- 172.21.15.52:0/4083400539 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe960011790 con 0x7fe964071a80 2023-06-23T18:44:56.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.591+0000 7fe959ffb700 1 -- 172.21.15.52:0/4083400539 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe960011b40 con 0x7fe964071a80 2023-06-23T18:44:56.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.591+0000 7fe96b6e9700 1 -- 172.21.15.52:0/4083400539 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9640b57c0 con 0x7fe964071a80 2023-06-23T18:44:56.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.591+0000 7f834d430700 1 --2- 172.21.15.52:0/2831473230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83480b8660 0x7f834814a4a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8340009e50 tx=0x7f834000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61b366bc0b6f92ce server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.592+0000 7fe96b6e9700 1 -- 172.21.15.52:0/4083400539 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe964145980 con 0x7fe964071a80 2023-06-23T18:44:56.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.592+0000 7f834cc2f700 1 -- 172.21.15.52:0/2831473230 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834000e070 con 0x7f83480b8660 2023-06-23T18:44:56.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.590+0000 7f0d815de700 1 -- 172.21.15.52:0/3775810272 shutdown_connections 2023-06-23T18:44:56.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.590+0000 7f0d815de700 1 -- 172.21.15.52:0/3775810272 wait complete. 2023-06-23T18:44:56.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.592+0000 7f0d815de700 1 Processor -- start 2023-06-23T18:44:56.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.592+0000 7f834cc2f700 1 -- 172.21.15.52:0/2831473230 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8340003a20 con 0x7f83480b8660 2023-06-23T18:44:56.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.592+0000 7fe96b6e9700 1 -- 172.21.15.52:0/4083400539 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe964146fa0 con 0x7fe964071a80 2023-06-23T18:44:56.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.592+0000 7f834cc2f700 1 -- 172.21.15.52:0/2831473230 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8340003dd0 con 0x7f83480b8660 2023-06-23T18:44:56.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.592+0000 7fea2044f700 1 Processor -- start 2023-06-23T18:44:56.607 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.592+0000 7fea2044f700 1 -- start start 2023-06-23T18:44:56.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.592+0000 7f0d815de700 1 -- start start 2023-06-23T18:44:56.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.593+0000 7f0d815de700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d7c0714c0 0x7f0d7c141c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.593+0000 7f0d815de700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d7c0b3570 0x7f0d7c1dba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.593+0000 7f0d815de700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d7c147fe0 0x7f0d7c147140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.593+0000 7f0d815de700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c140fe0 con 0x7f0d7c147fe0 2023-06-23T18:44:56.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.593+0000 7f0d815de700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c1421d0 con 0x7f0d7c0714c0 2023-06-23T18:44:56.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.593+0000 7f0d815de700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7c140dd0 con 0x7f0d7c0b3570 2023-06-23T18:44:56.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.594+0000 7f0d7affd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d7c0714c0 0x7f0d7c141c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.594+0000 7f0d7affd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d7c0714c0 0x7f0d7c141c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.52:58970/0 (socket says 172.21.15.52:58970) 2023-06-23T18:44:56.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.594+0000 7f0d7affd700 1 -- 172.21.15.52:0/1836227544 learned_addr learned my addr 172.21.15.52:0/1836227544 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:56.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.593+0000 7f834fe95700 1 -- 172.21.15.52:0/2831473230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83480b8660 msgr2=0x7f834814a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.593+0000 7f834fe95700 1 --2- 172.21.15.52:0/2831473230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83480b8660 0x7f834814a4a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8340009e50 tx=0x7f834000b330 comp rx=0 tx=0).stop 2023-06-23T18:44:56.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.594+0000 7f834fe95700 1 -- 172.21.15.52:0/2831473230 shutdown_connections 2023-06-23T18:44:56.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.594+0000 7f834fe95700 1 --2- 172.21.15.52:0/2831473230 >> v2:172.21.15.52:3300/0 conn(0x7f834814a9e0 0x7f8348154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.594+0000 7f834fe95700 1 --2- 172.21.15.52:0/2831473230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83480b8660 0x7f834814a4a0 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8340009e50 tx=0x7f834000b330 comp rx=0 tx=0).stop 2023-06-23T18:44:56.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.594+0000 7f834fe95700 1 -- 172.21.15.52:0/2831473230 >> 172.21.15.52:0/2831473230 conn(0x7f83480bc170 msgr2=0x7f83480bc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:56.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.594+0000 7fea2044f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fea1806c1f0 0x7fea181473d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.594+0000 7fea2044f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea18147910 0x7fea18071c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.594+0000 7fea2044f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea180b8fb0 con 0x7fea180b7c70 2023-06-23T18:44:56.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.594+0000 7fea2044f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea180b8b20 con 0x7fea1806c1f0 2023-06-23T18:44:56.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.594+0000 7fea2044f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea180b9b20 con 0x7fea18147910 2023-06-23T18:44:56.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.594+0000 7f0d7a7fc700 1 --2- 172.21.15.52:0/1836227544 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d7c0b3570 0x7f0d7c1dba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.612 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.594+0000 7f0d7b7fe700 1 --2- 172.21.15.52:0/1836227544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d7c147fe0 0x7f0d7c147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.594+0000 7f834fe95700 1 -- 172.21.15.52:0/2831473230 shutdown_connections 2023-06-23T18:44:56.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.594+0000 7fea1d9ea700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fea180b7c70 0x7fea18071540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44750/0 (socket says 172.21.15.52:44750) 2023-06-23T18:44:56.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.594+0000 7fea1e1eb700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fea1806c1f0 0x7fea181473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.594+0000 7fea1d9ea700 1 -- 172.21.15.52:0/1322830912 learned_addr learned my addr 172.21.15.52:0/1322830912 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:56.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.594+0000 7f0d7a7fc700 1 -- 172.21.15.52:0/1836227544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d7c0714c0 msgr2=0x7f0d7c141c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.594+0000 7f0d7a7fc700 1 --2- 172.21.15.52:0/1836227544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d7c0714c0 0x7f0d7c141c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.594+0000 7f0d7a7fc700 1 -- 172.21.15.52:0/1836227544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d7c147fe0 msgr2=0x7f0d7c147140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.594+0000 7f0d7a7fc700 1 --2- 172.21.15.52:0/1836227544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d7c147fe0 0x7f0d7c147140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.594+0000 7f0d7a7fc700 1 -- 172.21.15.52:0/1836227544 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6c00fd90 con 0x7f0d7c0b3570 2023-06-23T18:44:56.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.595+0000 7fea1e1eb700 1 -- 172.21.15.52:0/1322830912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea18147910 msgr2=0x7fea18071c50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-23T18:44:56.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.595+0000 7fea1e1eb700 1 --2- 172.21.15.52:0/1322830912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea18147910 0x7fea18071c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.595+0000 7fea1e1eb700 1 -- 172.21.15.52:0/1322830912 >> v1:172.21.15.52:6789/0 conn(0x7fea180b7c70 legacy=0x7fea18071540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.595+0000 7fea1e1eb700 1 -- 172.21.15.52:0/1322830912 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea180b49b0 con 0x7fea1806c1f0 2023-06-23T18:44:56.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.595+0000 7f0d7a7fc700 1 --2- 172.21.15.52:0/1836227544 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d7c0b3570 0x7f0d7c1dba00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00d000 tx=0x7f0d6c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.595+0000 7fe959ffb700 1 -- 172.21.15.52:0/4083400539 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe960018050 con 0x7fe964071a80 2023-06-23T18:44:56.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.595+0000 7fe959ffb700 1 --2- 172.21.15.52:0/4083400539 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe94806ad30 0x7fe94806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.595+0000 7fe959ffb700 1 -- 172.21.15.52:0/4083400539 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe96008a4f0 con 0x7fe964071a80 2023-06-23T18:44:56.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.595+0000 7fe959ffb700 1 --2- 172.21.15.52:0/4083400539 >> [v2:172.21.15.52:6810/2360219751,v1:172.21.15.52:6813/2360219751] conn(0x7fe9480735e0 0x7fe9480759f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.595+0000 7fe959ffb700 1 -- 172.21.15.52:0/4083400539 --> [v2:172.21.15.52:6810/2360219751,v1:172.21.15.52:6813/2360219751] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe9480760a0 con 0x7fe9480735e0 2023-06-23T18:44:56.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.595+0000 7fe969485700 1 --2- 172.21.15.52:0/4083400539 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe94806ad30 0x7fe94806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.595+0000 7fe959ffb700 1 -- 172.21.15.52:0/4083400539 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe96008a860 con 0x7fe964071a80 2023-06-23T18:44:56.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.595+0000 7f834fe95700 1 -- 172.21.15.52:0/2831473230 wait complete. 2023-06-23T18:44:56.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.596+0000 7fea1e1eb700 1 --2- 172.21.15.52:0/1322830912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea1806c1f0 0x7fea181473d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fea14009840 tx=0x7fea14009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89274848bf8ea70 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.596+0000 7fe969c86700 1 --2- 172.21.15.52:0/4083400539 >> [v2:172.21.15.52:6810/2360219751,v1:172.21.15.52:6813/2360219751] conn(0x7fe9480735e0 0x7fe9480759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.596+0000 7fe969485700 1 --2- 172.21.15.52:0/4083400539 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe94806ad30 0x7fe94806d1e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe9540096f0 tx=0x7fe954006c50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.596+0000 7fea1d1e9700 1 -- 172.21.15.52:0/1322830912 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14011830 con 0x7fea1806c1f0 2023-06-23T18:44:56.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.596+0000 7fea1d1e9700 1 -- 172.21.15.52:0/1322830912 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea14011990 con 0x7fea1806c1f0 2023-06-23T18:44:56.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.596+0000 7fea1d1e9700 1 -- 172.21.15.52:0/1322830912 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14011d20 con 0x7fea1806c1f0 2023-06-23T18:44:56.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.596+0000 7fe969c86700 1 --2- 172.21.15.52:0/4083400539 >> [v2:172.21.15.52:6810/2360219751,v1:172.21.15.52:6813/2360219751] conn(0x7fe9480735e0 0x7fe9480759f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.619 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.597+0000 7f834fe95700 1 Processor -- start 2023-06-23T18:44:56.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.595+0000 7f0d637fe700 1 -- 172.21.15.52:0/1836227544 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c02d070 con 0x7f0d7c0b3570 2023-06-23T18:44:56.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.595+0000 7f0d637fe700 1 -- 172.21.15.52:0/1836227544 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6c0038b0 con 0x7f0d7c0b3570 2023-06-23T18:44:56.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.595+0000 7f0d637fe700 1 -- 172.21.15.52:0/1836227544 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c003c40 con 0x7f0d7c0b3570 2023-06-23T18:44:56.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.597+0000 7f0d815de700 1 -- 172.21.15.52:0/1836227544 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d7c13afb0 con 0x7f0d7c0b3570 2023-06-23T18:44:56.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.597+0000 7f0d815de700 1 -- 172.21.15.52:0/1836227544 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d7c070c40 con 0x7f0d7c0b3570 2023-06-23T18:44:56.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.597+0000 7fea2044f700 1 -- 172.21.15.52:0/1322830912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea1806c1f0 msgr2=0x7fea181473d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.597+0000 7fea2044f700 1 --2- 172.21.15.52:0/1322830912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea1806c1f0 0x7fea181473d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fea14009840 tx=0x7fea14009b50 comp rx=0 tx=0).stop 2023-06-23T18:44:56.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.598+0000 7fea2044f700 1 -- 172.21.15.52:0/1322830912 shutdown_connections 2023-06-23T18:44:56.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.598+0000 7fea2044f700 1 --2- 172.21.15.52:0/1322830912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea18147910 0x7fea18071c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.598+0000 7fea2044f700 1 --2- 172.21.15.52:0/1322830912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea1806c1f0 0x7fea181473d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.598+0000 7fea2044f700 1 -- 172.21.15.52:0/1322830912 >> 172.21.15.52:0/1322830912 conn(0x7fea180bdf30 msgr2=0x7fea180b9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:56.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.598+0000 7f834fe95700 1 -- start start 2023-06-23T18:44:56.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.598+0000 7f0d815de700 1 -- 172.21.15.52:0/1836227544 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0d7c0b6f80 con 0x7f0d7c0b3570 2023-06-23T18:44:56.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.599+0000 7f834fe95700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8348071920 0x7f83480b5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.599+0000 7f834fe95700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f834814a9e0 0x7f83481e3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.599+0000 7f834fe95700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8348147970 0x7f83481e3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.599+0000 7f834fe95700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8348145390 con 0x7f8348071920 2023-06-23T18:44:56.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.599+0000 7f834fe95700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83480b46d0 con 0x7f8348147970 2023-06-23T18:44:56.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.599+0000 7f834fe95700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83480b43f0 con 0x7f834814a9e0 2023-06-23T18:44:56.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.599+0000 7fea2044f700 1 -- 172.21.15.52:0/1322830912 shutdown_connections 2023-06-23T18:44:56.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.599+0000 7fe959ffb700 1 -- 172.21.15.52:0/4083400539 <== osd.1 v2:172.21.15.52:6810/2360219751 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe9480760a0 con 0x7fe9480735e0 2023-06-23T18:44:56.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.599+0000 7f834d430700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f834814a9e0 0x7f83481e3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.599+0000 7f834d430700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f834814a9e0 0x7f83481e3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.52:48914/0 (socket says 172.21.15.52:48914) 2023-06-23T18:44:56.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.599+0000 7f834d430700 1 -- 172.21.15.52:0/2632684494 learned_addr learned my addr 172.21.15.52:0/2632684494 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:56.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.599+0000 7f834e432700 1 --2- 172.21.15.52:0/2632684494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8348147970 0x7f83481e3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.625 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.599+0000 7f834dc31700 1 --2- 172.21.15.52:0/2632684494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8348071920 0x7f83480b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.599+0000 7f1bbb5f2700 1 Processor -- start 2023-06-23T18:44:56.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.599+0000 7f0d637fe700 1 -- 172.21.15.52:0/1836227544 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0d6c026450 con 0x7f0d7c0b3570 2023-06-23T18:44:56.626 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.599+0000 7f834dc31700 1 -- 172.21.15.52:0/2632684494 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f834814a9e0 msgr2=0x7f83481e3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.599+0000 7f834dc31700 1 --2- 172.21.15.52:0/2632684494 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f834814a9e0 0x7f83481e3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.599+0000 7f834dc31700 1 -- 172.21.15.52:0/2632684494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8348147970 msgr2=0x7f83481e3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.599+0000 7f834dc31700 1 --2- 172.21.15.52:0/2632684494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8348147970 0x7f83481e3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.599+0000 7f834dc31700 1 -- 172.21.15.52:0/2632684494 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8340009b30 con 0x7f8348071920 2023-06-23T18:44:56.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.600+0000 7f834e432700 1 --2- 172.21.15.52:0/2632684494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8348147970 0x7f83481e3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:56.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.600+0000 7f834dc31700 1 --2- 172.21.15.52:0/2632684494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8348071920 0x7f83480b5340 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f834400c3e0 tx=0x7f834400c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.600+0000 7f0d637fe700 1 --2- 172.21.15.52:0/1836227544 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0d6806ad10 0x7f0d6806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.600+0000 7f0d637fe700 1 -- 172.21.15.52:0/1836227544 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0d6c09b630 con 0x7f0d7c0b3570 2023-06-23T18:44:56.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.600+0000 7f0d637fe700 1 --2- 172.21.15.52:0/1836227544 >> [v2:172.21.15.89:6824/2989085420,v1:172.21.15.89:6825/2989085420] conn(0x7f0d680734c0 0x7f0d680758d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.600+0000 7f0d637fe700 1 -- 172.21.15.52:0/1836227544 --> [v2:172.21.15.89:6824/2989085420,v1:172.21.15.89:6825/2989085420] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d68075f80 con 0x7f0d680734c0 2023-06-23T18:44:56.628 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.600+0000 7f0d637fe700 1 -- 172.21.15.52:0/1836227544 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d6c0666d0 con 0x7f0d7c0b3570 2023-06-23T18:44:56.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.600+0000 7fea2044f700 1 -- 172.21.15.52:0/1322830912 wait complete. 2023-06-23T18:44:56.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.599+0000 7f1bbb5f2700 1 -- start start 2023-06-23T18:44:56.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.601+0000 7f1bbb5f2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1bb40ba370 0x7f1bb415a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.601+0000 7f1bbb5f2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bb40b5bc0 con 0x7f1bb40b7aa0 2023-06-23T18:44:56.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.601+0000 7f1bbb5f2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bb40b60f0 con 0x7f1bb40bda10 2023-06-23T18:44:56.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.601+0000 7f1bbb5f2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb40b71f0 con 0x7f1bb40ba370 2023-06-23T18:44:56.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.601+0000 7f1bb9b8f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1bb40ba370 0x7f1bb415a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.601+0000 7f1bb9b8f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1bb40ba370 0x7f1bb415a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.52:48930/0 (socket says 172.21.15.52:48930) 2023-06-23T18:44:56.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.601+0000 7f1bb9b8f700 1 -- 172.21.15.52:0/3224147798 learned_addr learned my addr 172.21.15.52:0/3224147798 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:56.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.601+0000 7f1bb9b8f700 1 -- 172.21.15.52:0/3224147798 >> v1:172.21.15.89:6789/0 conn(0x7f1bb40bda10 legacy=0x7f1bb40b6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.601+0000 7f1bb9b8f700 1 -- 172.21.15.52:0/3224147798 >> v1:172.21.15.52:6789/0 conn(0x7f1bb40b7aa0 legacy=0x7f1bb40b9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:56.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.601+0000 7f1bb9b8f700 1 -- 172.21.15.52:0/3224147798 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb40b5e10 con 0x7f1bb40ba370 2023-06-23T18:44:56.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.602+0000 7f1bb9b8f700 1 --2- 172.21.15.52:0/3224147798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1bb40ba370 0x7f1bb415a240 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1ba40098a0 tx=0x7f1ba4009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5530d5211d2edc85 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.602+0000 7f1babfff700 1 -- 172.21.15.52:0/3224147798 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba4004230 con 0x7f1bb40ba370 2023-06-23T18:44:56.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.602+0000 7f1babfff700 1 -- 172.21.15.52:0/3224147798 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba4004390 con 0x7f1bb40ba370 2023-06-23T18:44:56.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.602+0000 7f1babfff700 1 -- 172.21.15.52:0/3224147798 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba40036a0 con 0x7f1bb40ba370 2023-06-23T18:44:56.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.603+0000 7f1bbb5f2700 1 -- 172.21.15.52:0/3224147798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1bb40ba370 msgr2=0x7f1bb415a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.603+0000 7f1bbb5f2700 1 --2- 172.21.15.52:0/3224147798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1bb40ba370 0x7f1bb415a240 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1ba40098a0 tx=0x7f1ba4009bb0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.603+0000 7f1bbb5f2700 1 -- 172.21.15.52:0/3224147798 shutdown_connections 2023-06-23T18:44:56.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.603+0000 7f1bbb5f2700 1 --2- 172.21.15.52:0/3224147798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1bb40ba370 0x7f1bb415a240 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.603+0000 7f1bbb5f2700 1 -- 172.21.15.52:0/3224147798 >> 172.21.15.52:0/3224147798 conn(0x7f1bb406c820 msgr2=0x7f1bb40bd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:56.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.601+0000 7f833e7fc700 1 -- 172.21.15.52:0/2632684494 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83440052d0 con 0x7f8348071920 2023-06-23T18:44:56.632 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.601+0000 7f833e7fc700 1 -- 172.21.15.52:0/2632684494 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8344005450 con 0x7f8348071920 2023-06-23T18:44:56.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.601+0000 7f833e7fc700 1 -- 172.21.15.52:0/2632684494 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83440038c0 con 0x7f8348071920 2023-06-23T18:44:56.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.601+0000 7f834fe95700 1 -- 172.21.15.52:0/2632684494 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83480b3d60 con 0x7f8348071920 2023-06-23T18:44:56.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.601+0000 7f834fe95700 1 -- 172.21.15.52:0/2632684494 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83480b5c10 con 0x7f8348071920 2023-06-23T18:44:56.633 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.601+0000 7fea2044f700 1 Processor -- start 2023-06-23T18:44:56.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.600+0000 7f2b1986f700 1 Processor -- start 2023-06-23T18:44:56.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.601+0000 7f2b1986f700 1 -- start start 2023-06-23T18:44:56.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.602+0000 7f2b1986f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2b140af8d0 0x7f2b1406ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.602+0000 7f2b1986f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b14070440 con 0x7f2b1406d490 2023-06-23T18:44:56.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.602+0000 7f2b1986f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b140b7e90 con 0x7f2b1406f0d0 2023-06-23T18:44:56.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.602+0000 7f2b1986f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b14071700 con 0x7f2b140af8d0 2023-06-23T18:44:56.634 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.602+0000 7f2b12ffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2b140af8d0 0x7f2b1406ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.602+0000 7f2b12ffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2b140af8d0 0x7f2b1406ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.52:58982/0 (socket says 172.21.15.52:58982) 2023-06-23T18:44:56.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.602+0000 7f2b12ffd700 1 -- 172.21.15.52:0/2452672284 learned_addr learned my addr 172.21.15.52:0/2452672284 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:56.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.602+0000 7f2b12ffd700 1 -- 172.21.15.52:0/2452672284 >> v1:172.21.15.89:6789/0 conn(0x7f2b1406f0d0 legacy=0x7f2b14143500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:56.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.602+0000 7f2b12ffd700 1 -- 172.21.15.52:0/2452672284 >> v1:172.21.15.52:6789/0 conn(0x7f2b1406d490 legacy=0x7f2b14149be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.602+0000 7f2b12ffd700 1 -- 172.21.15.52:0/2452672284 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b14071d90 con 0x7f2b140af8d0 2023-06-23T18:44:56.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.603+0000 7f2b12ffd700 1 --2- 172.21.15.52:0/2452672284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b140af8d0 0x7f2b1406ff00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2b040098f0 tx=0x7f2b04009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=103abdb94011166c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.603+0000 7f2b11ffb700 1 -- 172.21.15.52:0/2452672284 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b04004230 con 0x7f2b140af8d0 2023-06-23T18:44:56.635 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.603+0000 7f2b11ffb700 1 -- 172.21.15.52:0/2452672284 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b04004390 con 0x7f2b140af8d0 2023-06-23T18:44:56.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.603+0000 7f2b11ffb700 1 -- 172.21.15.52:0/2452672284 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b040036a0 con 0x7f2b140af8d0 2023-06-23T18:44:56.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.601+0000 7f0d7b7fe700 1 --2- 172.21.15.52:0/1836227544 >> [v2:172.21.15.89:6824/2989085420,v1:172.21.15.89:6825/2989085420] conn(0x7f0d680734c0 0x7f0d680758d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.601+0000 7f0d7affd700 1 --2- 172.21.15.52:0/1836227544 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0d6806ad10 0x7f0d6806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.636 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.604+0000 7f1bbb5f2700 1 -- 172.21.15.52:0/3224147798 shutdown_connections 2023-06-23T18:44:56.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.604+0000 7f1bbb5f2700 1 -- 172.21.15.52:0/3224147798 wait complete. 2023-06-23T18:44:56.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.604+0000 7f2b1986f700 1 -- 172.21.15.52:0/2452672284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b140af8d0 msgr2=0x7f2b1406ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.604+0000 7f2b1986f700 1 --2- 172.21.15.52:0/2452672284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b140af8d0 0x7f2b1406ff00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2b040098f0 tx=0x7f2b04009c00 comp rx=0 tx=0).stop 2023-06-23T18:44:56.637 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.604+0000 7f2b1986f700 1 -- 172.21.15.52:0/2452672284 shutdown_connections 2023-06-23T18:44:56.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.604+0000 7f2b1986f700 1 --2- 172.21.15.52:0/2452672284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b140af8d0 0x7f2b1406ff00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.604+0000 7f2b1986f700 1 -- 172.21.15.52:0/2452672284 >> 172.21.15.52:0/2452672284 conn(0x7f2b140bc170 msgr2=0x7f2b140bc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:56.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.604+0000 7f2ff1871700 1 Processor -- start 2023-06-23T18:44:56.638 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.603+0000 7fea2044f700 1 -- start start 2023-06-23T18:44:56.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.604+0000 7fea2044f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea1806c1f0 0x7fea1813d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.604+0000 7fea2044f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea180b7c70 0x7fea1813df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.604+0000 7fea2044f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea18147910 0x7fea1814a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.604+0000 7fea2044f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1814a050 con 0x7fea18147910 2023-06-23T18:44:56.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.604+0000 7fea2044f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea18149720 con 0x7fea1806c1f0 2023-06-23T18:44:56.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.604+0000 7fea2044f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea18149a00 con 0x7fea180b7c70 2023-06-23T18:44:56.639 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.605+0000 7fea1e1eb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea1806c1f0 0x7fea1813d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.605+0000 7fea1e1eb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea1806c1f0 0x7fea1813d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.52:58996/0 (socket says 172.21.15.52:58996) 2023-06-23T18:44:56.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.605+0000 7fea1e1eb700 1 -- 172.21.15.52:0/1965498210 learned_addr learned my addr 172.21.15.52:0/1965498210 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:56.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.605+0000 7f0d7affd700 1 --2- 172.21.15.52:0/1836227544 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0d6806ad10 0x7f0d6806d1c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0d700017f0 tx=0x7f0d70009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.640 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.605+0000 7f2b1986f700 1 -- 172.21.15.52:0/2452672284 shutdown_connections 2023-06-23T18:44:56.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.603+0000 7f834fe95700 1 -- 172.21.15.52:0/2632684494 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8330000fb0 con 0x7f8348071920 2023-06-23T18:44:56.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.605+0000 7f1bbb5f2700 1 Processor -- start 2023-06-23T18:44:56.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.604+0000 7f2ff1871700 1 -- start start 2023-06-23T18:44:56.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.606+0000 7f2ff1871700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2fec0b9310 0x7f2fec1488f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.606+0000 7f2ff1871700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fec1522a0 con 0x7f2fec06c1f0 2023-06-23T18:44:56.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.606+0000 7f2ff1871700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fec0b9a60 con 0x7f2fec14e940 2023-06-23T18:44:56.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.606+0000 7f2ff1871700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fec0b82a0 con 0x7f2fec0b9310 2023-06-23T18:44:56.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.606+0000 7f2feb7fe700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f2fec14e940 0x7f2fec1591c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.52:53368/0 (socket says 172.21.15.52:53368) 2023-06-23T18:44:56.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.606+0000 7f2feb7fe700 1 -- 172.21.15.52:0/1899441972 learned_addr learned my addr 172.21.15.52:0/1899441972 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:56.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.606+0000 7f0d7b7fe700 1 --2- 172.21.15.52:0/1836227544 >> [v2:172.21.15.89:6824/2989085420,v1:172.21.15.89:6825/2989085420] conn(0x7f0d680734c0 0x7f0d680758d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.606+0000 7f2fe9ffb700 1 -- 172.21.15.52:0/1899441972 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3542839786 0 0) 0x7f2fec0b9a60 con 0x7f2fec14e940 2023-06-23T18:44:56.643 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.606+0000 7f2fe9ffb700 1 -- 172.21.15.52:0/1899441972 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fd40035b0 con 0x7f2fec14e940 2023-06-23T18:44:56.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.605+0000 7f1bbb5f2700 1 -- start start 2023-06-23T18:44:56.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.606+0000 7f1bbb5f2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1bb40b7aa0 0x7f1bb41db3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.606+0000 7f1bbb5f2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bb40ba370 0x7f1bb414b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.606+0000 7f1bbb5f2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bb40bda10 0x7f1bb4148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.644 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f1bbb5f2700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb41db930 con 0x7f1bb40bda10 2023-06-23T18:44:56.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f1bbb5f2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb414f1f0 con 0x7f1bb40ba370 2023-06-23T18:44:56.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f1bbb5f2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb414bd20 con 0x7f1bb40b7aa0 2023-06-23T18:44:56.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.605+0000 7f2b1986f700 1 -- 172.21.15.52:0/2452672284 wait complete. 2023-06-23T18:44:56.645 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f2b1986f700 1 Processor -- start 2023-06-23T18:44:56.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.605+0000 7fea1e9ec700 1 --2- 172.21.15.52:0/1965498210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea18147910 0x7fea1814a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.606+0000 7fea1e1eb700 1 -- 172.21.15.52:0/1965498210 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea180b7c70 msgr2=0x7fea1813df20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-23T18:44:56.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.606+0000 7fea1e1eb700 1 --2- 172.21.15.52:0/1965498210 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fea180b7c70 0x7fea1813df20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.606+0000 7fea1e1eb700 1 -- 172.21.15.52:0/1965498210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea18147910 msgr2=0x7fea1814a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.646 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.606+0000 7fea1e1eb700 1 --2- 172.21.15.52:0/1965498210 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea18147910 0x7fea1814a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.606+0000 7fea1e1eb700 1 -- 172.21.15.52:0/1965498210 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea140094a0 con 0x7fea1806c1f0 2023-06-23T18:44:56.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.606+0000 7fea1e1eb700 1 --2- 172.21.15.52:0/1965498210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea1806c1f0 0x7fea1813d9e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fea14000c00 tx=0x7fea14004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.606+0000 7fea0effd700 1 -- 172.21.15.52:0/1965498210 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea140036a0 con 0x7fea1806c1f0 2023-06-23T18:44:56.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.606+0000 7fea0effd700 1 -- 172.21.15.52:0/1965498210 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1401f070 con 0x7fea1806c1f0 2023-06-23T18:44:56.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.606+0000 7fea0effd700 1 -- 172.21.15.52:0/1965498210 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14003a60 con 0x7fea1806c1f0 2023-06-23T18:44:56.647 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f1bb8b8d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bb40ba370 0x7f1bb414b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f1bb8b8d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bb40ba370 0x7f1bb414b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.52:59006/0 (socket says 172.21.15.52:59006) 2023-06-23T18:44:56.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f1bb8b8d700 1 -- 172.21.15.52:0/327244705 learned_addr learned my addr 172.21.15.52:0/327244705 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:56.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f2fe9ffb700 1 -- 172.21.15.52:0/1899441972 <== mon.1 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 866398482 0 0) 0x7f2fd40035b0 con 0x7f2fec14e940 2023-06-23T18:44:56.648 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f2fe9ffb700 1 -- 172.21.15.52:0/1899441972 >> v2:172.21.15.89:3300/0 conn(0x7f2fec0b9310 msgr2=0x7f2fec1488f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T18:44:56.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f2fe9ffb700 1 --2- 172.21.15.52:0/1899441972 >> v2:172.21.15.89:3300/0 conn(0x7f2fec0b9310 0x7f2fec1488f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f2fe9ffb700 1 -- 172.21.15.52:0/1899441972 >> v1:172.21.15.52:6789/0 conn(0x7f2fec06c1f0 legacy=0x7f2fec152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f2fe9ffb700 1 -- 172.21.15.52:0/1899441972 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec0b9780 con 0x7f2fec14e940 2023-06-23T18:44:56.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f2fe9ffb700 1 -- 172.21.15.52:0/1899441972 <== mon.1 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7f2fe40019f0 con 0x7f2fec14e940 2023-06-23T18:44:56.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f2fe9ffb700 1 -- 172.21.15.52:0/1899441972 >> v1:172.21.15.89:6789/0 conn(0x7f2fec14e940 legacy=0x7f2fec1591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f2fe9ffb700 1 --2- 172.21.15.52:0/1899441972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fd4003a00 0x7f2fd4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f2fe9ffb700 1 --2- 172.21.15.52:0/1899441972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fd4004850 0x7f2fd4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f2fe9ffb700 1 --2- 172.21.15.52:0/1899441972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fd40052d0 0x7f2fd400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f2fe9ffb700 1 -- 172.21.15.52:0/1899441972 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec0b82a0 con 0x7f2fd4003a00 2023-06-23T18:44:56.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f2fe9ffb700 1 -- 172.21.15.52:0/1899441972 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd400c200 con 0x7f2fd4004850 2023-06-23T18:44:56.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f2fe9ffb700 1 -- 172.21.15.52:0/1899441972 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd400c3c0 con 0x7f2fd40052d0 2023-06-23T18:44:56.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f2feb7fe700 1 --2- 172.21.15.52:0/1899441972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fd40052d0 0x7f2fd400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f1bb8b8d700 1 -- 172.21.15.52:0/327244705 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1bb40b7aa0 msgr2=0x7f1bb41db3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-23T18:44:56.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f1bb8b8d700 1 --2- 172.21.15.52:0/327244705 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1bb40b7aa0 0x7f1bb41db3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f1bb8b8d700 1 -- 172.21.15.52:0/327244705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bb40bda10 msgr2=0x7f1bb4148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f1bb8b8d700 1 --2- 172.21.15.52:0/327244705 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bb40bda10 0x7f1bb4148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f1bb8b8d700 1 -- 172.21.15.52:0/327244705 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba4009550 con 0x7f1bb40ba370 2023-06-23T18:44:56.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.606+0000 7f833e7fc700 1 -- 172.21.15.52:0/2632684494 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8344003a20 con 0x7f8348071920 2023-06-23T18:44:56.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f833e7fc700 1 --2- 172.21.15.52:0/2632684494 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f832c06adb0 0x7f832c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f833e7fc700 1 -- 172.21.15.52:0/2632684494 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8344088720 con 0x7f8348071920 2023-06-23T18:44:56.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f834d430700 1 --2- 172.21.15.52:0/2632684494 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f832c06adb0 0x7f832c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f833e7fc700 1 --2- 172.21.15.52:0/2632684494 >> [v2:172.21.15.89:6808/2538664679,v1:172.21.15.89:6809/2538664679] conn(0x7f832c073660 0x7f832c075a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f833e7fc700 1 -- 172.21.15.52:0/2632684494 --> [v2:172.21.15.89:6808/2538664679,v1:172.21.15.89:6809/2538664679] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f832c076120 con 0x7f832c073660 2023-06-23T18:44:56.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7f833e7fc700 1 -- 172.21.15.52:0/2632684494 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f834408ad40 con 0x7f8348071920 2023-06-23T18:44:56.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.608+0000 7f2feaffd700 1 --2- 172.21.15.52:0/1899441972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fd4003a00 0x7f2fd4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.608+0000 7f2feb7fe700 1 -- 172.21.15.52:0/1899441972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fd4004850 msgr2=0x7f2fd4004cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T18:44:56.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.608+0000 7f2feb7fe700 1 --2- 172.21.15.52:0/1899441972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fd4004850 0x7f2fd4004cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.608+0000 7f2feb7fe700 1 -- 172.21.15.52:0/1899441972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fd4003a00 msgr2=0x7f2fd4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:56.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.608+0000 7f2feb7fe700 1 --2- 172.21.15.52:0/1899441972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fd4003a00 0x7f2fd4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.608+0000 7f2feb7fe700 1 -- 172.21.15.52:0/1899441972 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec0b9780 con 0x7f2fd40052d0 2023-06-23T18:44:56.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.608+0000 7f2feb7fe700 1 -- 172.21.15.52:0/1899441972 reap_dead start 2023-06-23T18:44:56.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.608+0000 7f834d430700 1 --2- 172.21.15.52:0/2632684494 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f832c06adb0 0x7f832c06d260 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f834000b370 tx=0x7f8340009000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7fea2044f700 1 -- 172.21.15.52:0/1965498210 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea18149ce0 con 0x7fea1806c1f0 2023-06-23T18:44:56.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.607+0000 7fea2044f700 1 -- 172.21.15.52:0/1965498210 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea180b1380 con 0x7fea1806c1f0 2023-06-23T18:44:56.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.608+0000 7f0d637fe700 1 -- 172.21.15.52:0/1836227544 <== osd.7 v2:172.21.15.89:6824/2989085420 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0d68075f80 con 0x7f0d680734c0 2023-06-23T18:44:56.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.608+0000 7f2feb7fe700 1 --2- 172.21.15.52:0/1899441972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fd40052d0 0x7f2fd400ba10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2fe400a8a0 tx=0x7f2fd4005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7658fe41bfd8d25 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.609+0000 7f2fe9ffb700 1 -- 172.21.15.52:0/1899441972 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4012600 con 0x7f2fd40052d0 2023-06-23T18:44:56.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.609+0000 7f2fe9ffb700 1 -- 172.21.15.52:0/1899441972 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe4012780 con 0x7f2fd40052d0 2023-06-23T18:44:56.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.609+0000 7f2fe9ffb700 1 -- 172.21.15.52:0/1899441972 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4012b30 con 0x7f2fd40052d0 2023-06-23T18:44:56.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.609+0000 7f834e432700 1 --2- 172.21.15.52:0/2632684494 >> [v2:172.21.15.89:6808/2538664679,v1:172.21.15.89:6809/2538664679] conn(0x7f832c073660 0x7f832c075a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.609+0000 7f834e432700 1 --2- 172.21.15.52:0/2632684494 >> [v2:172.21.15.89:6808/2538664679,v1:172.21.15.89:6809/2538664679] conn(0x7f832c073660 0x7f832c075a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.608+0000 7fea2044f700 1 -- 172.21.15.52:0/1965498210 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fea180b0800 con 0x7fea1806c1f0 2023-06-23T18:44:56.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.608+0000 7f2b1986f700 1 -- start start 2023-06-23T18:44:56.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.609+0000 7f2b1986f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b1406d490 0x7f2b14147040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.609+0000 7f2b1986f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b1406f0d0 0x7f2b140b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.609+0000 7f2b1986f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b140af8d0 0x7f2b141efdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.609+0000 7f2b1986f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b14147580 con 0x7f2b140af8d0 2023-06-23T18:44:56.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.609+0000 7f2b1986f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b140b0230 con 0x7f2b1406d490 2023-06-23T18:44:56.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.609+0000 7f2b1986f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b140b5640 con 0x7f2b1406f0d0 2023-06-23T18:44:56.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.609+0000 7f2b127fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b1406f0d0 0x7f2b140b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.609+0000 7f2b127fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b1406f0d0 0x7f2b140b18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.52:48958/0 (socket says 172.21.15.52:48958) 2023-06-23T18:44:56.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.609+0000 7f2b127fc700 1 -- 172.21.15.52:0/69936617 learned_addr learned my addr 172.21.15.52:0/69936617 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:56.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.610+0000 7f2ff1871700 1 -- 172.21.15.52:0/1899441972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fd40052d0 msgr2=0x7f2fd400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.610+0000 7f2ff1871700 1 --2- 172.21.15.52:0/1899441972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fd40052d0 0x7f2fd400ba10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2fe400a8a0 tx=0x7f2fd4005880 comp rx=0 tx=0).stop 2023-06-23T18:44:56.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.610+0000 7f2ff1871700 1 -- 172.21.15.52:0/1899441972 shutdown_connections 2023-06-23T18:44:56.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.610+0000 7f2ff1871700 1 --2- 172.21.15.52:0/1899441972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fd40052d0 0x7f2fd400ba10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.610+0000 7f2ff1871700 1 -- 172.21.15.52:0/1899441972 >> 172.21.15.52:0/1899441972 conn(0x7f2fec0bdf30 msgr2=0x7f2fec0b9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:56.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.610+0000 7f2ff1871700 1 -- 172.21.15.52:0/1899441972 shutdown_connections 2023-06-23T18:44:56.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.610+0000 7f2ff1871700 1 -- 172.21.15.52:0/1899441972 wait complete. 2023-06-23T18:44:56.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.610+0000 7f2b127fc700 1 -- 172.21.15.52:0/69936617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b1406d490 msgr2=0x7f2b14147040 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-23T18:44:56.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.610+0000 7f2b127fc700 1 --2- 172.21.15.52:0/69936617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2b1406d490 0x7f2b14147040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.610+0000 7f2b127fc700 1 -- 172.21.15.52:0/69936617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b140af8d0 msgr2=0x7f2b141efdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.610+0000 7f2b127fc700 1 --2- 172.21.15.52:0/69936617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2b140af8d0 0x7f2b141efdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.610+0000 7f2b127fc700 1 -- 172.21.15.52:0/69936617 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b04009550 con 0x7f2b1406f0d0 2023-06-23T18:44:56.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.610+0000 7fea0effd700 1 -- 172.21.15.52:0/1965498210 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fea14003bc0 con 0x7fea1806c1f0 2023-06-23T18:44:56.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.610+0000 7f2b127fc700 1 --2- 172.21.15.52:0/69936617 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b1406f0d0 0x7f2b140b18b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2b0800b4a0 tx=0x7f2b0800b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.610+0000 7f2afbfff700 1 -- 172.21.15.52:0/69936617 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b08011830 con 0x7f2b1406f0d0 2023-06-23T18:44:56.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.611+0000 7f2afbfff700 1 -- 172.21.15.52:0/69936617 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b08011990 con 0x7f2b1406f0d0 2023-06-23T18:44:56.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.611+0000 7f2afbfff700 1 -- 172.21.15.52:0/69936617 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b08011d40 con 0x7f2b1406f0d0 2023-06-23T18:44:56.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.611+0000 7fea0effd700 1 --2- 172.21.15.52:0/1965498210 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe9fc06acb0 0x7fe9fc06d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.611+0000 7f2b1986f700 1 -- 172.21.15.52:0/69936617 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b140b24b0 con 0x7f2b1406f0d0 2023-06-23T18:44:56.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.611+0000 7f2b1986f700 1 -- 172.21.15.52:0/69936617 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b140b5b30 con 0x7f2b1406f0d0 2023-06-23T18:44:56.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.611+0000 7fea0effd700 1 -- 172.21.15.52:0/1965498210 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fea14021070 con 0x7fea1806c1f0 2023-06-23T18:44:56.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.611+0000 7fea0effd700 1 --2- 172.21.15.52:0/1965498210 >> [v2:172.21.15.89:6800/1683710352,v1:172.21.15.89:6801/1683710352] conn(0x7fe9fc0734e0 0x7fe9fc0758f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.611+0000 7fea0effd700 1 -- 172.21.15.52:0/1965498210 --> [v2:172.21.15.89:6800/1683710352,v1:172.21.15.89:6801/1683710352] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe9fc075fa0 con 0x7fe9fc0734e0 2023-06-23T18:44:56.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.611+0000 7fea0effd700 1 -- 172.21.15.52:0/1965498210 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea1408b3c0 con 0x7fea1806c1f0 2023-06-23T18:44:56.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.611+0000 7fea1d9ea700 1 --2- 172.21.15.52:0/1965498210 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe9fc06acb0 0x7fe9fc06d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.611+0000 7fea1e9ec700 1 --2- 172.21.15.52:0/1965498210 >> [v2:172.21.15.89:6800/1683710352,v1:172.21.15.89:6801/1683710352] conn(0x7fe9fc0734e0 0x7fe9fc0758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.612+0000 7f2ff1871700 1 Processor -- start 2023-06-23T18:44:56.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.612+0000 7f833e7fc700 1 -- 172.21.15.52:0/2632684494 <== osd.4 v2:172.21.15.89:6808/2538664679 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f832c076120 con 0x7f832c073660 2023-06-23T18:44:56.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.612+0000 7fea1d9ea700 1 --2- 172.21.15.52:0/1965498210 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe9fc06acb0 0x7fe9fc06d160 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fea181e4050 tx=0x7fea100015f0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.612+0000 7fea1e9ec700 1 --2- 172.21.15.52:0/1965498210 >> [v2:172.21.15.89:6800/1683710352,v1:172.21.15.89:6801/1683710352] conn(0x7fe9fc0734e0 0x7fe9fc0758f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.613+0000 7fea0effd700 1 -- 172.21.15.52:0/1965498210 <== osd.5 v2:172.21.15.89:6800/1683710352 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe9fc075fa0 con 0x7fe9fc0734e0 2023-06-23T18:44:56.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.612+0000 7f2ff1871700 1 -- start start 2023-06-23T18:44:56.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.613+0000 7f2ff1871700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fd40052d0 0x7f2fec151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.613+0000 7f2ff1871700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fec0b0e20 0x7f2fec1ecac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.613+0000 7f2ff1871700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fec1ed000 0x7f2fec1efce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.613+0000 7f2ff1871700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec152e40 con 0x7f2fec0b0e20 2023-06-23T18:44:56.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.613+0000 7f2ff1871700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec1515c0 con 0x7f2fec1ed000 2023-06-23T18:44:56.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.613+0000 7f2ff1871700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec0b7740 con 0x7f2fd40052d0 2023-06-23T18:44:56.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.613+0000 7f2feb7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fec1ed000 0x7f2fec1efce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.613+0000 7f2feb7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fec1ed000 0x7f2fec1efce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.52:59030/0 (socket says 172.21.15.52:59030) 2023-06-23T18:44:56.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.613+0000 7f2feb7fe700 1 -- 172.21.15.52:0/2001821422 learned_addr learned my addr 172.21.15.52:0/2001821422 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:56.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.614+0000 7f2feaffd700 1 --2- 172.21.15.52:0/2001821422 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fd40052d0 0x7f2fec151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.614+0000 7f2fea7fc700 1 --2- 172.21.15.52:0/2001821422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fec0b0e20 0x7f2fec1ecac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.614+0000 7f2feaffd700 1 -- 172.21.15.52:0/2001821422 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fec1ed000 msgr2=0x7f2fec1efce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.614+0000 7f2feaffd700 1 --2- 172.21.15.52:0/2001821422 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fec1ed000 0x7f2fec1efce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.614+0000 7f2feaffd700 1 -- 172.21.15.52:0/2001821422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fec0b0e20 msgr2=0x7f2fec1ecac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.614+0000 7f2feaffd700 1 --2- 172.21.15.52:0/2001821422 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fec0b0e20 0x7f2fec1ecac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.614+0000 7f2feaffd700 1 -- 172.21.15.52:0/2001821422 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec0b6ea0 con 0x7f2fd40052d0 2023-06-23T18:44:56.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.614+0000 7f2feaffd700 1 --2- 172.21.15.52:0/2001821422 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fd40052d0 0x7f2fec151080 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc001050 tx=0x7f2fdc00e740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.615+0000 7f2fd3fff700 1 -- 172.21.15.52:0/2001821422 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc00ee40 con 0x7f2fd40052d0 2023-06-23T18:44:56.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.615+0000 7f2fd3fff700 1 -- 172.21.15.52:0/2001821422 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fdc0052e0 con 0x7f2fd40052d0 2023-06-23T18:44:56.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.615+0000 7f2fd3fff700 1 -- 172.21.15.52:0/2001821422 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc003680 con 0x7f2fd40052d0 2023-06-23T18:44:56.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.615+0000 7f2ff1871700 1 -- 172.21.15.52:0/2001821422 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fec0b7460 con 0x7f2fd40052d0 2023-06-23T18:44:56.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.615+0000 7f2ff1871700 1 -- 172.21.15.52:0/2001821422 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fec0b70f0 con 0x7f2fd40052d0 2023-06-23T18:44:56.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.616+0000 7f2ff1871700 1 -- 172.21.15.52:0/2001821422 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2fec151f30 con 0x7f2fd40052d0 2023-06-23T18:44:56.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.617+0000 7f2fd3fff700 1 -- 172.21.15.52:0/2001821422 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2fdc0037e0 con 0x7f2fd40052d0 2023-06-23T18:44:56.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.618+0000 7f2fd3fff700 1 --2- 172.21.15.52:0/2001821422 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2fd806ace0 0x7f2fd806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.618+0000 7f2fd3fff700 1 -- 172.21.15.52:0/2001821422 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2fdc088f40 con 0x7f2fd40052d0 2023-06-23T18:44:56.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.618+0000 7f2fd3fff700 1 --2- 172.21.15.52:0/2001821422 >> [v2:172.21.15.52:6800/835073005,v1:172.21.15.52:6801/835073005] conn(0x7f2fd8073510 0x7f2fd8075920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.618+0000 7f2fea7fc700 1 --2- 172.21.15.52:0/2001821422 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2fd806ace0 0x7f2fd806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.618+0000 7f2fd3fff700 1 -- 172.21.15.52:0/2001821422 --> [v2:172.21.15.52:6800/835073005,v1:172.21.15.52:6801/835073005] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2fd8075fd0 con 0x7f2fd8073510 2023-06-23T18:44:56.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.618+0000 7f2fd3fff700 1 -- 172.21.15.52:0/2001821422 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2fdc089390 con 0x7f2fd40052d0 2023-06-23T18:44:56.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.618+0000 7f2fea7fc700 1 --2- 172.21.15.52:0/2001821422 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2fd806ace0 0x7f2fd806d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2fec1526a0 tx=0x7f2fe0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.616+0000 7f2afbfff700 1 -- 172.21.15.52:0/69936617 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2b0801a400 con 0x7f2b1406f0d0 2023-06-23T18:44:56.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.616+0000 7f2afbfff700 1 --2- 172.21.15.52:0/69936617 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2b0006ad10 0x7f2b0006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.616+0000 7f2afbfff700 1 -- 172.21.15.52:0/69936617 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2b080891d0 con 0x7f2b1406f0d0 2023-06-23T18:44:56.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.618+0000 7f2b12ffd700 1 --2- 172.21.15.52:0/69936617 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2b0006ad10 0x7f2b0006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.619+0000 7f2b12ffd700 1 --2- 172.21.15.52:0/69936617 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2b0006ad10 0x7f2b0006d1c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2b04009c40 tx=0x7f2b04008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.619+0000 7f1bb8b8d700 1 --2- 172.21.15.52:0/327244705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bb40ba370 0x7f1bb414b7e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1bac00ba80 tx=0x7f1bac00be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.621+0000 7f2feb7fe700 1 --2- 172.21.15.52:0/2001821422 >> [v2:172.21.15.52:6800/835073005,v1:172.21.15.52:6801/835073005] conn(0x7f2fd8073510 0x7f2fd8075920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.621+0000 7f2feb7fe700 1 --2- 172.21.15.52:0/2001821422 >> [v2:172.21.15.52:6800/835073005,v1:172.21.15.52:6801/835073005] conn(0x7f2fd8073510 0x7f2fd8075920 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.621+0000 7f1ba9ffb700 1 -- 172.21.15.52:0/327244705 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac00ca80 con 0x7f1bb40ba370 2023-06-23T18:44:56.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.621+0000 7f1ba9ffb700 1 -- 172.21.15.52:0/327244705 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bac00cc00 con 0x7f1bb40ba370 2023-06-23T18:44:56.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.621+0000 7f1ba9ffb700 1 -- 172.21.15.52:0/327244705 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac014440 con 0x7f1bb40ba370 2023-06-23T18:44:56.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.623+0000 7f2fd3fff700 1 -- 172.21.15.52:0/2001821422 <== osd.2 v2:172.21.15.52:6800/835073005 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2fd8075fd0 con 0x7f2fd8073510 2023-06-23T18:44:56.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.624+0000 7f0dd349c700 1 Processor -- start 2023-06-23T18:44:56.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.624+0000 7f0dd349c700 1 -- start start 2023-06-23T18:44:56.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.625+0000 7f0dd349c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0dcc070d80 0x7f0dcc152170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.625+0000 7f0dd349c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dcc0701a0 con 0x7f0dcc0b89e0 2023-06-23T18:44:56.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.625+0000 7f0dd349c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dcc140f20 con 0x7f0dcc06b0e0 2023-06-23T18:44:56.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.625+0000 7f0dd349c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dcc071540 con 0x7f0dcc070d80 2023-06-23T18:44:56.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.625+0000 7f0dd0a37700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0dcc0b89e0 0x7f0dcc149dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44790/0 (socket says 172.21.15.52:44790) 2023-06-23T18:44:56.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.625+0000 7f0dd0a37700 1 -- 172.21.15.52:0/688550878 learned_addr learned my addr 172.21.15.52:0/688550878 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:56.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.626+0000 7f0dd1a39700 1 --2- 172.21.15.52:0/688550878 >> v2:172.21.15.89:3300/0 conn(0x7f0dcc070d80 0x7f0dcc152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.626+0000 7f1bbb5f2700 1 -- 172.21.15.52:0/327244705 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bb414fd40 con 0x7f1bb40ba370 2023-06-23T18:44:56.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.626+0000 7f1bbb5f2700 1 -- 172.21.15.52:0/327244705 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb414cb70 con 0x7f1bb40ba370 2023-06-23T18:44:56.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.626+0000 7f0dc3fff700 1 -- 172.21.15.52:0/688550878 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2057080882 0 0) 0x7f0dcc140f20 con 0x7f0dcc06b0e0 2023-06-23T18:44:56.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.626+0000 7f0dc3fff700 1 -- 172.21.15.52:0/688550878 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0db80034d0 con 0x7f0dcc06b0e0 2023-06-23T18:44:56.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.626+0000 7f0dc3fff700 1 -- 172.21.15.52:0/688550878 <== mon.1 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3664009633 0 0) 0x7f0db80034d0 con 0x7f0dcc06b0e0 2023-06-23T18:44:56.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.626+0000 7f0dc3fff700 1 -- 172.21.15.52:0/688550878 >> v2:172.21.15.89:3300/0 conn(0x7f0dcc070d80 msgr2=0x7f0dcc152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:56.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.626+0000 7f0dc3fff700 1 --2- 172.21.15.52:0/688550878 >> v2:172.21.15.89:3300/0 conn(0x7f0dcc070d80 0x7f0dcc152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.626+0000 7f0dc3fff700 1 -- 172.21.15.52:0/688550878 >> v1:172.21.15.52:6789/0 conn(0x7f0dcc0b89e0 legacy=0x7f0dcc149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.626+0000 7f0dc3fff700 1 -- 172.21.15.52:0/688550878 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dcc0b8f00 con 0x7f0dcc06b0e0 2023-06-23T18:44:56.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.626+0000 7f0dc3fff700 1 -- 172.21.15.52:0/688550878 <== mon.1 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7f0dc8001670 con 0x7f0dcc06b0e0 2023-06-23T18:44:56.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.626+0000 7f0dc3fff700 1 -- 172.21.15.52:0/688550878 >> v1:172.21.15.89:6789/0 conn(0x7f0dcc06b0e0 legacy=0x7f0dcc140810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.626+0000 7f0dc3fff700 1 --2- 172.21.15.52:0/688550878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db8003af0 0x7f0db8003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.626+0000 7f0dc3fff700 1 --2- 172.21.15.52:0/688550878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0db8006720 0x7f0db8008ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.626+0000 7f0dc3fff700 1 --2- 172.21.15.52:0/688550878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db80093a0 0x7f0db8009840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.626+0000 7f0dc3fff700 1 -- 172.21.15.52:0/688550878 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db800a0f0 con 0x7f0db8006720 2023-06-23T18:44:56.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.627+0000 7f0dc3fff700 1 -- 172.21.15.52:0/688550878 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db800a260 con 0x7f0db8003af0 2023-06-23T18:44:56.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.627+0000 7f0dc3fff700 1 -- 172.21.15.52:0/688550878 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db800a420 con 0x7f0db80093a0 2023-06-23T18:44:56.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.627+0000 7f0dd1238700 1 --2- 172.21.15.52:0/688550878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db8003af0 0x7f0db8003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.627+0000 7f0dd1238700 1 -- 172.21.15.52:0/688550878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db80093a0 msgr2=0x7f0db8009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:56.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.627+0000 7f0dd1238700 1 --2- 172.21.15.52:0/688550878 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db80093a0 0x7f0db8009840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.627+0000 7f0dd1238700 1 -- 172.21.15.52:0/688550878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0db8006720 msgr2=0x7f0db8008ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:56.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.627+0000 7f0dd1238700 1 --2- 172.21.15.52:0/688550878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0db8006720 0x7f0db8008ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.627+0000 7f0dd1238700 1 -- 172.21.15.52:0/688550878 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dcc0b8f00 con 0x7f0db8003af0 2023-06-23T18:44:56.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.627+0000 7f0dd1a39700 1 -- 172.21.15.52:0/688550878 reap_dead start 2023-06-23T18:44:56.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.629+0000 7fe96b6e9700 1 -- 172.21.15.52:0/4083400539 --> [v2:172.21.15.52:6810/2360219751,v1:172.21.15.52:6813/2360219751] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe9640af7f0 con 0x7fe9480735e0 2023-06-23T18:44:56.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.628+0000 7f1ba9ffb700 1 -- 172.21.15.52:0/327244705 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1bac006d50 con 0x7f1bb40ba370 2023-06-23T18:44:56.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.628+0000 7f1ba9ffb700 1 --2- 172.21.15.52:0/327244705 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f1b9806ad30 0x7f1b9806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.629+0000 7f1ba9ffb700 1 -- 172.21.15.52:0/327244705 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1bac088f80 con 0x7f1bb40ba370 2023-06-23T18:44:56.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.629+0000 7f1bb938e700 1 --2- 172.21.15.52:0/327244705 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f1b9806ad30 0x7f1b9806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.627+0000 7f0dd1238700 1 --2- 172.21.15.52:0/688550878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db8003af0 0x7f0db8003f00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8001eb0 tx=0x7f0db8003780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33db5c8f3dc6e879 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.628+0000 7f0dc3fff700 1 -- 172.21.15.52:0/688550878 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc800cce0 con 0x7f0db8003af0 2023-06-23T18:44:56.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.628+0000 7f0dc3fff700 1 -- 172.21.15.52:0/688550878 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc800ce60 con 0x7f0db8003af0 2023-06-23T18:44:56.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.629+0000 7f1bb938e700 1 --2- 172.21.15.52:0/327244705 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f1b9806ad30 0x7f1b9806d1e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0001730 tx=0x7f1bb0007a40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.628+0000 7f0dc3fff700 1 -- 172.21.15.52:0/688550878 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8012660 con 0x7f0db8003af0 2023-06-23T18:44:56.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.630+0000 7f2b1986f700 1 --2- 172.21.15.52:0/69936617 >> [v2:172.21.15.89:6816/3890899288,v1:172.21.15.89:6817/3890899288] conn(0x7f2b140b1df0 0x7f2b141f0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.630+0000 7f2b1986f700 1 -- 172.21.15.52:0/69936617 --> [v2:172.21.15.89:6816/3890899288,v1:172.21.15.89:6817/3890899288] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b140b16c0 con 0x7f2b140b1df0 2023-06-23T18:44:56.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.630+0000 7f0dd349c700 1 -- 172.21.15.52:0/688550878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db8003af0 msgr2=0x7f0db8003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.630+0000 7f0dd349c700 1 --2- 172.21.15.52:0/688550878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db8003af0 0x7f0db8003f00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8001eb0 tx=0x7f0db8003780 comp rx=0 tx=0).stop 2023-06-23T18:44:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.631+0000 7f1bbb5f2700 1 --2- 172.21.15.52:0/327244705 >> [v2:172.21.15.52:6809/1066999520,v1:172.21.15.52:6812/1066999520] conn(0x7f1bb4148e60 0x7f1bb4146700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.631+0000 7f1bbb5f2700 1 -- 172.21.15.52:0/327244705 --> [v2:172.21.15.52:6809/1066999520,v1:172.21.15.52:6812/1066999520] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1bb40b8060 con 0x7f1bb4148e60 2023-06-23T18:44:56.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.633+0000 7f0dd349c700 1 -- 172.21.15.52:0/688550878 shutdown_connections 2023-06-23T18:44:56.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.633+0000 7f0dd349c700 1 --2- 172.21.15.52:0/688550878 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0db8003af0 0x7f0db8003f00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.633+0000 7f0dd349c700 1 -- 172.21.15.52:0/688550878 >> 172.21.15.52:0/688550878 conn(0x7f0dcc0bd690 msgr2=0x7f0dcc0b9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:56.686 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.633+0000 7f1bb9b8f700 1 --2- 172.21.15.52:0/327244705 >> [v2:172.21.15.52:6809/1066999520,v1:172.21.15.52:6812/1066999520] conn(0x7f1bb4148e60 0x7f1bb4146700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.633+0000 7fe959ffb700 1 -- 172.21.15.52:0/4083400539 <== osd.1 v2:172.21.15.52:6810/2360219751 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe95c008090 con 0x7fe9480735e0 2023-06-23T18:44:56.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.633+0000 7fea2044f700 1 -- 172.21.15.52:0/1965498210 --> [v2:172.21.15.89:6800/1683710352,v1:172.21.15.89:6801/1683710352] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fea1814ae70 con 0x7fe9fc0734e0 2023-06-23T18:44:56.687 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.633+0000 7f2b137fe700 1 --2- 172.21.15.52:0/69936617 >> [v2:172.21.15.89:6816/3890899288,v1:172.21.15.89:6817/3890899288] conn(0x7f2b140b1df0 0x7f2b141f0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.633+0000 7fea0effd700 1 -- 172.21.15.52:0/1965498210 <== osd.5 v2:172.21.15.89:6800/1683710352 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fea1814ae70 con 0x7fe9fc0734e0 2023-06-23T18:44:56.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.633+0000 7fe96b6e9700 1 -- 172.21.15.52:0/4083400539 >> [v2:172.21.15.52:6810/2360219751,v1:172.21.15.52:6813/2360219751] conn(0x7fe9480735e0 msgr2=0x7fe9480759f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.633+0000 7fe96b6e9700 1 --2- 172.21.15.52:0/4083400539 >> [v2:172.21.15.52:6810/2360219751,v1:172.21.15.52:6813/2360219751] conn(0x7fe9480735e0 0x7fe9480759f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.688 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.634+0000 7fe96b6e9700 1 -- 172.21.15.52:0/4083400539 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe94806ad30 msgr2=0x7fe94806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.634+0000 7f0dd349c700 1 -- 172.21.15.52:0/688550878 shutdown_connections 2023-06-23T18:44:56.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.634+0000 7fe96b6e9700 1 --2- 172.21.15.52:0/4083400539 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe94806ad30 0x7fe94806d1e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe9540096f0 tx=0x7fe954006c50 comp rx=0 tx=0).stop 2023-06-23T18:44:56.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.634+0000 7fe96b6e9700 1 -- 172.21.15.52:0/4083400539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe964071a80 msgr2=0x7fe9640b5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.634+0000 7fe96b6e9700 1 --2- 172.21.15.52:0/4083400539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe964071a80 0x7fe9640b5280 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe960009ea0 tx=0x7fe960004750 comp rx=0 tx=0).stop 2023-06-23T18:44:56.689 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.634+0000 7fe969c86700 1 -- 172.21.15.52:0/4083400539 reap_dead start 2023-06-23T18:44:56.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.634+0000 7f2b137fe700 1 --2- 172.21.15.52:0/69936617 >> [v2:172.21.15.89:6816/3890899288,v1:172.21.15.89:6817/3890899288] conn(0x7f2b140b1df0 0x7f2b141f0300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.690 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.634+0000 7f1bb9b8f700 1 --2- 172.21.15.52:0/327244705 >> [v2:172.21.15.52:6809/1066999520,v1:172.21.15.52:6812/1066999520] conn(0x7f1bb4148e60 0x7f1bb4146700 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.634+0000 7fea2044f700 1 -- 172.21.15.52:0/1965498210 >> [v2:172.21.15.89:6800/1683710352,v1:172.21.15.89:6801/1683710352] conn(0x7fe9fc0734e0 msgr2=0x7fe9fc0758f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.634+0000 7fea2044f700 1 --2- 172.21.15.52:0/1965498210 >> [v2:172.21.15.89:6800/1683710352,v1:172.21.15.89:6801/1683710352] conn(0x7fe9fc0734e0 0x7fe9fc0758f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.634+0000 7fea2044f700 1 -- 172.21.15.52:0/1965498210 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe9fc06acb0 msgr2=0x7fe9fc06d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.634+0000 7fea2044f700 1 --2- 172.21.15.52:0/1965498210 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe9fc06acb0 0x7fe9fc06d160 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fea181e4050 tx=0x7fea100015f0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.691 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.634+0000 7fea2044f700 1 -- 172.21.15.52:0/1965498210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea1806c1f0 msgr2=0x7fea1813d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.634+0000 7fea2044f700 1 --2- 172.21.15.52:0/1965498210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fea1806c1f0 0x7fea1813d9e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fea14000c00 tx=0x7fea14004750 comp rx=0 tx=0).stop 2023-06-23T18:44:56.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.634+0000 7fea1e9ec700 1 -- 172.21.15.52:0/1965498210 reap_dead start 2023-06-23T18:44:56.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.634+0000 7fea2044f700 1 -- 172.21.15.52:0/1965498210 shutdown_connections 2023-06-23T18:44:56.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.634+0000 7fea2044f700 1 -- 172.21.15.52:0/1965498210 >> 172.21.15.52:0/1965498210 conn(0x7fea180bdf30 msgr2=0x7fea180bbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:56.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.634+0000 7fea2044f700 1 -- 172.21.15.52:0/1965498210 shutdown_connections 2023-06-23T18:44:56.692 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.635+0000 7fea2044f700 1 -- 172.21.15.52:0/1965498210 wait complete. 2023-06-23T18:44:56.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.635+0000 7f1ba9ffb700 1 -- 172.21.15.52:0/327244705 <== osd.0 v2:172.21.15.52:6809/1066999520 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1ba4004030 con 0x7f1bb4148e60 2023-06-23T18:44:56.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.636+0000 7f0d815de700 1 -- 172.21.15.52:0/1836227544 --> [v2:172.21.15.89:6824/2989085420,v1:172.21.15.89:6825/2989085420] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0d7c0b87f0 con 0x7f0d680734c0 2023-06-23T18:44:56.693 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.637+0000 7f2afbfff700 1 -- 172.21.15.52:0/69936617 <== osd.6 v2:172.21.15.89:6816/3890899288 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2b140b16c0 con 0x7f2b140b1df0 2023-06-23T18:44:56.694 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.637+0000 7f0d637fe700 1 -- 172.21.15.52:0/1836227544 <== osd.7 v2:172.21.15.89:6824/2989085420 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0d74009bf0 con 0x7f0d680734c0 2023-06-23T18:44:56.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.638+0000 7f0d815de700 1 -- 172.21.15.52:0/1836227544 >> [v2:172.21.15.89:6824/2989085420,v1:172.21.15.89:6825/2989085420] conn(0x7f0d680734c0 msgr2=0x7f0d680758d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.638+0000 7f0d815de700 1 --2- 172.21.15.52:0/1836227544 >> [v2:172.21.15.89:6824/2989085420,v1:172.21.15.89:6825/2989085420] conn(0x7f0d680734c0 0x7f0d680758d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.638+0000 7f0d815de700 1 -- 172.21.15.52:0/1836227544 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0d6806ad10 msgr2=0x7f0d6806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.638+0000 7f0d815de700 1 --2- 172.21.15.52:0/1836227544 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0d6806ad10 0x7f0d6806d1c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0d700017f0 tx=0x7f0d70009040 comp rx=0 tx=0).stop 2023-06-23T18:44:56.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.638+0000 7f0d815de700 1 -- 172.21.15.52:0/1836227544 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d7c0b3570 msgr2=0x7f0d7c1dba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.695 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.638+0000 7f0d815de700 1 --2- 172.21.15.52:0/1836227544 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d7c0b3570 0x7f0d7c1dba00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00d000 tx=0x7f0d6c004750 comp rx=0 tx=0).stop 2023-06-23T18:44:56.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.638+0000 7f0d7b7fe700 1 -- 172.21.15.52:0/1836227544 reap_dead start 2023-06-23T18:44:56.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.640+0000 7f0d815de700 1 -- 172.21.15.52:0/1836227544 shutdown_connections 2023-06-23T18:44:56.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.640+0000 7f0d815de700 1 -- 172.21.15.52:0/1836227544 >> 172.21.15.52:0/1836227544 conn(0x7f0d7c0bc170 msgr2=0x7f0d7c0b73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:56.696 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.643+0000 7f834fe95700 1 -- 172.21.15.52:0/2632684494 --> [v2:172.21.15.89:6808/2538664679,v1:172.21.15.89:6809/2538664679] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8330002d30 con 0x7f832c073660 2023-06-23T18:44:56.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.643+0000 7f0d815de700 1 -- 172.21.15.52:0/1836227544 shutdown_connections 2023-06-23T18:44:56.697 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.643+0000 7f0d815de700 1 -- 172.21.15.52:0/1836227544 wait complete. 2023-06-23T18:44:56.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.636+0000 7f0dd349c700 1 -- 172.21.15.52:0/688550878 wait complete. 2023-06-23T18:44:56.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.638+0000 7f0dd349c700 1 Processor -- start 2023-06-23T18:44:56.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.638+0000 7f0dd349c700 1 -- start start 2023-06-23T18:44:56.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.639+0000 7f0dd349c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db8003af0 0x7f0dcc084910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.639+0000 7f0dd349c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dcc088950 0x7f0dcc0bbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.639+0000 7f0dd349c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dcc131710 0x7f0dcc131b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.698 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.639+0000 7f0dd349c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc0bc250 con 0x7f0dcc131710 2023-06-23T18:44:56.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.639+0000 7f0dd349c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc0858d0 con 0x7f0dcc088950 2023-06-23T18:44:56.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.639+0000 7f0dd349c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc088dc0 con 0x7f0db8003af0 2023-06-23T18:44:56.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.640+0000 7f0dd1238700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db8003af0 0x7f0dcc084910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.640+0000 7f0dd1238700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db8003af0 0x7f0dcc084910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.52:48978/0 (socket says 172.21.15.52:48978) 2023-06-23T18:44:56.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.640+0000 7f0dd1238700 1 -- 172.21.15.52:0/914715039 learned_addr learned my addr 172.21.15.52:0/914715039 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:56.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.640+0000 7f0dd1238700 1 -- 172.21.15.52:0/914715039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dcc088950 msgr2=0x7f0dcc0bbd10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-23T18:44:56.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.640+0000 7f0dd1238700 1 --2- 172.21.15.52:0/914715039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dcc088950 0x7f0dcc0bbd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.640+0000 7f0dd1238700 1 -- 172.21.15.52:0/914715039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dcc131710 msgr2=0x7f0dcc131b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.640+0000 7f0dd1238700 1 --2- 172.21.15.52:0/914715039 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dcc131710 0x7f0dcc131b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.640+0000 7f0dd1238700 1 -- 172.21.15.52:0/914715039 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dcc0bc770 con 0x7f0db8003af0 2023-06-23T18:44:56.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.640+0000 7f0dd1238700 1 --2- 172.21.15.52:0/914715039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db8003af0 0x7f0dcc084910 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0db800a3f0 tx=0x7f0dc8001930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.641+0000 7f0dc1ffb700 1 -- 172.21.15.52:0/914715039 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc80054e0 con 0x7f0db8003af0 2023-06-23T18:44:56.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.641+0000 7f0dc1ffb700 1 -- 172.21.15.52:0/914715039 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc8003680 con 0x7f0db8003af0 2023-06-23T18:44:56.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.641+0000 7f0dd349c700 1 -- 172.21.15.52:0/914715039 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dcc089d10 con 0x7f0db8003af0 2023-06-23T18:44:56.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.641+0000 7f0dc1ffb700 1 -- 172.21.15.52:0/914715039 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8003a30 con 0x7f0db8003af0 2023-06-23T18:44:56.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.641+0000 7f0dd349c700 1 -- 172.21.15.52:0/914715039 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dcc088170 con 0x7f0db8003af0 2023-06-23T18:44:56.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.642+0000 7f0dd349c700 1 -- 172.21.15.52:0/914715039 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0dcc06fe30 con 0x7f0db8003af0 2023-06-23T18:44:56.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.644+0000 7f0dc1ffb700 1 -- 172.21.15.52:0/914715039 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0dc8022070 con 0x7f0db8003af0 2023-06-23T18:44:56.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.644+0000 7f0dc1ffb700 1 --2- 172.21.15.52:0/914715039 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0db006ace0 0x7f0db006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.644+0000 7f0dc1ffb700 1 -- 172.21.15.52:0/914715039 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0dc808aa60 con 0x7f0db8003af0 2023-06-23T18:44:56.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.644+0000 7f0dc1ffb700 1 --2- 172.21.15.52:0/914715039 >> [v2:172.21.15.52:6808/2852700864,v1:172.21.15.52:6811/2852700864] conn(0x7f0db0073510 0x7f0db0075920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.644+0000 7f0dc1ffb700 1 -- 172.21.15.52:0/914715039 --> [v2:172.21.15.52:6808/2852700864,v1:172.21.15.52:6811/2852700864] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0db0075fd0 con 0x7f0db0073510 2023-06-23T18:44:56.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.644+0000 7f0dc1ffb700 1 -- 172.21.15.52:0/914715039 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0dc808ae80 con 0x7f0db8003af0 2023-06-23T18:44:56.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.645+0000 7f833e7fc700 1 -- 172.21.15.52:0/2632684494 <== osd.4 v2:172.21.15.89:6808/2538664679 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8330002d30 con 0x7f832c073660 2023-06-23T18:44:56.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.645+0000 7f0dd0a37700 1 --2- 172.21.15.52:0/914715039 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0db006ace0 0x7f0db006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.645+0000 7f0dd1a39700 1 --2- 172.21.15.52:0/914715039 >> [v2:172.21.15.52:6808/2852700864,v1:172.21.15.52:6811/2852700864] conn(0x7f0db0073510 0x7f0db0075920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.645+0000 7f0dd0a37700 1 --2- 172.21.15.52:0/914715039 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0db006ace0 0x7f0db006d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc069250 tx=0x7f0dbc007a50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.645+0000 7f0dd1a39700 1 --2- 172.21.15.52:0/914715039 >> [v2:172.21.15.52:6808/2852700864,v1:172.21.15.52:6811/2852700864] conn(0x7f0db0073510 0x7f0db0075920 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.646+0000 7f834fe95700 1 -- 172.21.15.52:0/2632684494 >> [v2:172.21.15.89:6808/2538664679,v1:172.21.15.89:6809/2538664679] conn(0x7f832c073660 msgr2=0x7f832c075a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.646+0000 7f834fe95700 1 --2- 172.21.15.52:0/2632684494 >> [v2:172.21.15.89:6808/2538664679,v1:172.21.15.89:6809/2538664679] conn(0x7f832c073660 0x7f832c075a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.646+0000 7f834fe95700 1 -- 172.21.15.52:0/2632684494 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f832c06adb0 msgr2=0x7f832c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.646+0000 7f834fe95700 1 --2- 172.21.15.52:0/2632684494 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f832c06adb0 0x7f832c06d260 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f834000b370 tx=0x7f8340009000 comp rx=0 tx=0).stop 2023-06-23T18:44:56.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.646+0000 7f834fe95700 1 -- 172.21.15.52:0/2632684494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8348071920 msgr2=0x7f83480b5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.646+0000 7f834fe95700 1 --2- 172.21.15.52:0/2632684494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8348071920 0x7f83480b5340 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f834400c3e0 tx=0x7f834400c6f0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.646+0000 7f834e432700 1 -- 172.21.15.52:0/2632684494 reap_dead start 2023-06-23T18:44:56.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.646+0000 7f0dc1ffb700 1 -- 172.21.15.52:0/914715039 <== osd.3 v2:172.21.15.52:6808/2852700864 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0db0075fd0 con 0x7f0db0073510 2023-06-23T18:44:56.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.647+0000 7f834fe95700 1 -- 172.21.15.52:0/2632684494 shutdown_connections 2023-06-23T18:44:56.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.647+0000 7f834fe95700 1 -- 172.21.15.52:0/2632684494 >> 172.21.15.52:0/2632684494 conn(0x7f83480bc170 msgr2=0x7f83480ba5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:56.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.647+0000 7f834fe95700 1 -- 172.21.15.52:0/2632684494 shutdown_connections 2023-06-23T18:44:56.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.647+0000 7f834fe95700 1 -- 172.21.15.52:0/2632684494 wait complete. 2023-06-23T18:44:56.706 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.654+0000 7fe96b6e9700 1 -- 172.21.15.52:0/4083400539 shutdown_connections 2023-06-23T18:44:56.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.654+0000 7fe96b6e9700 1 -- 172.21.15.52:0/4083400539 >> 172.21.15.52:0/4083400539 conn(0x7fe9640bc170 msgr2=0x7fe96406a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:56.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.654+0000 7f2ff1871700 1 -- 172.21.15.52:0/2001821422 --> [v2:172.21.15.52:6800/835073005,v1:172.21.15.52:6801/835073005] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2fec14dd70 con 0x7f2fd8073510 2023-06-23T18:44:56.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.655+0000 7f2fd3fff700 1 -- 172.21.15.52:0/2001821422 <== osd.2 v2:172.21.15.52:6800/835073005 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2fec14dd70 con 0x7f2fd8073510 2023-06-23T18:44:56.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.655+0000 7f2ff1871700 1 -- 172.21.15.52:0/2001821422 >> [v2:172.21.15.52:6800/835073005,v1:172.21.15.52:6801/835073005] conn(0x7f2fd8073510 msgr2=0x7f2fd8075920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.655+0000 7f2ff1871700 1 --2- 172.21.15.52:0/2001821422 >> [v2:172.21.15.52:6800/835073005,v1:172.21.15.52:6801/835073005] conn(0x7f2fd8073510 0x7f2fd8075920 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.656+0000 7f2ff1871700 1 -- 172.21.15.52:0/2001821422 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2fd806ace0 msgr2=0x7f2fd806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.656+0000 7f2ff1871700 1 --2- 172.21.15.52:0/2001821422 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2fd806ace0 0x7f2fd806d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2fec1526a0 tx=0x7f2fe0008040 comp rx=0 tx=0).stop 2023-06-23T18:44:56.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.656+0000 7f2ff1871700 1 -- 172.21.15.52:0/2001821422 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fd40052d0 msgr2=0x7f2fec151080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.656+0000 7f2ff1871700 1 --2- 172.21.15.52:0/2001821422 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fd40052d0 0x7f2fec151080 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc001050 tx=0x7f2fdc00e740 comp rx=0 tx=0).stop 2023-06-23T18:44:56.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.656+0000 7f2feb7fe700 1 -- 172.21.15.52:0/2001821422 reap_dead start 2023-06-23T18:44:56.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.656+0000 7f2ff1871700 1 -- 172.21.15.52:0/2001821422 shutdown_connections 2023-06-23T18:44:56.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.656+0000 7f2ff1871700 1 -- 172.21.15.52:0/2001821422 >> 172.21.15.52:0/2001821422 conn(0x7f2fec0bdf30 msgr2=0x7f2fec0700e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:56.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.656+0000 7f2ff1871700 1 -- 172.21.15.52:0/2001821422 shutdown_connections 2023-06-23T18:44:56.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.656+0000 7f2ff1871700 1 -- 172.21.15.52:0/2001821422 wait complete. 2023-06-23T18:44:56.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.657+0000 7f2b1986f700 1 -- 172.21.15.52:0/69936617 --> [v2:172.21.15.89:6816/3890899288,v1:172.21.15.89:6817/3890899288] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2b1404e1d0 con 0x7f2b140b1df0 2023-06-23T18:44:56.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.659+0000 7fe96b6e9700 1 -- 172.21.15.52:0/4083400539 shutdown_connections 2023-06-23T18:44:56.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.659+0000 7fe96b6e9700 1 -- 172.21.15.52:0/4083400539 wait complete. 2023-06-23T18:44:56.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.661+0000 7f2afbfff700 1 -- 172.21.15.52:0/69936617 <== osd.6 v2:172.21.15.89:6816/3890899288 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2b1404e1d0 con 0x7f2b140b1df0 2023-06-23T18:44:56.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.661+0000 7f1bbb5f2700 1 -- 172.21.15.52:0/327244705 --> [v2:172.21.15.52:6809/1066999520,v1:172.21.15.52:6812/1066999520] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1bb40b65b0 con 0x7f1bb4148e60 2023-06-23T18:44:56.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.662+0000 7f1ba9ffb700 1 -- 172.21.15.52:0/327244705 <== osd.0 v2:172.21.15.52:6809/1066999520 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1bb40b65b0 con 0x7f1bb4148e60 2023-06-23T18:44:56.713 INFO:teuthology.orchestra.run.smithi052.stdout:55834574853 2023-06-23T18:44:56.713 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-23T18:44:56.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.665+0000 7f1bbb5f2700 1 -- 172.21.15.52:0/327244705 >> [v2:172.21.15.52:6809/1066999520,v1:172.21.15.52:6812/1066999520] conn(0x7f1bb4148e60 msgr2=0x7f1bb4146700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.665+0000 7f1bbb5f2700 1 --2- 172.21.15.52:0/327244705 >> [v2:172.21.15.52:6809/1066999520,v1:172.21.15.52:6812/1066999520] conn(0x7f1bb4148e60 0x7f1bb4146700 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.714 INFO:teuthology.orchestra.run.smithi052.stdout:55834574852 2023-06-23T18:44:56.715 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-23T18:44:56.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.666+0000 7f1bbb5f2700 1 -- 172.21.15.52:0/327244705 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f1b9806ad30 msgr2=0x7f1b9806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.666+0000 7f1bbb5f2700 1 --2- 172.21.15.52:0/327244705 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f1b9806ad30 0x7f1b9806d1e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0001730 tx=0x7f1bb0007a40 comp rx=0 tx=0).stop 2023-06-23T18:44:56.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.666+0000 7f1bbb5f2700 1 -- 172.21.15.52:0/327244705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bb40ba370 msgr2=0x7f1bb414b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.666+0000 7f1bbb5f2700 1 --2- 172.21.15.52:0/327244705 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bb40ba370 0x7f1bb414b7e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1bac00ba80 tx=0x7f1bac00be40 comp rx=0 tx=0).stop 2023-06-23T18:44:56.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.666+0000 7f1bb9b8f700 1 -- 172.21.15.52:0/327244705 reap_dead start 2023-06-23T18:44:56.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.666+0000 7f0dd349c700 1 -- 172.21.15.52:0/914715039 --> [v2:172.21.15.52:6808/2852700864,v1:172.21.15.52:6811/2852700864] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0dcc0b91e0 con 0x7f0db0073510 2023-06-23T18:44:56.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.666+0000 7f2b1986f700 1 -- 172.21.15.52:0/69936617 >> [v2:172.21.15.89:6816/3890899288,v1:172.21.15.89:6817/3890899288] conn(0x7f2b140b1df0 msgr2=0x7f2b141f0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.666+0000 7f2b1986f700 1 --2- 172.21.15.52:0/69936617 >> [v2:172.21.15.89:6816/3890899288,v1:172.21.15.89:6817/3890899288] conn(0x7f2b140b1df0 0x7f2b141f0300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.666+0000 7f1bbb5f2700 1 -- 172.21.15.52:0/327244705 shutdown_connections 2023-06-23T18:44:56.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.666+0000 7f1bbb5f2700 1 -- 172.21.15.52:0/327244705 >> 172.21.15.52:0/327244705 conn(0x7f1bb406c820 msgr2=0x7f1bb40bf370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:56.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.666+0000 7f2b1986f700 1 -- 172.21.15.52:0/69936617 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2b0006ad10 msgr2=0x7f2b0006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.666+0000 7f2b1986f700 1 --2- 172.21.15.52:0/69936617 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2b0006ad10 0x7f2b0006d1c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2b04009c40 tx=0x7f2b04008030 comp rx=0 tx=0).stop 2023-06-23T18:44:56.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.666+0000 7f2b1986f700 1 -- 172.21.15.52:0/69936617 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b1406f0d0 msgr2=0x7f2b140b18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.666+0000 7f2b1986f700 1 --2- 172.21.15.52:0/69936617 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2b1406f0d0 0x7f2b140b18b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2b0800b4a0 tx=0x7f2b0800b860 comp rx=0 tx=0).stop 2023-06-23T18:44:56.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.666+0000 7f2b137fe700 1 -- 172.21.15.52:0/69936617 reap_dead start 2023-06-23T18:44:56.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.667+0000 7f2b1986f700 1 -- 172.21.15.52:0/69936617 shutdown_connections 2023-06-23T18:44:56.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.667+0000 7f2b1986f700 1 -- 172.21.15.52:0/69936617 >> 172.21.15.52:0/69936617 conn(0x7f2b140bc170 msgr2=0x7f2b14142920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:56.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.667+0000 7f0dc1ffb700 1 -- 172.21.15.52:0/914715039 <== osd.3 v2:172.21.15.52:6808/2852700864 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0dc400f040 con 0x7f0db0073510 2023-06-23T18:44:56.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.667+0000 7f0dd349c700 1 -- 172.21.15.52:0/914715039 >> [v2:172.21.15.52:6808/2852700864,v1:172.21.15.52:6811/2852700864] conn(0x7f0db0073510 msgr2=0x7f0db0075920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.667+0000 7f0dd349c700 1 --2- 172.21.15.52:0/914715039 >> [v2:172.21.15.52:6808/2852700864,v1:172.21.15.52:6811/2852700864] conn(0x7f0db0073510 0x7f0db0075920 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.667+0000 7f0dd349c700 1 -- 172.21.15.52:0/914715039 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0db006ace0 msgr2=0x7f0db006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.667+0000 7f0dd349c700 1 --2- 172.21.15.52:0/914715039 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0db006ace0 0x7f0db006d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc069250 tx=0x7f0dbc007a50 comp rx=0 tx=0).stop 2023-06-23T18:44:56.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.667+0000 7f0dd349c700 1 -- 172.21.15.52:0/914715039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db8003af0 msgr2=0x7f0dcc084910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.667+0000 7f0dd349c700 1 --2- 172.21.15.52:0/914715039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0db8003af0 0x7f0dcc084910 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0db800a3f0 tx=0x7f0dc8001930 comp rx=0 tx=0).stop 2023-06-23T18:44:56.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.667+0000 7f0dd1a39700 1 -- 172.21.15.52:0/914715039 reap_dead start 2023-06-23T18:44:56.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.667+0000 7f0dd349c700 1 -- 172.21.15.52:0/914715039 shutdown_connections 2023-06-23T18:44:56.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.667+0000 7f0dd349c700 1 -- 172.21.15.52:0/914715039 >> 172.21.15.52:0/914715039 conn(0x7f0dcc0bd690 msgr2=0x7f0dcc0664d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:56.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.667+0000 7f0dd349c700 1 -- 172.21.15.52:0/914715039 shutdown_connections 2023-06-23T18:44:56.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.667+0000 7f0dd349c700 1 -- 172.21.15.52:0/914715039 wait complete. 2023-06-23T18:44:56.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.669+0000 7f1bbb5f2700 1 -- 172.21.15.52:0/327244705 shutdown_connections 2023-06-23T18:44:56.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.669+0000 7f2b1986f700 1 -- 172.21.15.52:0/69936617 shutdown_connections 2023-06-23T18:44:56.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.669+0000 7f1bbb5f2700 1 -- 172.21.15.52:0/327244705 wait complete. 2023-06-23T18:44:56.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.670+0000 7f2b1986f700 1 -- 172.21.15.52:0/69936617 wait complete. 2023-06-23T18:44:56.723 INFO:teuthology.orchestra.run.smithi052.stdout:55834574852 2023-06-23T18:44:56.723 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-23T18:44:56.724 INFO:teuthology.orchestra.run.smithi052.stdout:55834574855 2023-06-23T18:44:56.724 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-23T18:44:56.725 INFO:teuthology.orchestra.run.smithi052.stdout:55834574853 2023-06-23T18:44:56.726 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-23T18:44:56.727 INFO:teuthology.orchestra.run.smithi052.stdout:55834574853 2023-06-23T18:44:56.727 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-23T18:44:56.728 INFO:teuthology.orchestra.run.smithi052.stdout:55834574853 2023-06-23T18:44:56.728 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-23T18:44:56.729 INFO:teuthology.orchestra.run.smithi052.stdout:55834574853 2023-06-23T18:44:56.729 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-23T18:44:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.967+0000 7f22a88c9700 1 Processor -- start 2023-06-23T18:44:56.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.967+0000 7f22a88c9700 1 -- start start 2023-06-23T18:44:56.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.968+0000 7f22a88c9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22a4071a80 0x7f22a4143b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.968+0000 7f22a88c9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f22a406f930 0x7f22a406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.968+0000 7f22a88c9700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a40716f0 con 0x7f22a40bcc50 2023-06-23T18:44:56.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.968+0000 7f22a88c9700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a4071f60 con 0x7f22a406f930 2023-06-23T18:44:56.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.968+0000 7f22a88c9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a406f4a0 con 0x7f22a4071a80 2023-06-23T18:44:56.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.969+0000 7f22a1d9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f22a40bcc50 0x7f22a41464c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44792/0 (socket says 172.21.15.52:44792) 2023-06-23T18:44:56.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.969+0000 7f22a1d9b700 1 -- 172.21.15.52:0/2926356225 learned_addr learned my addr 172.21.15.52:0/2926356225 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:56.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.969+0000 7f22a2d9d700 1 --2- 172.21.15.52:0/2926356225 >> v2:172.21.15.89:3300/0 conn(0x7f22a406f930 0x7f22a406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.969+0000 7f22a259c700 1 --2- 172.21.15.52:0/2926356225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22a4071a80 0x7f22a4143b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.969+0000 7f22a159a700 1 -- 172.21.15.52:0/2926356225 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 878796055 0 0) 0x7f22a40716f0 con 0x7f22a40bcc50 2023-06-23T18:44:56.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.969+0000 7f22a159a700 1 -- 172.21.15.52:0/2926356225 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f228c0035b0 con 0x7f22a40bcc50 2023-06-23T18:44:56.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.970+0000 7f22a2d9d700 1 -- 172.21.15.52:0/2926356225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22a4071a80 msgr2=0x7f22a4143b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:56.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.970+0000 7f22a2d9d700 1 --2- 172.21.15.52:0/2926356225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22a4071a80 0x7f22a4143b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.970+0000 7f22a2d9d700 1 -- 172.21.15.52:0/2926356225 >> v1:172.21.15.52:6789/0 conn(0x7f22a40bcc50 legacy=0x7f22a41464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.970+0000 7f22a2d9d700 1 -- 172.21.15.52:0/2926356225 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a40af7f0 con 0x7f22a406f930 2023-06-23T18:44:56.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.970+0000 7f22a2d9d700 1 --2- 172.21.15.52:0/2926356225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22a406f930 0x7f22a406fdb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f229c009e10 tx=0x7f229c00d540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a3798ec4753f8e1 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.970+0000 7f22a159a700 1 -- 172.21.15.52:0/2926356225 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c011460 con 0x7f22a406f930 2023-06-23T18:44:56.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.970+0000 7f22a159a700 1 -- 172.21.15.52:0/2926356225 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229c0115c0 con 0x7f22a406f930 2023-06-23T18:44:56.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.970+0000 7f22a159a700 1 -- 172.21.15.52:0/2926356225 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c011970 con 0x7f22a406f930 2023-06-23T18:44:56.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.972+0000 7f22a88c9700 1 -- 172.21.15.52:0/2926356225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22a406f930 msgr2=0x7f22a406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.972+0000 7f22a88c9700 1 --2- 172.21.15.52:0/2926356225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22a406f930 0x7f22a406fdb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f229c009e10 tx=0x7f229c00d540 comp rx=0 tx=0).stop 2023-06-23T18:44:56.977 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.972+0000 7f4c0bb08700 1 Processor -- start 2023-06-23T18:44:56.978 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.972+0000 7f4c0bb08700 1 -- start start 2023-06-23T18:44:56.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.973+0000 7f4c0bb08700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4c0406f400 0x7f4c04151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.973+0000 7f4c0bb08700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4c04152300 0x7f4c04159130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.973+0000 7f4c0bb08700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c040700f0 con 0x7f4c04148c20 2023-06-23T18:44:56.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.973+0000 7f4c0bb08700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c040705b0 con 0x7f4c04152300 2023-06-23T18:44:56.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.973+0000 7f4c0bb08700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c04152740 con 0x7f4c0406f400 2023-06-23T18:44:56.979 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.974+0000 7f4c090a3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4c0406f400 0x7f4c04151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.974+0000 7f4c090a3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4c0406f400 0x7f4c04151dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.52:59064/0 (socket says 172.21.15.52:59064) 2023-06-23T18:44:56.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.974+0000 7f4c090a3700 1 -- 172.21.15.52:0/4039882955 learned_addr learned my addr 172.21.15.52:0/4039882955 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:56.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.974+0000 7f4c0a0a5700 1 --2- 172.21.15.52:0/4039882955 >> v2:172.21.15.52:3300/0 conn(0x7f4c04152300 0x7f4c04159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.974+0000 7f4c090a3700 1 -- 172.21.15.52:0/4039882955 >> v2:172.21.15.52:3300/0 conn(0x7f4c04152300 msgr2=0x7f4c04159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:56.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.974+0000 7f4c090a3700 1 --2- 172.21.15.52:0/4039882955 >> v2:172.21.15.52:3300/0 conn(0x7f4c04152300 0x7f4c04159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.974+0000 7f4c090a3700 1 -- 172.21.15.52:0/4039882955 >> v1:172.21.15.89:6789/0 conn(0x7f4c04148c20 legacy=0x7f4c04071620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:56.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.974+0000 7f4c090a3700 1 -- 172.21.15.52:0/4039882955 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c040b83e0 con 0x7f4c0406f400 2023-06-23T18:44:56.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.974+0000 7f4c090a3700 1 --2- 172.21.15.52:0/4039882955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c0406f400 0x7f4c04151dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4c040bd240 tx=0x7f4c00009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57cf426ef0e961c1 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.974+0000 7f4c088a2700 1 -- 172.21.15.52:0/4039882955 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c00004230 con 0x7f4c0406f400 2023-06-23T18:44:56.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.975+0000 7f22a88c9700 1 -- 172.21.15.52:0/2926356225 shutdown_connections 2023-06-23T18:44:56.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.975+0000 7f22a88c9700 1 --2- 172.21.15.52:0/2926356225 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22a406f930 0x7f22a406fdb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.975+0000 7f22a88c9700 1 --2- 172.21.15.52:0/2926356225 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22a4071a80 0x7f22a4143b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.982 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.975+0000 7f22a88c9700 1 -- 172.21.15.52:0/2926356225 >> 172.21.15.52:0/2926356225 conn(0x7f22a40bc170 msgr2=0x7f22a40bc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:56.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.975+0000 7f4c088a2700 1 -- 172.21.15.52:0/4039882955 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c00004390 con 0x7f4c0406f400 2023-06-23T18:44:56.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.975+0000 7f4c088a2700 1 -- 172.21.15.52:0/4039882955 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c000036a0 con 0x7f4c0406f400 2023-06-23T18:44:56.983 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.975+0000 7f9270e10700 1 Processor -- start 2023-06-23T18:44:56.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.975+0000 7f9270e10700 1 -- start start 2023-06-23T18:44:56.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.975+0000 7f4c0bb08700 1 -- 172.21.15.52:0/4039882955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c0406f400 msgr2=0x7f4c04151dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.984 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.975+0000 7f4c0bb08700 1 --2- 172.21.15.52:0/4039882955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c0406f400 0x7f4c04151dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4c040bd240 tx=0x7f4c00009bd0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.975+0000 7f4c0bb08700 1 -- 172.21.15.52:0/4039882955 shutdown_connections 2023-06-23T18:44:56.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.975+0000 7f4c0bb08700 1 --2- 172.21.15.52:0/4039882955 >> v2:172.21.15.52:3300/0 conn(0x7f4c04152300 0x7f4c04159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.975+0000 7f4c0bb08700 1 --2- 172.21.15.52:0/4039882955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c0406f400 0x7f4c04151dc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.975+0000 7f4c0bb08700 1 -- 172.21.15.52:0/4039882955 >> 172.21.15.52:0/4039882955 conn(0x7f4c040bc170 msgr2=0x7f4c040bc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:56.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.976+0000 7f4c0bb08700 1 -- 172.21.15.52:0/4039882955 shutdown_connections 2023-06-23T18:44:56.985 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.976+0000 7f4c0bb08700 1 -- 172.21.15.52:0/4039882955 wait complete. 2023-06-23T18:44:56.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.976+0000 7fefbe04c700 1 Processor -- start 2023-06-23T18:44:56.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.976+0000 7fefbe04c700 1 -- start start 2023-06-23T18:44:56.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.976+0000 7f9270e10700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f926c0b6af0 0x7f926c1484c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.977+0000 7f926a59c700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f926c0714c0 0x7f926c145480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.52:53386/0 (socket says 172.21.15.52:53386) 2023-06-23T18:44:56.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.977+0000 7f8132cb9700 1 Processor -- start 2023-06-23T18:44:56.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.977+0000 7f9269d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f926c0b6af0 0x7f926c1484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.977+0000 7f9269d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f926c0b6af0 0x7f926c1484c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:51974/0 (socket says 172.21.15.52:51974) 2023-06-23T18:44:56.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.977+0000 7fefbe04c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefb80bda10 0x7fefb80b7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.977+0000 7f8132cb9700 1 -- start start 2023-06-23T18:44:56.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.977+0000 7fefbe04c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fefb80b6f10 0x7fefb80ba370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.977+0000 7fefbe04c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb80b60f0 con 0x7fefb80b6ae0 2023-06-23T18:44:56.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.977+0000 7fefbe04c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb80b5e10 con 0x7fefb80b6f10 2023-06-23T18:44:56.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.977+0000 7fefbe04c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb80b65c0 con 0x7fefb80bda10 2023-06-23T18:44:56.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.977+0000 7f4c0bb08700 1 Processor -- start 2023-06-23T18:44:56.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.977+0000 7fefb6ffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fefb80b6ae0 0x7fefb80b9c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44794/0 (socket says 172.21.15.52:44794) 2023-06-23T18:44:56.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.977+0000 7fefb6ffd700 1 -- 172.21.15.52:0/3405880084 learned_addr learned my addr 172.21.15.52:0/3405880084 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:56.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.977+0000 7fefb77fe700 1 --2- 172.21.15.52:0/3405880084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefb80bda10 0x7fefb80b7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.978+0000 7f22a88c9700 1 -- 172.21.15.52:0/2926356225 shutdown_connections 2023-06-23T18:44:56.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.977+0000 7f4c0bb08700 1 -- start start 2023-06-23T18:44:56.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.978+0000 7fefb77fe700 1 -- 172.21.15.52:0/3405880084 >> v2:172.21.15.52:3300/0 conn(0x7fefb80b6f10 msgr2=0x7fefb80ba370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:56.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.978+0000 7fefb77fe700 1 --2- 172.21.15.52:0/3405880084 >> v2:172.21.15.52:3300/0 conn(0x7fefb80b6f10 0x7fefb80ba370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.978+0000 7fefb77fe700 1 -- 172.21.15.52:0/3405880084 >> v1:172.21.15.52:6789/0 conn(0x7fefb80b6ae0 legacy=0x7fefb80b9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.978+0000 7fefb77fe700 1 -- 172.21.15.52:0/3405880084 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb80a6110 con 0x7fefb80bda10 2023-06-23T18:44:56.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.978+0000 7f22a88c9700 1 -- 172.21.15.52:0/2926356225 wait complete. 2023-06-23T18:44:56.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.978+0000 7f8132cb9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f812c0bcc50 0x7f812c143b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.978+0000 7f8132cb9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f812c06f930 0x7f812c06fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.978+0000 7f8132cb9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f812c0716f0 con 0x7f812c071a80 2023-06-23T18:44:56.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.978+0000 7f8132cb9700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812c071f60 con 0x7f812c0bcc50 2023-06-23T18:44:56.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.978+0000 7f8132cb9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812c06f4a0 con 0x7f812c06f930 2023-06-23T18:44:56.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.978+0000 7f4c0bb08700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c0406f400 0x7f4c0414b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.978+0000 7f4c0bb08700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c04148c20 0x7f4c04145df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.978+0000 7f4c0bb08700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c04152300 0x7f4c040b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:56.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.978+0000 7f4c0bb08700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c04148420 con 0x7f4c04152300 2023-06-23T18:44:56.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.978+0000 7f4c0bb08700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0414f570 con 0x7f4c0406f400 2023-06-23T18:44:56.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.978+0000 7f4c0bb08700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c040b3010 con 0x7f4c04148c20 2023-06-23T18:44:56.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.979+0000 7f4c090a3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c04148c20 0x7f4c04145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.979+0000 7f4c090a3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c04148c20 0x7f4c04145df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.52:49006/0 (socket says 172.21.15.52:49006) 2023-06-23T18:44:56.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.979+0000 7f4c090a3700 1 -- 172.21.15.52:0/3909658548 learned_addr learned my addr 172.21.15.52:0/3909658548 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:56.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.979+0000 7f8123fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f812c0bcc50 0x7f812c143b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.995 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.979+0000 7f8123fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f812c0bcc50 0x7f812c143b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.52:59068/0 (socket says 172.21.15.52:59068) 2023-06-23T18:44:56.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.979+0000 7f8123fff700 1 -- 172.21.15.52:0/255625969 learned_addr learned my addr 172.21.15.52:0/255625969 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:56.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.979+0000 7f4c098a4700 1 --2- 172.21.15.52:0/3909658548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c0406f400 0x7f4c0414b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.979+0000 7f8131256700 1 --2- 172.21.15.52:0/255625969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f812c06f930 0x7f812c06fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:56.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.979+0000 7f8123fff700 1 -- 172.21.15.52:0/255625969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f812c06f930 msgr2=0x7f812c06fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:56.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.979+0000 7f8123fff700 1 --2- 172.21.15.52:0/255625969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f812c06f930 0x7f812c06fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.979+0000 7f8123fff700 1 -- 172.21.15.52:0/255625969 >> v1:172.21.15.89:6789/0 conn(0x7f812c071a80 legacy=0x7f812c1464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.979+0000 7f8123fff700 1 -- 172.21.15.52:0/255625969 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812c0af7f0 con 0x7f812c0bcc50 2023-06-23T18:44:56.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.979+0000 7f4c090a3700 1 -- 172.21.15.52:0/3909658548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c0406f400 msgr2=0x7f4c0414b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.979+0000 7f4c090a3700 1 --2- 172.21.15.52:0/3909658548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c0406f400 0x7f4c0414b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.979+0000 7f4c090a3700 1 -- 172.21.15.52:0/3909658548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c04152300 msgr2=0x7f4c040b2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:56.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.979+0000 7f4c090a3700 1 --2- 172.21.15.52:0/3909658548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c04152300 0x7f4c040b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:56.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.979+0000 7f4c090a3700 1 -- 172.21.15.52:0/3909658548 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c00009550 con 0x7f4c04148c20 2023-06-23T18:44:56.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.979+0000 7f8123fff700 1 --2- 172.21.15.52:0/255625969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f812c0bcc50 0x7f812c143b90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f811c009e50 tx=0x7f811c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d19a393901e01cf7 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.979+0000 7f4c090a3700 1 --2- 172.21.15.52:0/3909658548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c04148c20 0x7f4c04145df0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4c00009130 tx=0x7f4c00004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:56.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.979+0000 7f4bfa7fc700 1 -- 172.21.15.52:0/3909658548 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c00003c50 con 0x7f4c04148c20 2023-06-23T18:44:56.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.980+0000 7f4bfa7fc700 1 -- 172.21.15.52:0/3909658548 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0001f070 con 0x7f4c04148c20 2023-06-23T18:44:56.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.980+0000 7f4bfa7fc700 1 -- 172.21.15.52:0/3909658548 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c00011630 con 0x7f4c04148c20 2023-06-23T18:44:57.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.980+0000 7f4c0bb08700 1 -- 172.21.15.52:0/3909658548 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c0414ba80 con 0x7f4c04148c20 2023-06-23T18:44:57.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.980+0000 7f4c0bb08700 1 -- 172.21.15.52:0/3909658548 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0414f290 con 0x7f4c04148c20 2023-06-23T18:44:57.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.980+0000 7f22a88c9700 1 Processor -- start 2023-06-23T18:44:57.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.978+0000 7fefb77fe700 1 --2- 172.21.15.52:0/3405880084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefb80bda10 0x7fefb80b7aa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fefb0009d90 tx=0x7fefb000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53777d34459d6ae4 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:57.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.979+0000 7fefb67fc700 1 -- 172.21.15.52:0/3405880084 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb000e070 con 0x7fefb80bda10 2023-06-23T18:44:57.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.979+0000 7fefb67fc700 1 -- 172.21.15.52:0/3405880084 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb000bbd0 con 0x7fefb80bda10 2023-06-23T18:44:57.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.979+0000 7fefb67fc700 1 -- 172.21.15.52:0/3405880084 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb0012430 con 0x7fefb80bda10 2023-06-23T18:44:57.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.980+0000 7fefbe04c700 1 -- 172.21.15.52:0/3405880084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefb80bda10 msgr2=0x7fefb80b7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.980+0000 7fefbe04c700 1 --2- 172.21.15.52:0/3405880084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefb80bda10 0x7fefb80b7aa0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fefb0009d90 tx=0x7fefb000b330 comp rx=0 tx=0).stop 2023-06-23T18:44:57.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.980+0000 7fefbe04c700 1 -- 172.21.15.52:0/3405880084 shutdown_connections 2023-06-23T18:44:57.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.980+0000 7fefbe04c700 1 --2- 172.21.15.52:0/3405880084 >> v2:172.21.15.52:3300/0 conn(0x7fefb80b6f10 0x7fefb80ba370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.980+0000 7fefbe04c700 1 --2- 172.21.15.52:0/3405880084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefb80bda10 0x7fefb80b7aa0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.980+0000 7fefbe04c700 1 -- 172.21.15.52:0/3405880084 >> 172.21.15.52:0/3405880084 conn(0x7fefb806c820 msgr2=0x7fefb80bd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:57.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.980+0000 7f88afcfc700 1 Processor -- start 2023-06-23T18:44:57.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.981+0000 7f812bfff700 1 -- 172.21.15.52:0/255625969 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c00e070 con 0x7f812c0bcc50 2023-06-23T18:44:57.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.981+0000 7f812bfff700 1 -- 172.21.15.52:0/255625969 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811c00b9c0 con 0x7f812c0bcc50 2023-06-23T18:44:57.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.981+0000 7f812bfff700 1 -- 172.21.15.52:0/255625969 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c00bd70 con 0x7f812c0bcc50 2023-06-23T18:44:57.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.977+0000 7f53ccb13700 1 Processor -- start 2023-06-23T18:44:57.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.978+0000 7f53ccb13700 1 -- start start 2023-06-23T18:44:57.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.980+0000 7f53ccb13700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53c8148b90 0x7f53c80b8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.980+0000 7f53ccb13700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f53c8151e00 0x7f53c8071620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.980+0000 7f53ccb13700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c806fc30 con 0x7f53c8071b60 2023-06-23T18:44:57.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.980+0000 7f53ccb13700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c806f400 con 0x7f53c8151e00 2023-06-23T18:44:57.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.980+0000 7f53ccb13700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c806f5e0 con 0x7f53c8148b90 2023-06-23T18:44:57.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.980+0000 7f53c659c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53c8148b90 0x7f53c80b8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.980+0000 7f53c659c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53c8148b90 0x7f53c80b8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.52:49008/0 (socket says 172.21.15.52:49008) 2023-06-23T18:44:57.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.980+0000 7f53c5d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f53c8151e00 0x7f53c8071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.980+0000 7f53c659c700 1 -- 172.21.15.52:0/1177800949 learned_addr learned my addr 172.21.15.52:0/1177800949 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:57.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.981+0000 7f53c5d9b700 1 -- 172.21.15.52:0/1177800949 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53c8148b90 msgr2=0x7f53c80b8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:57.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.981+0000 7f53c5d9b700 1 --2- 172.21.15.52:0/1177800949 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53c8148b90 0x7f53c80b8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.981+0000 7f53c5d9b700 1 -- 172.21.15.52:0/1177800949 >> v1:172.21.15.89:6789/0 conn(0x7f53c8071b60 legacy=0x7f53c814e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.981+0000 7f53c5d9b700 1 -- 172.21.15.52:0/1177800949 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c806f8c0 con 0x7f53c8151e00 2023-06-23T18:44:57.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.981+0000 7f88afcfc700 1 -- start start 2023-06-23T18:44:57.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.981+0000 7f53c5d9b700 1 --2- 172.21.15.52:0/1177800949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53c8151e00 0x7f53c8071620 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f53b8009840 tx=0x7f53b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9195426bf624d818 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:57.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.981+0000 7f4c0bb08700 1 -- 172.21.15.52:0/3909658548 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c0404e1d0 con 0x7f4c04148c20 2023-06-23T18:44:57.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.981+0000 7fefbe04c700 1 -- 172.21.15.52:0/3405880084 shutdown_connections 2023-06-23T18:44:57.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.981+0000 7f9270e10700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926c0b8230 con 0x7f926c0b3570 2023-06-23T18:44:57.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.981+0000 7f9270e10700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926c0b8510 con 0x7f926c0714c0 2023-06-23T18:44:57.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.981+0000 7f9270e10700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f926c0b4910 con 0x7f926c0b6af0 2023-06-23T18:44:57.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.981+0000 7f926a59c700 1 -- 172.21.15.52:0/3864615990 learned_addr learned my addr 172.21.15.52:0/3864615990 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:57.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.981+0000 7f22a88c9700 1 -- start start 2023-06-23T18:44:57.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f926959a700 1 -- 172.21.15.52:0/3864615990 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3124484037 0 0) 0x7f926c0b8510 con 0x7f926c0714c0 2023-06-23T18:44:57.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f926959a700 1 -- 172.21.15.52:0/3864615990 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92540035b0 con 0x7f926c0714c0 2023-06-23T18:44:57.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f8132cb9700 1 -- 172.21.15.52:0/255625969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f812c0bcc50 msgr2=0x7f812c143b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f8132cb9700 1 --2- 172.21.15.52:0/255625969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f812c0bcc50 0x7f812c143b90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f811c009e50 tx=0x7f811c00b330 comp rx=0 tx=0).stop 2023-06-23T18:44:57.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f88afcfc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f88a80b7c70 0x7f88a8071540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f88afcfc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88a8071a80 0x7f88a8151c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f88afcfc700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a80b8fb0 con 0x7f88a806c1f0 2023-06-23T18:44:57.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f88afcfc700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a80b8b20 con 0x7f88a80b7c70 2023-06-23T18:44:57.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f88afcfc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a80b9b20 con 0x7f88a8071a80 2023-06-23T18:44:57.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f22a88c9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22a406f930 0x7f22a41d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f22a88c9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22a4071a80 0x7f22a40bb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f926959a700 1 -- 172.21.15.52:0/3864615990 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3292609921 0 0) 0x7f926c0b8230 con 0x7f926c0b3570 2023-06-23T18:44:57.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f926959a700 1 -- 172.21.15.52:0/3864615990 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f926c0b8510 con 0x7f926c0b3570 2023-06-23T18:44:57.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f926959a700 1 -- 172.21.15.52:0/3864615990 <== mon.1 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3675809443 0 0) 0x7f92540035b0 con 0x7f926c0714c0 2023-06-23T18:44:57.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f926959a700 1 -- 172.21.15.52:0/3864615990 >> v2:172.21.15.52:3300/0 conn(0x7f926c0b6af0 msgr2=0x7f926c1484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:57.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f926959a700 1 --2- 172.21.15.52:0/3864615990 >> v2:172.21.15.52:3300/0 conn(0x7f926c0b6af0 0x7f926c1484c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f926959a700 1 -- 172.21.15.52:0/3864615990 >> v1:172.21.15.52:6789/0 conn(0x7f926c0b3570 legacy=0x7f926c152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f926959a700 1 -- 172.21.15.52:0/3864615990 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926c0b87f0 con 0x7f926c0714c0 2023-06-23T18:44:57.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f926959a700 1 -- 172.21.15.52:0/3864615990 <== mon.1 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7f9260001670 con 0x7f926c0714c0 2023-06-23T18:44:57.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f926959a700 1 -- 172.21.15.52:0/3864615990 >> v1:172.21.15.89:6789/0 conn(0x7f926c0714c0 legacy=0x7f926c145480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f926959a700 1 --2- 172.21.15.52:0/3864615990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9254003b90 0x7f9254003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f88ada98700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f88a806c1f0 0x7f88a81473d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44802/0 (socket says 172.21.15.52:44802) 2023-06-23T18:44:57.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f88ada98700 1 -- 172.21.15.52:0/3345860949 learned_addr learned my addr 172.21.15.52:0/3345860949 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:57.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f926959a700 1 --2- 172.21.15.52:0/3864615990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9254004850 0x7f9254004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f926959a700 1 --2- 172.21.15.52:0/3864615990 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9254005200 0x7f925400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f926959a700 1 -- 172.21.15.52:0/3864615990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925400c050 con 0x7f9254003b90 2023-06-23T18:44:57.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f926959a700 1 -- 172.21.15.52:0/3864615990 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925400c1c0 con 0x7f9254004850 2023-06-23T18:44:57.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f926959a700 1 -- 172.21.15.52:0/3864615990 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925400c380 con 0x7f9254005200 2023-06-23T18:44:57.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f22a88c9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22a40bcc50 0x7f22a41415d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f22a88c9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a41d1010 con 0x7f22a4071a80 2023-06-23T18:44:57.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f22a88c9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a4138d70 con 0x7f22a406f930 2023-06-23T18:44:57.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f22a88c9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a40bb3c0 con 0x7f22a40bcc50 2023-06-23T18:44:57.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f53c559a700 1 -- 172.21.15.52:0/1177800949 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b8011830 con 0x7f53c8151e00 2023-06-23T18:44:57.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f53c559a700 1 -- 172.21.15.52:0/1177800949 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b8011990 con 0x7f53c8151e00 2023-06-23T18:44:57.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f88ad297700 1 --2- 172.21.15.52:0/3345860949 >> v2:172.21.15.52:3300/0 conn(0x7f88a80b7c70 0x7f88a8071540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f53c559a700 1 -- 172.21.15.52:0/1177800949 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b8011d20 con 0x7f53c8151e00 2023-06-23T18:44:57.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f9269d9b700 1 --2- 172.21.15.52:0/3864615990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9254004850 0x7f9254004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.983+0000 7f926ad9d700 1 --2- 172.21.15.52:0/3864615990 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9254005200 0x7f925400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.983+0000 7f926a59c700 1 --2- 172.21.15.52:0/3864615990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9254003b90 0x7f9254003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.983+0000 7f4bfa7fc700 1 -- 172.21.15.52:0/3909658548 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4c00021030 con 0x7f4c04148c20 2023-06-23T18:44:57.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f22a259c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22a406f930 0x7f22a41d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.982+0000 7f22a1d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22a4071a80 0x7f22a40bb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.983+0000 7f22a1d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22a4071a80 0x7f22a40bb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52024/0 (socket says 172.21.15.52:52024) 2023-06-23T18:44:57.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.983+0000 7f22a1d9b700 1 -- 172.21.15.52:0/1487160199 learned_addr learned my addr 172.21.15.52:0/1487160199 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:57.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.983+0000 7f22a2d9d700 1 --2- 172.21.15.52:0/1487160199 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22a40bcc50 0x7f22a41415d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.983+0000 7f22a1d9b700 1 -- 172.21.15.52:0/1487160199 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22a40bcc50 msgr2=0x7f22a41415d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.983+0000 7f22a1d9b700 1 --2- 172.21.15.52:0/1487160199 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22a40bcc50 0x7f22a41415d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.983+0000 7f22a1d9b700 1 -- 172.21.15.52:0/1487160199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22a406f930 msgr2=0x7f22a41d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.983+0000 7f22a1d9b700 1 --2- 172.21.15.52:0/1487160199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22a406f930 0x7f22a41d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.983+0000 7f22a1d9b700 1 -- 172.21.15.52:0/1487160199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229c009a70 con 0x7f22a4071a80 2023-06-23T18:44:57.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.983+0000 7f22a1d9b700 1 --2- 172.21.15.52:0/1487160199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22a4071a80 0x7f22a40bb850 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2298001eb0 tx=0x7f229800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:57.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.983+0000 7f926a59c700 1 -- 172.21.15.52:0/3864615990 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9254005200 msgr2=0x7f925400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:57.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.983+0000 7f926a59c700 1 --2- 172.21.15.52:0/3864615990 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9254005200 0x7f925400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.983+0000 7f926a59c700 1 -- 172.21.15.52:0/3864615990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9254004850 msgr2=0x7f9254004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:57.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.983+0000 7f926a59c700 1 --2- 172.21.15.52:0/3864615990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9254004850 0x7f9254004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.983+0000 7f926a59c700 1 -- 172.21.15.52:0/3864615990 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926c0b87f0 con 0x7f9254003b90 2023-06-23T18:44:57.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.983+0000 7f926ad9d700 1 -- 172.21.15.52:0/3864615990 reap_dead start 2023-06-23T18:44:57.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.983+0000 7f88ad297700 1 -- 172.21.15.52:0/3345860949 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88a8071a80 msgr2=0x7f88a8151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:57.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.983+0000 7f88ad297700 1 --2- 172.21.15.52:0/3345860949 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88a8071a80 0x7f88a8151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.983+0000 7f88ad297700 1 -- 172.21.15.52:0/3345860949 >> v1:172.21.15.52:6789/0 conn(0x7f88a806c1f0 legacy=0x7f88a81473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.983+0000 7f88ad297700 1 -- 172.21.15.52:0/3345860949 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a80b49b0 con 0x7f88a80b7c70 2023-06-23T18:44:57.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.983+0000 7f53ccb13700 1 -- 172.21.15.52:0/1177800949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53c8151e00 msgr2=0x7f53c8071620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.983+0000 7f53ccb13700 1 --2- 172.21.15.52:0/1177800949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53c8151e00 0x7f53c8071620 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f53b8009840 tx=0x7f53b8009b50 comp rx=0 tx=0).stop 2023-06-23T18:44:57.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.984+0000 7f53ccb13700 1 -- 172.21.15.52:0/1177800949 shutdown_connections 2023-06-23T18:44:57.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.984+0000 7f53ccb13700 1 --2- 172.21.15.52:0/1177800949 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53c8148b90 0x7f53c80b8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.984+0000 7f53ccb13700 1 --2- 172.21.15.52:0/1177800949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53c8151e00 0x7f53c8071620 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.984+0000 7f53ccb13700 1 -- 172.21.15.52:0/1177800949 >> 172.21.15.52:0/1177800949 conn(0x7f53c80bc170 msgr2=0x7f53c80bc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:57.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.983+0000 7fefbe04c700 1 -- 172.21.15.52:0/3405880084 wait complete. 2023-06-23T18:44:57.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.984+0000 7f53ccb13700 1 -- 172.21.15.52:0/1177800949 shutdown_connections 2023-06-23T18:44:57.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.984+0000 7f53ccb13700 1 -- 172.21.15.52:0/1177800949 wait complete. 2023-06-23T18:44:57.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.984+0000 7f8132cb9700 1 -- 172.21.15.52:0/255625969 shutdown_connections 2023-06-23T18:44:57.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.984+0000 7f8132cb9700 1 --2- 172.21.15.52:0/255625969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f812c06f930 0x7f812c06fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.984+0000 7f8132cb9700 1 --2- 172.21.15.52:0/255625969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f812c0bcc50 0x7f812c143b90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.984+0000 7f8132cb9700 1 -- 172.21.15.52:0/255625969 >> 172.21.15.52:0/255625969 conn(0x7f812c0bc170 msgr2=0x7f812c0bc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:57.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.984+0000 7f926a59c700 1 --2- 172.21.15.52:0/3864615990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9254003b90 0x7f9254003f80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f926000c340 tx=0x7f9254005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e948c215aa95cb server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:57.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.984+0000 7f4bfa7fc700 1 --2- 172.21.15.52:0/3909658548 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f4be806ace0 0x7f4be806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.984+0000 7f4bfa7fc700 1 -- 172.21.15.52:0/3909658548 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4c0008a9d0 con 0x7f4c04148c20 2023-06-23T18:44:57.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.984+0000 7f4c098a4700 1 --2- 172.21.15.52:0/3909658548 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f4be806ace0 0x7f4be806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.984+0000 7f88ad297700 1 --2- 172.21.15.52:0/3345860949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88a80b7c70 0x7f88a8071540 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8898009840 tx=0x7f8898009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889a0664cdcd9e36 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:57.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.984+0000 7f2292ffd700 1 -- 172.21.15.52:0/1487160199 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2298005d70 con 0x7f22a4071a80 2023-06-23T18:44:57.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.984+0000 7f2292ffd700 1 -- 172.21.15.52:0/1487160199 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22980070d0 con 0x7f22a4071a80 2023-06-23T18:44:57.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.984+0000 7f2292ffd700 1 -- 172.21.15.52:0/1487160199 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2298007440 con 0x7f22a4071a80 2023-06-23T18:44:57.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.984+0000 7f926959a700 1 -- 172.21.15.52:0/3864615990 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9260007c30 con 0x7f9254003b90 2023-06-23T18:44:57.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.984+0000 7f926959a700 1 -- 172.21.15.52:0/3864615990 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926000ce00 con 0x7f9254003b90 2023-06-23T18:44:57.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.984+0000 7f926959a700 1 -- 172.21.15.52:0/3864615990 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9260005b80 con 0x7f9254003b90 2023-06-23T18:44:57.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.984+0000 7f22a88c9700 1 -- 172.21.15.52:0/1487160199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a4146190 con 0x7f22a4071a80 2023-06-23T18:44:57.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.984+0000 7f22a88c9700 1 -- 172.21.15.52:0/1487160199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a40bbd90 con 0x7f22a4071a80 2023-06-23T18:44:57.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.984+0000 7f8132cb9700 1 -- 172.21.15.52:0/255625969 shutdown_connections 2023-06-23T18:44:57.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.985+0000 7f88aca96700 1 -- 172.21.15.52:0/3345860949 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8898011830 con 0x7f88a80b7c70 2023-06-23T18:44:57.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.985+0000 7f88aca96700 1 -- 172.21.15.52:0/3345860949 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8898011990 con 0x7f88a80b7c70 2023-06-23T18:44:57.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.985+0000 7f88aca96700 1 -- 172.21.15.52:0/3345860949 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8898011d00 con 0x7f88a80b7c70 2023-06-23T18:44:57.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.985+0000 7fefbe04c700 1 Processor -- start 2023-06-23T18:44:57.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.985+0000 7f22a88c9700 1 -- 172.21.15.52:0/1487160199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a4145ff0 con 0x7f22a4071a80 2023-06-23T18:44:57.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.985+0000 7f53ccb13700 1 Processor -- start 2023-06-23T18:44:57.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.986+0000 7f88afcfc700 1 -- 172.21.15.52:0/3345860949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88a80b7c70 msgr2=0x7f88a8071540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.986+0000 7f88afcfc700 1 --2- 172.21.15.52:0/3345860949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88a80b7c70 0x7f88a8071540 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8898009840 tx=0x7f8898009b50 comp rx=0 tx=0).stop 2023-06-23T18:44:57.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.986+0000 7f88afcfc700 1 -- 172.21.15.52:0/3345860949 shutdown_connections 2023-06-23T18:44:57.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.986+0000 7f88afcfc700 1 --2- 172.21.15.52:0/3345860949 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88a8071a80 0x7f88a8151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.986+0000 7f88afcfc700 1 --2- 172.21.15.52:0/3345860949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88a80b7c70 0x7f88a8071540 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.986+0000 7f88afcfc700 1 -- 172.21.15.52:0/3345860949 >> 172.21.15.52:0/3345860949 conn(0x7f88a80bdf30 msgr2=0x7f88a80b9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:57.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.985+0000 7f8132cb9700 1 -- 172.21.15.52:0/255625969 wait complete. 2023-06-23T18:44:57.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.986+0000 7f4c098a4700 1 --2- 172.21.15.52:0/3909658548 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f4be806ace0 0x7f4be806d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4007fd0 tx=0x7f4bf4007ec0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:57.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.985+0000 7fefbe04c700 1 -- start start 2023-06-23T18:44:57.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.986+0000 7fefbe04c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefb80b6ae0 0x7fefb81d9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.986+0000 7fefbe04c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefb80b6f10 0x7fefb814cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.986+0000 7fefbe04c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefb80bda10 0x7fefb81e7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.986+0000 7fefbe04c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb814d130 con 0x7fefb80b6f10 2023-06-23T18:44:57.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.986+0000 7fefbe04c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb81d8370 con 0x7fefb80b6ae0 2023-06-23T18:44:57.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.986+0000 7fefbe04c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb81d8b80 con 0x7fefb80bda10 2023-06-23T18:44:57.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.986+0000 7fefb6ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefb80b6f10 0x7fefb814cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.986+0000 7fefb6ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefb80b6f10 0x7fefb814cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52034/0 (socket says 172.21.15.52:52034) 2023-06-23T18:44:57.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.986+0000 7fefb6ffd700 1 -- 172.21.15.52:0/4212613171 learned_addr learned my addr 172.21.15.52:0/4212613171 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:57.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.986+0000 7f9270e10700 1 -- 172.21.15.52:0/3864615990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9254003b90 msgr2=0x7f9254003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.986+0000 7f9270e10700 1 --2- 172.21.15.52:0/3864615990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9254003b90 0x7f9254003f80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f926000c340 tx=0x7f9254005880 comp rx=0 tx=0).stop 2023-06-23T18:44:57.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.986+0000 7f8132cb9700 1 Processor -- start 2023-06-23T18:44:57.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.987+0000 7fefb77fe700 1 --2- 172.21.15.52:0/4212613171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefb80b6ae0 0x7fefb81d9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.987+0000 7f9270e10700 1 -- 172.21.15.52:0/3864615990 shutdown_connections 2023-06-23T18:44:57.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.987+0000 7f9270e10700 1 --2- 172.21.15.52:0/3864615990 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9254003b90 0x7f9254003f80 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f926000c340 tx=0x7f9254005880 comp rx=0 tx=0).stop 2023-06-23T18:44:57.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.987+0000 7f9270e10700 1 -- 172.21.15.52:0/3864615990 >> 172.21.15.52:0/3864615990 conn(0x7f926c0bc170 msgr2=0x7f926c0bc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:57.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.987+0000 7fefb6ffd700 1 -- 172.21.15.52:0/4212613171 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefb80bda10 msgr2=0x7fefb81e7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.987+0000 7fefb6ffd700 1 --2- 172.21.15.52:0/4212613171 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefb80bda10 0x7fefb81e7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.987+0000 7fefb6ffd700 1 -- 172.21.15.52:0/4212613171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefb80b6ae0 msgr2=0x7fefb81d9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.987+0000 7fefb6ffd700 1 --2- 172.21.15.52:0/4212613171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefb80b6ae0 0x7fefb81d9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.987+0000 7fefb6ffd700 1 -- 172.21.15.52:0/4212613171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb0009a70 con 0x7fefb80b6f10 2023-06-23T18:44:57.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.987+0000 7fefb77fe700 1 --2- 172.21.15.52:0/4212613171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefb80b6ae0 0x7fefb81d9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:44:57.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.987+0000 7fefb6ffd700 1 --2- 172.21.15.52:0/4212613171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefb80b6f10 0x7fefb814cbf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fefac00c430 tx=0x7fefac00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:57.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.987+0000 7f53ccb13700 1 -- start start 2023-06-23T18:44:57.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.987+0000 7f53ccb13700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53c8071b60 0x7f53c8138770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.987+0000 7f53ccb13700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53c8148b90 0x7f53c81497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.987+0000 7f53ccb13700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53c8151e00 0x7f53c814a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.987+0000 7f53ccb13700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c8149d10 con 0x7f53c8151e00 2023-06-23T18:44:57.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.987+0000 7f53ccb13700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c814b990 con 0x7f53c8148b90 2023-06-23T18:44:57.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.987+0000 7f53ccb13700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c814c300 con 0x7f53c8071b60 2023-06-23T18:44:57.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f53c6d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53c8151e00 0x7f53c814a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f53c659c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53c8071b60 0x7f53c8138770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f53c6d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53c8151e00 0x7f53c814a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52048/0 (socket says 172.21.15.52:52048) 2023-06-23T18:44:57.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f53c6d9d700 1 -- 172.21.15.52:0/2136118471 learned_addr learned my addr 172.21.15.52:0/2136118471 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:57.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.987+0000 7f8132cb9700 1 -- start start 2023-06-23T18:44:57.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f8132cb9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f812c06f930 0x7f812c0afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f8132cb9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f812c071a80 0x7f812c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f8132cb9700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f812c0bcc50 0x7f812c13d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f8132cb9700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812c1d3310 con 0x7f812c0bcc50 2023-06-23T18:44:57.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f8132cb9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812c0b01c0 con 0x7f812c06f930 2023-06-23T18:44:57.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f8132cb9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812c0b6440 con 0x7f812c071a80 2023-06-23T18:44:57.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f8130a55700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f812c06f930 0x7f812c0afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f8130a55700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f812c06f930 0x7f812c0afc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.52:59114/0 (socket says 172.21.15.52:59114) 2023-06-23T18:44:57.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f8130a55700 1 -- 172.21.15.52:0/1958628052 learned_addr learned my addr 172.21.15.52:0/1958628052 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:57.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f8131256700 1 --2- 172.21.15.52:0/1958628052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f812c0bcc50 0x7f812c13d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f53c5d9b700 1 --2- 172.21.15.52:0/2136118471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53c8148b90 0x7f53c81497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f53c659c700 1 -- 172.21.15.52:0/2136118471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53c8148b90 msgr2=0x7f53c81497d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f53c659c700 1 --2- 172.21.15.52:0/2136118471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53c8148b90 0x7f53c81497d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f53c659c700 1 -- 172.21.15.52:0/2136118471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53c8151e00 msgr2=0x7f53c814a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f53c659c700 1 --2- 172.21.15.52:0/2136118471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53c8151e00 0x7f53c814a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f53c659c700 1 -- 172.21.15.52:0/2136118471 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b80094a0 con 0x7f53c8071b60 2023-06-23T18:44:57.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f53c659c700 1 --2- 172.21.15.52:0/2136118471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53c8071b60 0x7f53c8138770 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00e8e0 tx=0x7f53bc00ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:57.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f8130a55700 1 -- 172.21.15.52:0/1958628052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f812c071a80 msgr2=0x7f812c0b25a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-23T18:44:57.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f8130a55700 1 --2- 172.21.15.52:0/1958628052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f812c071a80 0x7f812c0b25a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f8130a55700 1 -- 172.21.15.52:0/1958628052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f812c0bcc50 msgr2=0x7f812c13d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f8130a55700 1 --2- 172.21.15.52:0/1958628052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f812c0bcc50 0x7f812c13d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f8130a55700 1 -- 172.21.15.52:0/1958628052 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811c009b30 con 0x7f812c06f930 2023-06-23T18:44:57.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.988+0000 7f8131256700 1 --2- 172.21.15.52:0/1958628052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f812c0bcc50 0x7f812c13d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:44:57.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.989+0000 7f8130a55700 1 --2- 172.21.15.52:0/1958628052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f812c06f930 0x7f812c0afc80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f811400c4e0 tx=0x7f811400c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:57.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.989+0000 7f53b6ffd700 1 -- 172.21.15.52:0/2136118471 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc00c690 con 0x7f53c8071b60 2023-06-23T18:44:57.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.989+0000 7f53b6ffd700 1 -- 172.21.15.52:0/2136118471 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53bc00c7f0 con 0x7f53c8071b60 2023-06-23T18:44:57.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.989+0000 7f53b6ffd700 1 -- 172.21.15.52:0/2136118471 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc00cb60 con 0x7f53c8071b60 2023-06-23T18:44:57.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.989+0000 7f8129ffb700 1 -- 172.21.15.52:0/1958628052 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81140052d0 con 0x7f812c06f930 2023-06-23T18:44:57.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.989+0000 7f8129ffb700 1 -- 172.21.15.52:0/1958628052 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8114005430 con 0x7f812c06f930 2023-06-23T18:44:57.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.989+0000 7f8129ffb700 1 -- 172.21.15.52:0/1958628052 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81140038c0 con 0x7f812c06f930 2023-06-23T18:44:57.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.989+0000 7f53ccb13700 1 -- 172.21.15.52:0/2136118471 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c814e960 con 0x7f53c8071b60 2023-06-23T18:44:57.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.989+0000 7f4bfa7fc700 1 -- 172.21.15.52:0/3909658548 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4c00055a70 con 0x7f4c04148c20 2023-06-23T18:44:57.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.989+0000 7f53ccb13700 1 -- 172.21.15.52:0/2136118471 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c814c020 con 0x7f53c8071b60 2023-06-23T18:44:57.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.989+0000 7fc18fe32700 1 Processor -- start 2023-06-23T18:44:57.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.990+0000 7f53ccb13700 1 -- 172.21.15.52:0/2136118471 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c80b7420 con 0x7f53c8071b60 2023-06-23T18:44:57.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.990+0000 7f8132cb9700 1 -- 172.21.15.52:0/1958628052 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f812c1e42c0 con 0x7f812c06f930 2023-06-23T18:44:57.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.990+0000 7f8132cb9700 1 -- 172.21.15.52:0/1958628052 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f812c1e4880 con 0x7f812c06f930 2023-06-23T18:44:57.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.991+0000 7f8132cb9700 1 -- 172.21.15.52:0/1958628052 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f812c04e1d0 con 0x7f812c06f930 2023-06-23T18:44:57.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.991+0000 7fc18fe32700 1 -- start start 2023-06-23T18:44:57.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.991+0000 7f8129ffb700 1 -- 172.21.15.52:0/1958628052 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8114003a20 con 0x7f812c06f930 2023-06-23T18:44:57.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.991+0000 7f53b6ffd700 1 -- 172.21.15.52:0/2136118471 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f53bc00ccc0 con 0x7f53c8071b60 2023-06-23T18:44:57.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.992+0000 7f88afcfc700 1 -- 172.21.15.52:0/3345860949 shutdown_connections 2023-06-23T18:44:57.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.992+0000 7f8129ffb700 1 --2- 172.21.15.52:0/1958628052 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f810c06ace0 0x7f810c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.992+0000 7f8129ffb700 1 -- 172.21.15.52:0/1958628052 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8114088860 con 0x7f812c06f930 2023-06-23T18:44:57.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.992+0000 7f8123fff700 1 --2- 172.21.15.52:0/1958628052 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f810c06ace0 0x7f810c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.992+0000 7f53b6ffd700 1 --2- 172.21.15.52:0/2136118471 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f53a806adb0 0x7f53a806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.992+0000 7f53b6ffd700 1 -- 172.21.15.52:0/2136118471 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f53bc089480 con 0x7f53c8071b60 2023-06-23T18:44:57.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.992+0000 7fc18fe32700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1880714c0 0x7fc1880b6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.992+0000 7fc18fe32700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc1881455d0 0x7fc188145a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.992+0000 7fc18fe32700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc1881487c0 0x7fc188148c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.992+0000 7fc18fe32700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1880b3f10 con 0x7fc1881487c0 2023-06-23T18:44:57.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.992+0000 7fc18fe32700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1880b8ab0 con 0x7fc1881455d0 2023-06-23T18:44:57.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.992+0000 7fc18fe32700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880b7030 con 0x7fc1880714c0 2023-06-23T18:44:57.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.992+0000 7fc18e3cf700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc1881487c0 0x7fc188148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.992+0000 7fc18e3cf700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc1881487c0 0x7fc188148c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52076/0 (socket says 172.21.15.52:52076) 2023-06-23T18:44:57.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.992+0000 7fc18e3cf700 1 -- 172.21.15.52:0/400336269 learned_addr learned my addr 172.21.15.52:0/400336269 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:57.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.992+0000 7fc18e3cf700 1 -- 172.21.15.52:0/400336269 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1880714c0 msgr2=0x7fc1880b6af0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-23T18:44:57.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.992+0000 7fc18e3cf700 1 --2- 172.21.15.52:0/400336269 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1880714c0 0x7fc1880b6af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.992+0000 7fc18e3cf700 1 -- 172.21.15.52:0/400336269 >> v2:172.21.15.89:3300/0 conn(0x7fc1881455d0 msgr2=0x7fc188145a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T18:44:57.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.992+0000 7fc18e3cf700 1 --2- 172.21.15.52:0/400336269 >> v2:172.21.15.89:3300/0 conn(0x7fc1881455d0 0x7fc188145a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.992+0000 7fc18e3cf700 1 -- 172.21.15.52:0/400336269 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc188149180 con 0x7fc1881487c0 2023-06-23T18:44:57.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.993+0000 7f53c5d9b700 1 --2- 172.21.15.52:0/2136118471 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f53a806adb0 0x7f53a806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.993+0000 7fc18e3cf700 1 --2- 172.21.15.52:0/400336269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1881487c0 0x7fc188148c40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc1880bd150 tx=0x7fc18000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b609091cbe49414c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:57.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.993+0000 7f8123fff700 1 --2- 172.21.15.52:0/1958628052 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f810c06ace0 0x7f810c06d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f811c009e50 tx=0x7f811c009000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:57.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.993+0000 7f88afcfc700 1 -- 172.21.15.52:0/3345860949 wait complete. 2023-06-23T18:44:57.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.994+0000 7f88afcfc700 1 Processor -- start 2023-06-23T18:44:57.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.994+0000 7f2292ffd700 1 -- 172.21.15.52:0/1487160199 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f22980075a0 con 0x7f22a4071a80 2023-06-23T18:44:57.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.994+0000 7f2292ffd700 1 --2- 172.21.15.52:0/1487160199 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f228406ad30 0x7f228406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.994+0000 7f2292ffd700 1 -- 172.21.15.52:0/1487160199 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2298088b00 con 0x7f22a4071a80 2023-06-23T18:44:57.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.994+0000 7f88afcfc700 1 -- start start 2023-06-23T18:44:57.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.995+0000 7f88afcfc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88a806c1f0 0x7f88a813e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.995+0000 7f88afcfc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88a8071a80 0x7f88a81484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.995+0000 7f88afcfc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88a80b7c70 0x7f88a81e3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.995+0000 7f88afcfc700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a81e7690 con 0x7f88a80b7c70 2023-06-23T18:44:57.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.995+0000 7f88afcfc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a81e7970 con 0x7f88a806c1f0 2023-06-23T18:44:57.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.995+0000 7f88afcfc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a81e7c50 con 0x7f88a8071a80 2023-06-23T18:44:57.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.995+0000 7f88ae299700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88a80b7c70 0x7f88a81e3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.995+0000 7f88ae299700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88a80b7c70 0x7f88a81e3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52080/0 (socket says 172.21.15.52:52080) 2023-06-23T18:44:57.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.995+0000 7f88ae299700 1 -- 172.21.15.52:0/2886394256 learned_addr learned my addr 172.21.15.52:0/2886394256 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:57.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.995+0000 7fc18cbcc700 1 -- 172.21.15.52:0/400336269 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18000e070 con 0x7fc1881487c0 2023-06-23T18:44:57.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.995+0000 7f88ad297700 1 --2- 172.21.15.52:0/2886394256 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88a8071a80 0x7f88a81484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.995+0000 7f88ada98700 1 --2- 172.21.15.52:0/2886394256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88a806c1f0 0x7f88a813e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.995+0000 7f88ae299700 1 -- 172.21.15.52:0/2886394256 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88a8071a80 msgr2=0x7f88a81484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.995+0000 7f88ae299700 1 --2- 172.21.15.52:0/2886394256 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88a8071a80 0x7f88a81484c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.995+0000 7f88ae299700 1 -- 172.21.15.52:0/2886394256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88a806c1f0 msgr2=0x7f88a813e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.995+0000 7f88ae299700 1 --2- 172.21.15.52:0/2886394256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88a806c1f0 0x7f88a813e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.995+0000 7f88ae299700 1 -- 172.21.15.52:0/2886394256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88980094a0 con 0x7f88a80b7c70 2023-06-23T18:44:57.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.996+0000 7f88ae299700 1 --2- 172.21.15.52:0/2886394256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88a80b7c70 0x7f88a81e3ed0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f88a000b970 tx=0x7f88a000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:57.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.995+0000 7fc18cbcc700 1 -- 172.21.15.52:0/400336269 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18000b980 con 0x7fc1881487c0 2023-06-23T18:44:57.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.995+0000 7fc18cbcc700 1 -- 172.21.15.52:0/400336269 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18000bd30 con 0x7fc1881487c0 2023-06-23T18:44:57.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.996+0000 7f2292ffd700 1 -- 172.21.15.52:0/1487160199 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2298053c40 con 0x7f22a4071a80 2023-06-23T18:44:57.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.996+0000 7f22a259c700 1 --2- 172.21.15.52:0/1487160199 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f228406ad30 0x7f228406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.996+0000 7fc18fe32700 1 -- 172.21.15.52:0/400336269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1881487c0 msgr2=0x7fc188148c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.996+0000 7fc18fe32700 1 --2- 172.21.15.52:0/400336269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1881487c0 0x7fc188148c40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc1880bd150 tx=0x7fc18000b330 comp rx=0 tx=0).stop 2023-06-23T18:44:57.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.997+0000 7f53b6ffd700 1 -- 172.21.15.52:0/2136118471 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f53bc054510 con 0x7f53c8071b60 2023-06-23T18:44:57.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.997+0000 7fc18fe32700 1 -- 172.21.15.52:0/400336269 shutdown_connections 2023-06-23T18:44:57.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.997+0000 7fc18fe32700 1 --2- 172.21.15.52:0/400336269 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1881487c0 0x7fc188148c40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.997+0000 7fc18fe32700 1 --2- 172.21.15.52:0/400336269 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1880714c0 0x7fc1880b6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.997+0000 7fc18fe32700 1 --2- 172.21.15.52:0/400336269 >> v2:172.21.15.89:3300/0 conn(0x7fc1881455d0 0x7fc188145a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.997+0000 7fc18fe32700 1 -- 172.21.15.52:0/400336269 >> 172.21.15.52:0/400336269 conn(0x7fc1880bc170 msgr2=0x7fc1880bc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:57.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.997+0000 7f8129ffb700 1 -- 172.21.15.52:0/1958628052 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8114053900 con 0x7f812c06f930 2023-06-23T18:44:57.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.997+0000 7fc18fe32700 1 -- 172.21.15.52:0/400336269 shutdown_connections 2023-06-23T18:44:57.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.997+0000 7fc18fe32700 1 -- 172.21.15.52:0/400336269 wait complete. 2023-06-23T18:44:57.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.999+0000 7fc18fe32700 1 Processor -- start 2023-06-23T18:44:57.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.999+0000 7fc18fe32700 1 -- start start 2023-06-23T18:44:57.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.000+0000 7fc18fe32700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1880714c0 0x7fc188070540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.000+0000 7fc18fe32700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1881455d0 0x7fc188070a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.000+0000 7fc18fe32700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1881487c0 0x7fc1881e7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.000+0000 7fc18fe32700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880b0e60 con 0x7fc1880714c0 2023-06-23T18:44:57.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.000+0000 7fc18fe32700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc188142be0 con 0x7fc1881487c0 2023-06-23T18:44:57.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.000+0000 7fc18fe32700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1881435c0 con 0x7fc1881455d0 2023-06-23T18:44:57.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.995+0000 7fef9ffff700 1 -- 172.21.15.52:0/4212613171 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac005d70 con 0x7fefb80b6f10 2023-06-23T18:44:57.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.995+0000 7fef9ffff700 1 -- 172.21.15.52:0/4212613171 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefac0070d0 con 0x7fefb80b6f10 2023-06-23T18:44:57.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.995+0000 7fef9ffff700 1 -- 172.21.15.52:0/4212613171 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac007440 con 0x7fefb80b6f10 2023-06-23T18:44:57.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.995+0000 7fefbe04c700 1 -- 172.21.15.52:0/4212613171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb81d85c0 con 0x7fefb80b6f10 2023-06-23T18:44:57.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.001+0000 7f9270e10700 1 -- 172.21.15.52:0/3864615990 shutdown_connections 2023-06-23T18:44:57.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.995+0000 7fefbe04c700 1 -- 172.21.15.52:0/4212613171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb81e7670 con 0x7fefb80b6f10 2023-06-23T18:44:57.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:56.997+0000 7fefbe04c700 1 -- 172.21.15.52:0/4212613171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb804e1d0 con 0x7fefb80b6f10 2023-06-23T18:44:57.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.001+0000 7fc18dbce700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1880714c0 0x7fc188070540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.001+0000 7fc18dbce700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1880714c0 0x7fc188070540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52094/0 (socket says 172.21.15.52:52094) 2023-06-23T18:44:57.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.001+0000 7fc18dbce700 1 -- 172.21.15.52:0/2555554208 learned_addr learned my addr 172.21.15.52:0/2555554208 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:57.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.001+0000 7fc18dbce700 1 -- 172.21.15.52:0/2555554208 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1881455d0 msgr2=0x7fc188070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.001+0000 7fc18dbce700 1 --2- 172.21.15.52:0/2555554208 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1881455d0 0x7fc188070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.001+0000 7fc18dbce700 1 -- 172.21.15.52:0/2555554208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1881487c0 msgr2=0x7fc1881e7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.001+0000 7fc18dbce700 1 --2- 172.21.15.52:0/2555554208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1881487c0 0x7fc1881e7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.001+0000 7fc18dbce700 1 -- 172.21.15.52:0/2555554208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc180009b30 con 0x7fc1880714c0 2023-06-23T18:44:57.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.001+0000 7fc18dbce700 1 --2- 172.21.15.52:0/2555554208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1880714c0 0x7fc188070540 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc18400b550 tx=0x7fc18400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:57.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.001+0000 7f9270e10700 1 -- 172.21.15.52:0/3864615990 wait complete. 2023-06-23T18:44:57.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.002+0000 7f9270e10700 1 Processor -- start 2023-06-23T18:44:57.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.002+0000 7f9270e10700 1 -- start start 2023-06-23T18:44:57.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.003+0000 7f9270e10700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f926c0bb850 0x7f926c1dc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.003+0000 7f9270e10700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f926c1dead0 0x7f926c1468c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.003+0000 7f9270e10700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f926c0b1c70 0x7f926c0b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.003+0000 7f9270e10700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926c146e00 con 0x7f926c0bb850 2023-06-23T18:44:57.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.003+0000 7f9270e10700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926c1df9d0 con 0x7f926c0b1c70 2023-06-23T18:44:57.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.003+0000 7f9270e10700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926c0b2650 con 0x7f926c1dead0 2023-06-23T18:44:57.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.003+0000 7f926a59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f926c0bb850 0x7f926c1dc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.003+0000 7f926a59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f926c0bb850 0x7f926c1dc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52110/0 (socket says 172.21.15.52:52110) 2023-06-23T18:44:57.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.003+0000 7f926a59c700 1 -- 172.21.15.52:0/2039996674 learned_addr learned my addr 172.21.15.52:0/2039996674 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:57.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.003+0000 7f926a59c700 1 -- 172.21.15.52:0/2039996674 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f926c1dead0 msgr2=0x7f926c1468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.003+0000 7f926a59c700 1 --2- 172.21.15.52:0/2039996674 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f926c1dead0 0x7f926c1468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.003+0000 7f926a59c700 1 -- 172.21.15.52:0/2039996674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f926c0b1c70 msgr2=0x7f926c0b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.003+0000 7f926a59c700 1 --2- 172.21.15.52:0/2039996674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f926c0b1c70 0x7f926c0b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.003+0000 7f926a59c700 1 -- 172.21.15.52:0/2039996674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926c1def40 con 0x7f926c0bb850 2023-06-23T18:44:57.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.003+0000 7f926a59c700 1 --2- 172.21.15.52:0/2039996674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f926c0bb850 0x7f926c1dc050 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f925400c190 tx=0x7f9260001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:57.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.006+0000 7f22a259c700 1 --2- 172.21.15.52:0/1487160199 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f228406ad30 0x7f228406d1e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2294009be0 tx=0x7f2294009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:57.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.006+0000 7f925affd700 1 -- 172.21.15.52:0/2039996674 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9260021070 con 0x7f926c0bb850 2023-06-23T18:44:57.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.007+0000 7f9270e10700 1 -- 172.21.15.52:0/2039996674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f926c147000 con 0x7f926c0bb850 2023-06-23T18:44:57.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.007+0000 7f9270e10700 1 -- 172.21.15.52:0/2039996674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f926c1db850 con 0x7f926c0bb850 2023-06-23T18:44:57.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.006+0000 7fc17e7fc700 1 -- 172.21.15.52:0/2555554208 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc184011830 con 0x7fc1880714c0 2023-06-23T18:44:57.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.006+0000 7fc18fe32700 1 -- 172.21.15.52:0/2555554208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1881438a0 con 0x7fc1880714c0 2023-06-23T18:44:57.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.007+0000 7fc18fe32700 1 -- 172.21.15.52:0/2555554208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1880b1280 con 0x7fc1880714c0 2023-06-23T18:44:57.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.007+0000 7fc17e7fc700 1 -- 172.21.15.52:0/2555554208 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc184011990 con 0x7fc1880714c0 2023-06-23T18:44:57.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.007+0000 7fc17e7fc700 1 -- 172.21.15.52:0/2555554208 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc184011d40 con 0x7fc1880714c0 2023-06-23T18:44:57.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.007+0000 7f925affd700 1 -- 172.21.15.52:0/2039996674 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9260001640 con 0x7f926c0bb850 2023-06-23T18:44:57.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.007+0000 7f925affd700 1 -- 172.21.15.52:0/2039996674 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92600070d0 con 0x7f926c0bb850 2023-06-23T18:44:57.072 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.008+0000 7f9270e10700 1 -- 172.21.15.52:0/2039996674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f926c06e5f0 con 0x7f926c0bb850 2023-06-23T18:44:57.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.009+0000 7f889e7fc700 1 -- 172.21.15.52:0/2886394256 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a000d860 con 0x7f88a80b7c70 2023-06-23T18:44:57.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.009+0000 7f889e7fc700 1 -- 172.21.15.52:0/2886394256 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a000d9e0 con 0x7f88a80b7c70 2023-06-23T18:44:57.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.009+0000 7f889e7fc700 1 -- 172.21.15.52:0/2886394256 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a000dd90 con 0x7f88a80b7c70 2023-06-23T18:44:57.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.009+0000 7f88afcfc700 1 -- 172.21.15.52:0/2886394256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a81e7f30 con 0x7f88a80b7c70 2023-06-23T18:44:57.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.009+0000 7f88afcfc700 1 -- 172.21.15.52:0/2886394256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a80b40b0 con 0x7f88a80b7c70 2023-06-23T18:44:57.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.010+0000 7f88afcfc700 1 -- 172.21.15.52:0/2886394256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88900052e0 con 0x7f88a80b7c70 2023-06-23T18:44:57.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.011+0000 7f53c5d9b700 1 --2- 172.21.15.52:0/2136118471 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f53a806adb0 0x7f53a806d260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f53c80b6d90 tx=0x7f53b8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:57.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.009+0000 7fef9ffff700 1 -- 172.21.15.52:0/4212613171 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fefac0075a0 con 0x7fefb80b6f10 2023-06-23T18:44:57.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.010+0000 7fef9ffff700 1 --2- 172.21.15.52:0/4212613171 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fefa406ace0 0x7fefa406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.010+0000 7fef9ffff700 1 -- 172.21.15.52:0/4212613171 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fefac089090 con 0x7fefb80b6f10 2023-06-23T18:44:57.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.011+0000 7fefb77fe700 1 --2- 172.21.15.52:0/4212613171 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fefa406ace0 0x7fefa406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.012+0000 7fc18fe32700 1 -- 172.21.15.52:0/2555554208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1700052e0 con 0x7fc1880714c0 2023-06-23T18:44:57.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.012+0000 7fefb77fe700 1 --2- 172.21.15.52:0/4212613171 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fefa406ace0 0x7fefa406d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fefb0014040 tx=0x7fefb0011000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:57.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.014+0000 7fef9ffff700 1 -- 172.21.15.52:0/4212613171 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fefac0541d0 con 0x7fefb80b6f10 2023-06-23T18:44:57.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.016+0000 7f889e7fc700 1 -- 172.21.15.52:0/2886394256 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f88a000e430 con 0x7f88a80b7c70 2023-06-23T18:44:57.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.017+0000 7f889e7fc700 1 --2- 172.21.15.52:0/2886394256 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f888c06ad30 0x7f888c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.017+0000 7f889e7fc700 1 -- 172.21.15.52:0/2886394256 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f88a0006e40 con 0x7f88a80b7c70 2023-06-23T18:44:57.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.020+0000 7f88ada98700 1 --2- 172.21.15.52:0/2886394256 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f888c06ad30 0x7f888c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.020+0000 7f88ada98700 1 --2- 172.21.15.52:0/2886394256 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f888c06ad30 0x7f888c06d1e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f88a4005910 tx=0x7f88a4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:57.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.019+0000 7f925affd700 1 -- 172.21.15.52:0/2039996674 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9260007230 con 0x7f926c0bb850 2023-06-23T18:44:57.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.019+0000 7f925affd700 1 --2- 172.21.15.52:0/2039996674 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f924c06ace0 0x7f924c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.019+0000 7f925affd700 1 -- 172.21.15.52:0/2039996674 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f926008aa40 con 0x7f926c0bb850 2023-06-23T18:44:57.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.020+0000 7f9269d9b700 1 --2- 172.21.15.52:0/2039996674 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f924c06ace0 0x7f924c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.020+0000 7f9269d9b700 1 --2- 172.21.15.52:0/2039996674 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f924c06ace0 0x7f924c06d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f925c006f10 tx=0x7f925c006e80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:57.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.021+0000 7fc17e7fc700 1 -- 172.21.15.52:0/2555554208 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc18401a400 con 0x7fc1880714c0 2023-06-23T18:44:57.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.022+0000 7fc17e7fc700 1 --2- 172.21.15.52:0/2555554208 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc16c06ace0 0x7fc16c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:57.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.022+0000 7fc17e7fc700 1 -- 172.21.15.52:0/2555554208 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc184089b30 con 0x7fc1880714c0 2023-06-23T18:44:57.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.022+0000 7fc18d3cd700 1 --2- 172.21.15.52:0/2555554208 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc16c06ace0 0x7fc16c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:57.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.023+0000 7fc18d3cd700 1 --2- 172.21.15.52:0/2555554208 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc16c06ace0 0x7fc16c06d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc188148ed0 tx=0x7fc178006cd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:57.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.029+0000 7fc17e7fc700 1 -- 172.21.15.52:0/2555554208 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc184054bc0 con 0x7fc1880714c0 2023-06-23T18:44:57.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.033+0000 7f925affd700 1 -- 172.21.15.52:0/2039996674 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9260055ae0 con 0x7f926c0bb850 2023-06-23T18:44:57.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.042+0000 7f889e7fc700 1 -- 172.21.15.52:0/2886394256 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f88a0054a40 con 0x7f88a80b7c70 2023-06-23T18:44:57.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.398+0000 7f8132cb9700 1 -- 172.21.15.52:0/1958628052 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f812c140f40 con 0x7f812c06f930 2023-06-23T18:44:57.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.399+0000 7f4c0bb08700 1 -- 172.21.15.52:0/3909658548 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4c040b64a0 con 0x7f4c04148c20 2023-06-23T18:44:57.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.403+0000 7f22a88c9700 1 -- 172.21.15.52:0/1487160199 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f22a41412e0 con 0x7f22a4071a80 2023-06-23T18:44:57.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.403+0000 7f2292ffd700 1 -- 172.21.15.52:0/1487160199 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f22a41412e0 con 0x7f22a4071a80 2023-06-23T18:44:57.408 INFO:teuthology.orchestra.run.smithi052.stdout:55834574854 2023-06-23T18:44:57.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.405+0000 7f8129ffb700 1 -- 172.21.15.52:0/1958628052 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8114056f20 con 0x7f812c06f930 2023-06-23T18:44:57.409 INFO:teuthology.orchestra.run.smithi052.stdout:55834574851 2023-06-23T18:44:57.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.403+0000 7f53ccb13700 1 -- 172.21.15.52:0/2136118471 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f53c814edf0 con 0x7f53c8071b60 2023-06-23T18:44:57.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.408+0000 7f8132cb9700 1 -- 172.21.15.52:0/1958628052 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f810c06ace0 msgr2=0x7f810c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.408+0000 7f8132cb9700 1 --2- 172.21.15.52:0/1958628052 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f810c06ace0 0x7f810c06d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f811c009e50 tx=0x7f811c009000 comp rx=0 tx=0).stop 2023-06-23T18:44:57.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.408+0000 7f8132cb9700 1 -- 172.21.15.52:0/1958628052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f812c06f930 msgr2=0x7f812c0afc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.408+0000 7f8132cb9700 1 --2- 172.21.15.52:0/1958628052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f812c06f930 0x7f812c0afc80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f811400c4e0 tx=0x7f811400c7f0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.408+0000 7f4bfa7fc700 1 -- 172.21.15.52:0/3909658548 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4c00059090 con 0x7f4c04148c20 2023-06-23T18:44:57.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.408+0000 7f8132cb9700 1 -- 172.21.15.52:0/1958628052 shutdown_connections 2023-06-23T18:44:57.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.408+0000 7f8132cb9700 1 --2- 172.21.15.52:0/1958628052 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f810c06ace0 0x7f810c06d190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.408+0000 7f8132cb9700 1 --2- 172.21.15.52:0/1958628052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f812c0bcc50 0x7f812c13d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.408+0000 7f8132cb9700 1 --2- 172.21.15.52:0/1958628052 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f812c06f930 0x7f812c0afc80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.408+0000 7f8132cb9700 1 --2- 172.21.15.52:0/1958628052 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f812c071a80 0x7f812c0b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.408+0000 7f8132cb9700 1 -- 172.21.15.52:0/1958628052 >> 172.21.15.52:0/1958628052 conn(0x7f812c0bc170 msgr2=0x7f812c13e330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:57.415 INFO:teuthology.orchestra.run.smithi052.stdout:55834574851 2023-06-23T18:44:57.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.411+0000 7f4c0bb08700 1 -- 172.21.15.52:0/3909658548 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f4be806ace0 msgr2=0x7f4be806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.411+0000 7f4c0bb08700 1 --2- 172.21.15.52:0/3909658548 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f4be806ace0 0x7f4be806d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4007fd0 tx=0x7f4bf4007ec0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.411+0000 7f4c0bb08700 1 -- 172.21.15.52:0/3909658548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c04148c20 msgr2=0x7f4c04145df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.411+0000 7f4c0bb08700 1 --2- 172.21.15.52:0/3909658548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c04148c20 0x7f4c04145df0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4c00009130 tx=0x7f4c00004750 comp rx=0 tx=0).stop 2023-06-23T18:44:57.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.411+0000 7f8132cb9700 1 -- 172.21.15.52:0/1958628052 shutdown_connections 2023-06-23T18:44:57.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.411+0000 7f8132cb9700 1 -- 172.21.15.52:0/1958628052 wait complete. 2023-06-23T18:44:57.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.411+0000 7f4c0bb08700 1 -- 172.21.15.52:0/3909658548 shutdown_connections 2023-06-23T18:44:57.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.411+0000 7f4c0bb08700 1 --2- 172.21.15.52:0/3909658548 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f4be806ace0 0x7f4be806d190 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4bf4007fd0 tx=0x7f4bf4007ec0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.411+0000 7f4c0bb08700 1 --2- 172.21.15.52:0/3909658548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c04152300 0x7f4c040b2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.411+0000 7f4c0bb08700 1 --2- 172.21.15.52:0/3909658548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c0406f400 0x7f4c0414b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.411+0000 7f4c0bb08700 1 --2- 172.21.15.52:0/3909658548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c04148c20 0x7f4c04145df0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.411+0000 7f4c0bb08700 1 -- 172.21.15.52:0/3909658548 >> 172.21.15.52:0/3909658548 conn(0x7f4c040bc170 msgr2=0x7f4c0413a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:57.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.411+0000 7f4c0bb08700 1 -- 172.21.15.52:0/3909658548 shutdown_connections 2023-06-23T18:44:57.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.411+0000 7f22a88c9700 1 -- 172.21.15.52:0/1487160199 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f228406ad30 msgr2=0x7f228406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.411+0000 7f22a88c9700 1 --2- 172.21.15.52:0/1487160199 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f228406ad30 0x7f228406d1e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2294009be0 tx=0x7f2294009210 comp rx=0 tx=0).stop 2023-06-23T18:44:57.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.411+0000 7f22a88c9700 1 -- 172.21.15.52:0/1487160199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22a4071a80 msgr2=0x7f22a40bb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.411+0000 7f22a88c9700 1 --2- 172.21.15.52:0/1487160199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22a4071a80 0x7f22a40bb850 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2298001eb0 tx=0x7f229800c7b0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.411+0000 7f4c0bb08700 1 -- 172.21.15.52:0/3909658548 wait complete. 2023-06-23T18:44:57.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.411+0000 7f22a88c9700 1 -- 172.21.15.52:0/1487160199 shutdown_connections 2023-06-23T18:44:57.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.411+0000 7f22a88c9700 1 --2- 172.21.15.52:0/1487160199 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f228406ad30 0x7f228406d1e0 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2294009be0 tx=0x7f2294009210 comp rx=0 tx=0).stop 2023-06-23T18:44:57.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.411+0000 7f22a88c9700 1 --2- 172.21.15.52:0/1487160199 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22a40bcc50 0x7f22a41415d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.411+0000 7f22a88c9700 1 --2- 172.21.15.52:0/1487160199 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22a406f930 0x7f22a41d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.411+0000 7f22a88c9700 1 --2- 172.21.15.52:0/1487160199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f22a4071a80 0x7f22a40bb850 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.411+0000 7f22a88c9700 1 -- 172.21.15.52:0/1487160199 >> 172.21.15.52:0/1487160199 conn(0x7f22a40bc170 msgr2=0x7f22a413e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:57.421 INFO:teuthology.orchestra.run.smithi052.stdout:55834574852 2023-06-23T18:44:57.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.414+0000 7f53b6ffd700 1 -- 172.21.15.52:0/2136118471 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f53bc057b30 con 0x7f53c8071b60 2023-06-23T18:44:57.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.420+0000 7f53ccb13700 1 -- 172.21.15.52:0/2136118471 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f53a806adb0 msgr2=0x7f53a806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.420+0000 7f53ccb13700 1 --2- 172.21.15.52:0/2136118471 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f53a806adb0 0x7f53a806d260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f53c80b6d90 tx=0x7f53b8008030 comp rx=0 tx=0).stop 2023-06-23T18:44:57.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.420+0000 7f53ccb13700 1 -- 172.21.15.52:0/2136118471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53c8071b60 msgr2=0x7f53c8138770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.420+0000 7f53ccb13700 1 --2- 172.21.15.52:0/2136118471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53c8071b60 0x7f53c8138770 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00e8e0 tx=0x7f53bc00ebf0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.420+0000 7fefbe04c700 1 -- 172.21.15.52:0/4212613171 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fefb80bcd50 con 0x7fefb80b6f10 2023-06-23T18:44:57.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.420+0000 7f22a88c9700 1 -- 172.21.15.52:0/1487160199 shutdown_connections 2023-06-23T18:44:57.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.420+0000 7f22a88c9700 1 -- 172.21.15.52:0/1487160199 wait complete. 2023-06-23T18:44:57.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.423+0000 7f53ccb13700 1 -- 172.21.15.52:0/2136118471 shutdown_connections 2023-06-23T18:44:57.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.423+0000 7f53ccb13700 1 --2- 172.21.15.52:0/2136118471 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f53a806adb0 0x7f53a806d260 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.423+0000 7f53ccb13700 1 --2- 172.21.15.52:0/2136118471 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53c8151e00 0x7f53c814a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.423+0000 7f53ccb13700 1 --2- 172.21.15.52:0/2136118471 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53c8071b60 0x7f53c8138770 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.423+0000 7f53ccb13700 1 --2- 172.21.15.52:0/2136118471 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53c8148b90 0x7f53c81497d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.423+0000 7f53ccb13700 1 -- 172.21.15.52:0/2136118471 >> 172.21.15.52:0/2136118471 conn(0x7f53c80bc170 msgr2=0x7f53c8136270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:57.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.426+0000 7fef9ffff700 1 -- 172.21.15.52:0/4212613171 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fefac017020 con 0x7fefb80b6f10 2023-06-23T18:44:57.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.426+0000 7f53ccb13700 1 -- 172.21.15.52:0/2136118471 shutdown_connections 2023-06-23T18:44:57.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.426+0000 7f53ccb13700 1 -- 172.21.15.52:0/2136118471 wait complete. 2023-06-23T18:44:57.433 INFO:teuthology.orchestra.run.smithi052.stdout:55834574852 2023-06-23T18:44:57.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.2 2023-06-23T18:44:57.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.428+0000 7fefbe04c700 1 -- 172.21.15.52:0/4212613171 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fefa406ace0 msgr2=0x7fefa406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.428+0000 7fefbe04c700 1 --2- 172.21.15.52:0/4212613171 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fefa406ace0 0x7fefa406d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fefb0014040 tx=0x7fefb0011000 comp rx=0 tx=0).stop 2023-06-23T18:44:57.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.428+0000 7fefbe04c700 1 -- 172.21.15.52:0/4212613171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefb80b6f10 msgr2=0x7fefb814cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.428+0000 7fefbe04c700 1 --2- 172.21.15.52:0/4212613171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefb80b6f10 0x7fefb814cbf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fefac00c430 tx=0x7fefac00c7f0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.428+0000 7fefbe04c700 1 -- 172.21.15.52:0/4212613171 shutdown_connections 2023-06-23T18:44:57.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.428+0000 7fefbe04c700 1 --2- 172.21.15.52:0/4212613171 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fefa406ace0 0x7fefa406d190 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fefb0014040 tx=0x7fefb0011000 comp rx=0 tx=0).stop 2023-06-23T18:44:57.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.428+0000 7fefbe04c700 1 --2- 172.21.15.52:0/4212613171 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fefb80bda10 0x7fefb81e7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.428+0000 7fefbe04c700 1 --2- 172.21.15.52:0/4212613171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fefb80b6ae0 0x7fefb81d9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.428+0000 7fefbe04c700 1 --2- 172.21.15.52:0/4212613171 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fefb80b6f10 0x7fefb814cbf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.435 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.428+0000 7fefbe04c700 1 -- 172.21.15.52:0/4212613171 >> 172.21.15.52:0/4212613171 conn(0x7fefb806c820 msgr2=0x7fefb8152230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:57.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.429+0000 7fefbe04c700 1 -- 172.21.15.52:0/4212613171 shutdown_connections 2023-06-23T18:44:57.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.429+0000 7fefbe04c700 1 -- 172.21.15.52:0/4212613171 wait complete. 2023-06-23T18:44:57.442 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.4 2023-06-23T18:44:57.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.439+0000 7f88afcfc700 1 -- 172.21.15.52:0/2886394256 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8890005860 con 0x7f88a80b7c70 2023-06-23T18:44:57.446 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2023-06-23T18:44:57.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.441+0000 7f889e7fc700 1 -- 172.21.15.52:0/2886394256 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f88a0058060 con 0x7f88a80b7c70 2023-06-23T18:44:57.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.441+0000 7fc18fe32700 1 -- 172.21.15.52:0/2555554208 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc170005860 con 0x7fc1880714c0 2023-06-23T18:44:57.447 INFO:teuthology.orchestra.run.smithi052.stdout:55834574852 2023-06-23T18:44:57.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.443+0000 7fc17e7fc700 1 -- 172.21.15.52:0/2555554208 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc1840581e0 con 0x7fc1880714c0 2023-06-23T18:44:57.448 INFO:teuthology.orchestra.run.smithi052.stdout:55834574852 2023-06-23T18:44:57.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.445+0000 7f88afcfc700 1 -- 172.21.15.52:0/2886394256 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f888c06ad30 msgr2=0x7f888c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.445+0000 7f88afcfc700 1 --2- 172.21.15.52:0/2886394256 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f888c06ad30 0x7f888c06d1e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f88a4005910 tx=0x7f88a4009040 comp rx=0 tx=0).stop 2023-06-23T18:44:57.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.445+0000 7f88afcfc700 1 -- 172.21.15.52:0/2886394256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88a80b7c70 msgr2=0x7f88a81e3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.445+0000 7f88afcfc700 1 --2- 172.21.15.52:0/2886394256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88a80b7c70 0x7f88a81e3ed0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f88a000b970 tx=0x7f88a000bc80 comp rx=0 tx=0).stop 2023-06-23T18:44:57.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.445+0000 7f88afcfc700 1 -- 172.21.15.52:0/2886394256 shutdown_connections 2023-06-23T18:44:57.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.445+0000 7f88afcfc700 1 --2- 172.21.15.52:0/2886394256 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f888c06ad30 0x7f888c06d1e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.445+0000 7f88afcfc700 1 --2- 172.21.15.52:0/2886394256 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88a80b7c70 0x7f88a81e3ed0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.445+0000 7f88afcfc700 1 --2- 172.21.15.52:0/2886394256 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88a806c1f0 0x7f88a813e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.445+0000 7f88afcfc700 1 --2- 172.21.15.52:0/2886394256 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88a8071a80 0x7f88a81484c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.445+0000 7f88afcfc700 1 -- 172.21.15.52:0/2886394256 >> 172.21.15.52:0/2886394256 conn(0x7f88a80bdf30 msgr2=0x7f88a806a620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:57.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.445+0000 7f88afcfc700 1 -- 172.21.15.52:0/2886394256 shutdown_connections 2023-06-23T18:44:57.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.445+0000 7f88afcfc700 1 -- 172.21.15.52:0/2886394256 wait complete. 2023-06-23T18:44:57.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.446+0000 7fc18fe32700 1 -- 172.21.15.52:0/2555554208 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc16c06ace0 msgr2=0x7fc16c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.446+0000 7fc18fe32700 1 --2- 172.21.15.52:0/2555554208 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc16c06ace0 0x7fc16c06d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc188148ed0 tx=0x7fc178006cd0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.446+0000 7fc18fe32700 1 -- 172.21.15.52:0/2555554208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1880714c0 msgr2=0x7fc188070540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.446+0000 7fc18fe32700 1 --2- 172.21.15.52:0/2555554208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1880714c0 0x7fc188070540 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc18400b550 tx=0x7fc18400b910 comp rx=0 tx=0).stop 2023-06-23T18:44:57.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.446+0000 7fc18fe32700 1 -- 172.21.15.52:0/2555554208 shutdown_connections 2023-06-23T18:44:57.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.446+0000 7fc18fe32700 1 --2- 172.21.15.52:0/2555554208 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc16c06ace0 0x7fc16c06d190 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.446+0000 7fc18fe32700 1 --2- 172.21.15.52:0/2555554208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1881487c0 0x7fc1881e7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.446+0000 7fc18fe32700 1 --2- 172.21.15.52:0/2555554208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1880714c0 0x7fc188070540 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.446+0000 7fc18fe32700 1 --2- 172.21.15.52:0/2555554208 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc1881455d0 0x7fc188070a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.446+0000 7fc18fe32700 1 -- 172.21.15.52:0/2555554208 >> 172.21.15.52:0/2555554208 conn(0x7fc1880bc170 msgr2=0x7fc18806a780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:57.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.446+0000 7fc18fe32700 1 -- 172.21.15.52:0/2555554208 shutdown_connections 2023-06-23T18:44:57.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2023-06-23T18:44:57.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.446+0000 7fc18fe32700 1 -- 172.21.15.52:0/2555554208 wait complete. 2023-06-23T18:44:57.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.449+0000 7f9270e10700 1 -- 172.21.15.52:0/2039996674 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f926c04e1d0 con 0x7f926c0bb850 2023-06-23T18:44:57.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.449+0000 7f925affd700 1 -- 172.21.15.52:0/2039996674 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9260017090 con 0x7f926c0bb850 2023-06-23T18:44:57.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2023-06-23T18:44:57.457 INFO:teuthology.orchestra.run.smithi052.stdout:55834574852 2023-06-23T18:44:57.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.453+0000 7f9270e10700 1 -- 172.21.15.52:0/2039996674 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f924c06ace0 msgr2=0x7f924c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.453+0000 7f9270e10700 1 --2- 172.21.15.52:0/2039996674 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f924c06ace0 0x7f924c06d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f925c006f10 tx=0x7f925c006e80 comp rx=0 tx=0).stop 2023-06-23T18:44:57.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.453+0000 7f9270e10700 1 -- 172.21.15.52:0/2039996674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f926c0bb850 msgr2=0x7f926c1dc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:57.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.453+0000 7f9270e10700 1 --2- 172.21.15.52:0/2039996674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f926c0bb850 0x7f926c1dc050 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f925400c190 tx=0x7f9260001930 comp rx=0 tx=0).stop 2023-06-23T18:44:57.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.453+0000 7f9270e10700 1 -- 172.21.15.52:0/2039996674 shutdown_connections 2023-06-23T18:44:57.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.453+0000 7f9270e10700 1 --2- 172.21.15.52:0/2039996674 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f924c06ace0 0x7f924c06d190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.453+0000 7f9270e10700 1 --2- 172.21.15.52:0/2039996674 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f926c0b1c70 0x7f926c0b2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.453+0000 7f9270e10700 1 --2- 172.21.15.52:0/2039996674 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f926c0bb850 0x7f926c1dc050 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.453+0000 7f9270e10700 1 --2- 172.21.15.52:0/2039996674 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f926c1dead0 0x7f926c1468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:57.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.453+0000 7f9270e10700 1 -- 172.21.15.52:0/2039996674 >> 172.21.15.52:0/2039996674 conn(0x7f926c0bc170 msgr2=0x7f926c143bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:57.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.454+0000 7f9270e10700 1 -- 172.21.15.52:0/2039996674 shutdown_connections 2023-06-23T18:44:57.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:57.454+0000 7f9270e10700 1 -- 172.21.15.52:0/2039996674 wait complete. 2023-06-23T18:44:57.466 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-06-23T18:44:57.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2023-06-23T18:44:57.472 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2023-06-23T18:44:57.817 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:44:57.819 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:44:57.821 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:44:58.434 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-23T18:44:58.443 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-23T18:44:58.447 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-23T18:44:58.456 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-23T18:44:58.457 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-23T18:44:58.468 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-23T18:44:58.468 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-23T18:44:58.473 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-23T18:44:58.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.643+0000 7fe109e1f700 1 Processor -- start 2023-06-23T18:44:58.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.643+0000 7fe109e1f700 1 -- start start 2023-06-23T18:44:58.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.644+0000 7fe109e1f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe104157ce0 0x7fe104070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.644+0000 7fe109e1f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe104071620 0x7fe104071a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.644+0000 7fe109e1f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1040b8a20 con 0x7fe1040b7c60 2023-06-23T18:44:58.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.644+0000 7fe109e1f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe104089270 con 0x7fe104071620 2023-06-23T18:44:58.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.644+0000 7fe109e1f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040700b0 con 0x7fe104157ce0 2023-06-23T18:44:58.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.645+0000 7fe102ffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe1040b7c60 0x7fe10406f9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44806/0 (socket says 172.21.15.52:44806) 2023-06-23T18:44:58.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.645+0000 7fe102ffd700 1 -- 172.21.15.52:0/3906518918 learned_addr learned my addr 172.21.15.52:0/3906518918 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:58.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.645+0000 7fe1037fe700 1 --2- 172.21.15.52:0/3906518918 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe104157ce0 0x7fe104070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.645+0000 7fe103fff700 1 --2- 172.21.15.52:0/3906518918 >> v2:172.21.15.89:3300/0 conn(0x7fe104071620 0x7fe104071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.647+0000 7fe1037fe700 1 -- 172.21.15.52:0/3906518918 >> v2:172.21.15.89:3300/0 conn(0x7fe104071620 msgr2=0x7fe104071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:58.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.647+0000 7fe1037fe700 1 --2- 172.21.15.52:0/3906518918 >> v2:172.21.15.89:3300/0 conn(0x7fe104071620 0x7fe104071a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.647+0000 7fe1037fe700 1 -- 172.21.15.52:0/3906518918 >> v1:172.21.15.52:6789/0 conn(0x7fe1040b7c60 legacy=0x7fe10406f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.647+0000 7fe1037fe700 1 -- 172.21.15.52:0/3906518918 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1041580b0 con 0x7fe104157ce0 2023-06-23T18:44:58.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.647+0000 7fe1037fe700 1 --2- 172.21.15.52:0/3906518918 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe104157ce0 0x7fe104070b70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc008d70 tx=0x7fe0fc00c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f6ed48f8cd0ec96 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:58.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.648+0000 7fe1027fc700 1 -- 172.21.15.52:0/3906518918 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc00cda0 con 0x7fe104157ce0 2023-06-23T18:44:58.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.648+0000 7fe1027fc700 1 -- 172.21.15.52:0/3906518918 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0fc00e040 con 0x7fe104157ce0 2023-06-23T18:44:58.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.648+0000 7fe1027fc700 1 -- 172.21.15.52:0/3906518918 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc012610 con 0x7fe104157ce0 2023-06-23T18:44:58.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.649+0000 7fe109e1f700 1 -- 172.21.15.52:0/3906518918 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe104157ce0 msgr2=0x7fe104070b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.649+0000 7fe109e1f700 1 --2- 172.21.15.52:0/3906518918 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe104157ce0 0x7fe104070b70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc008d70 tx=0x7fe0fc00c3b0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.651+0000 7fe109e1f700 1 -- 172.21.15.52:0/3906518918 shutdown_connections 2023-06-23T18:44:58.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.651+0000 7fe109e1f700 1 --2- 172.21.15.52:0/3906518918 >> v2:172.21.15.89:3300/0 conn(0x7fe104071620 0x7fe104071a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.651+0000 7fe109e1f700 1 --2- 172.21.15.52:0/3906518918 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe104157ce0 0x7fe104070b70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.651+0000 7fe109e1f700 1 -- 172.21.15.52:0/3906518918 >> 172.21.15.52:0/3906518918 conn(0x7fe1040bc170 msgr2=0x7fe1040bc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:58.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.653+0000 7fe109e1f700 1 -- 172.21.15.52:0/3906518918 shutdown_connections 2023-06-23T18:44:58.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.653+0000 7fe109e1f700 1 -- 172.21.15.52:0/3906518918 wait complete. 2023-06-23T18:44:58.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.655+0000 7fe109e1f700 1 Processor -- start 2023-06-23T18:44:58.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.655+0000 7fe109e1f700 1 -- start start 2023-06-23T18:44:58.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.656+0000 7fe109e1f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe104071620 0x7fe1041f8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.656+0000 7fe109e1f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1040b7c60 0x7fe1041f6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.656+0000 7fe109e1f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe104157ce0 0x7fe1041ea2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.656+0000 7fe109e1f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe104082f30 con 0x7fe104071620 2023-06-23T18:44:58.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.656+0000 7fe109e1f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040bb570 con 0x7fe1040b7c60 2023-06-23T18:44:58.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.656+0000 7fe109e1f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040b2f30 con 0x7fe104157ce0 2023-06-23T18:44:58.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.657+0000 7fe103fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe104157ce0 0x7fe1041ea2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.657+0000 7fe103fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe104157ce0 0x7fe1041ea2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.52:49128/0 (socket says 172.21.15.52:49128) 2023-06-23T18:44:58.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.657+0000 7fe103fff700 1 -- 172.21.15.52:0/1302872821 learned_addr learned my addr 172.21.15.52:0/1302872821 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:58.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.657+0000 7fe103fff700 1 -- 172.21.15.52:0/1302872821 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1040b7c60 msgr2=0x7fe1041f6210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-23T18:44:58.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.657+0000 7fe103fff700 1 --2- 172.21.15.52:0/1302872821 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1040b7c60 0x7fe1041f6210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.657+0000 7fe103fff700 1 -- 172.21.15.52:0/1302872821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe104071620 msgr2=0x7fe1041f8580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-23T18:44:58.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.657+0000 7fe103fff700 1 --2- 172.21.15.52:0/1302872821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe104071620 0x7fe1041f8580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.657+0000 7fe103fff700 1 -- 172.21.15.52:0/1302872821 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc0089d0 con 0x7fe104157ce0 2023-06-23T18:44:58.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.657+0000 7fe103fff700 1 --2- 172.21.15.52:0/1302872821 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe104157ce0 0x7fe1041ea2a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe0f800ecc0 tx=0x7fe0f800d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:58.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.659+0000 7fe0ebfff700 1 -- 172.21.15.52:0/1302872821 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f800de40 con 0x7fe104157ce0 2023-06-23T18:44:58.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.659+0000 7fe0ebfff700 1 -- 172.21.15.52:0/1302872821 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f8010440 con 0x7fe104157ce0 2023-06-23T18:44:58.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.659+0000 7fe0ebfff700 1 -- 172.21.15.52:0/1302872821 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f80107d0 con 0x7fe104157ce0 2023-06-23T18:44:58.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.659+0000 7fe109e1f700 1 -- 172.21.15.52:0/1302872821 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe104081890 con 0x7fe104157ce0 2023-06-23T18:44:58.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.659+0000 7fe109e1f700 1 -- 172.21.15.52:0/1302872821 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1041f8ac0 con 0x7fe104157ce0 2023-06-23T18:44:58.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.662+0000 7fe0ebfff700 1 -- 172.21.15.52:0/1302872821 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe0f8010930 con 0x7fe104157ce0 2023-06-23T18:44:58.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.663+0000 7fe0ebfff700 1 --2- 172.21.15.52:0/1302872821 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe0f006ad30 0x7fe0f006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.663+0000 7fe0ebfff700 1 -- 172.21.15.52:0/1302872821 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe0f8014070 con 0x7fe104157ce0 2023-06-23T18:44:58.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.664+0000 7fe1037fe700 1 --2- 172.21.15.52:0/1302872821 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe0f006ad30 0x7fe0f006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.664+0000 7fe1037fe700 1 --2- 172.21.15.52:0/1302872821 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe0f006ad30 0x7fe0f006d1e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc00c3f0 tx=0x7fe0fc00a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:58.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.664+0000 7fe109e1f700 1 -- 172.21.15.52:0/1302872821 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e40052e0 con 0x7fe104157ce0 2023-06-23T18:44:58.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.672+0000 7fe0ebfff700 1 -- 172.21.15.52:0/1302872821 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe0f8054ce0 con 0x7fe104157ce0 2023-06-23T18:44:58.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.702+0000 7f855fd8c700 1 Processor -- start 2023-06-23T18:44:58.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.703+0000 7fdbe84a3700 1 Processor -- start 2023-06-23T18:44:58.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.703+0000 7fdbe84a3700 1 -- start start 2023-06-23T18:44:58.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.702+0000 7f855fd8c700 1 -- start start 2023-06-23T18:44:58.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.703+0000 7f855fd8c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8558143b90 0x7f85581464c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.704+0000 7f855fd8c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8558071a80 0x7f855806f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.704+0000 7f855fd8c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8558146a00 0x7f855806fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.704+0000 7f855fd8c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8558071f60 con 0x7f8558071a80 2023-06-23T18:44:58.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.704+0000 7f855fd8c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8558143f60 con 0x7f8558146a00 2023-06-23T18:44:58.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.704+0000 7f855fd8c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85580716f0 con 0x7f8558143b90 2023-06-23T18:44:58.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.704+0000 7f855d327700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8558071a80 0x7f855806f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.704+0000 7f855d327700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8558071a80 0x7f855806f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52114/0 (socket says 172.21.15.52:52114) 2023-06-23T18:44:58.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.704+0000 7f855d327700 1 -- 172.21.15.52:0/2391973900 learned_addr learned my addr 172.21.15.52:0/2391973900 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:58.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.704+0000 7fdbe84a3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdbe0148b90 0x7fdbe006f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.704+0000 7fdbe84a3700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdbe0071640 0x7fdbe0071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.704+0000 7fdbe84a3700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe00b7c40 con 0x7fdbe014e7b0 2023-06-23T18:44:58.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.704+0000 7fdbe84a3700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe006b7a0 con 0x7fdbe0071640 2023-06-23T18:44:58.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.704+0000 7fdbe84a3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe0148f60 con 0x7fdbe0148b90 2023-06-23T18:44:58.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.705+0000 7fdbe6a40700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdbe014e7b0 0x7fdbe0151d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44814/0 (socket says 172.21.15.52:44814) 2023-06-23T18:44:58.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.705+0000 7fdbe6a40700 1 -- 172.21.15.52:0/2162728565 learned_addr learned my addr 172.21.15.52:0/2162728565 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:58.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.705+0000 7f855d327700 1 -- 172.21.15.52:0/2391973900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8558143b90 msgr2=0x7f85581464c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-23T18:44:58.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.705+0000 7f855d327700 1 --2- 172.21.15.52:0/2391973900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8558143b90 0x7f85581464c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.705+0000 7f855d327700 1 -- 172.21.15.52:0/2391973900 >> v2:172.21.15.89:3300/0 conn(0x7f8558146a00 msgr2=0x7f855806fe70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-23T18:44:58.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.705+0000 7f855d327700 1 --2- 172.21.15.52:0/2391973900 >> v2:172.21.15.89:3300/0 conn(0x7f8558146a00 0x7f855806fe70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.705+0000 7f855d327700 1 -- 172.21.15.52:0/2391973900 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855806f4a0 con 0x7f8558071a80 2023-06-23T18:44:58.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.705+0000 7fdbe623f700 1 --2- 172.21.15.52:0/2162728565 >> v2:172.21.15.89:3300/0 conn(0x7fdbe0148b90 0x7fdbe006f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.705+0000 7f855d327700 1 --2- 172.21.15.52:0/2391973900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8558071a80 0x7f855806f930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8558146ea0 tx=0x7f8554008bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d74d99a8f5c720 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:58.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.705+0000 7fdbe523d700 1 -- 172.21.15.52:0/2162728565 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138932670 0 0) 0x7fdbe00b7c40 con 0x7fdbe014e7b0 2023-06-23T18:44:58.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.705+0000 7fdbe523d700 1 -- 172.21.15.52:0/2162728565 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbcc0035b0 con 0x7fdbe014e7b0 2023-06-23T18:44:58.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.706+0000 7fdbe5a3e700 1 --2- 172.21.15.52:0/2162728565 >> v2:172.21.15.52:3300/0 conn(0x7fdbe0071640 0x7fdbe0071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.706+0000 7fdbe623f700 1 -- 172.21.15.52:0/2162728565 >> v2:172.21.15.52:3300/0 conn(0x7fdbe0071640 msgr2=0x7fdbe0071aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:58.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.706+0000 7fdbe623f700 1 --2- 172.21.15.52:0/2162728565 >> v2:172.21.15.52:3300/0 conn(0x7fdbe0071640 0x7fdbe0071aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.706+0000 7fdbe623f700 1 -- 172.21.15.52:0/2162728565 >> v1:172.21.15.52:6789/0 conn(0x7fdbe014e7b0 legacy=0x7fdbe0151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.706+0000 7fdbe623f700 1 -- 172.21.15.52:0/2162728565 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe0070fb0 con 0x7fdbe0148b90 2023-06-23T18:44:58.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.705+0000 7f855cb26700 1 -- 172.21.15.52:0/2391973900 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855400b820 con 0x7f8558071a80 2023-06-23T18:44:58.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.705+0000 7f855cb26700 1 -- 172.21.15.52:0/2391973900 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855400b980 con 0x7f8558071a80 2023-06-23T18:44:58.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.705+0000 7f855cb26700 1 -- 172.21.15.52:0/2391973900 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85540126f0 con 0x7f8558071a80 2023-06-23T18:44:58.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.706+0000 7fdbe623f700 1 --2- 172.21.15.52:0/2162728565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbe0148b90 0x7fdbe006f920 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0073d10 tx=0x7fdbd800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c0349bf67b206e5 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:58.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.706+0000 7f58aebf0700 1 Processor -- start 2023-06-23T18:44:58.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.706+0000 7f58aebf0700 1 -- start start 2023-06-23T18:44:58.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.706+0000 7f855fd8c700 1 -- 172.21.15.52:0/2391973900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8558071a80 msgr2=0x7f855806f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.706+0000 7f855fd8c700 1 --2- 172.21.15.52:0/2391973900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8558071a80 0x7f855806f930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8558146ea0 tx=0x7f8554008bd0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.706+0000 7f855fd8c700 1 -- 172.21.15.52:0/2391973900 shutdown_connections 2023-06-23T18:44:58.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.706+0000 7f855fd8c700 1 --2- 172.21.15.52:0/2391973900 >> v2:172.21.15.89:3300/0 conn(0x7f8558146a00 0x7f855806fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.706+0000 7f855fd8c700 1 --2- 172.21.15.52:0/2391973900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8558143b90 0x7f85581464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.706+0000 7f855fd8c700 1 --2- 172.21.15.52:0/2391973900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8558071a80 0x7f855806f930 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.706+0000 7f855fd8c700 1 -- 172.21.15.52:0/2391973900 >> 172.21.15.52:0/2391973900 conn(0x7f85580bc170 msgr2=0x7f85580bc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:58.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.708+0000 7f58aebf0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f58a8071640 0x7f58a8071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.708+0000 7f58aebf0700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a80b7c40 con 0x7f58a814e7b0 2023-06-23T18:44:58.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.708+0000 7f58aebf0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a8070fb0 con 0x7f58a8148b90 2023-06-23T18:44:58.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.708+0000 7f58aebf0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a806b7a0 con 0x7f58a8071640 2023-06-23T18:44:58.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.708+0000 7f58ad18d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f58a814e7b0 0x7f58a81590c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44816/0 (socket says 172.21.15.52:44816) 2023-06-23T18:44:58.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.708+0000 7f58ad18d700 1 -- 172.21.15.52:0/2897182666 learned_addr learned my addr 172.21.15.52:0/2897182666 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:58.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.707+0000 7fdbe523d700 1 -- 172.21.15.52:0/2162728565 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd800e070 con 0x7fdbe0148b90 2023-06-23T18:44:58.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.707+0000 7fdbe523d700 1 -- 172.21.15.52:0/2162728565 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd8003a20 con 0x7fdbe0148b90 2023-06-23T18:44:58.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.707+0000 7fdbe523d700 1 -- 172.21.15.52:0/2162728565 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc001670 con 0x7fdbe0148b90 2023-06-23T18:44:58.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.709+0000 7fdbe84a3700 1 -- 172.21.15.52:0/2162728565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbe0148b90 msgr2=0x7fdbe006f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.709+0000 7fdbe84a3700 1 --2- 172.21.15.52:0/2162728565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbe0148b90 0x7fdbe006f920 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0073d10 tx=0x7fdbd800b330 comp rx=0 tx=0).stop 2023-06-23T18:44:58.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.709+0000 7fdbe84a3700 1 -- 172.21.15.52:0/2162728565 shutdown_connections 2023-06-23T18:44:58.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.709+0000 7fdbe84a3700 1 --2- 172.21.15.52:0/2162728565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbe0148b90 0x7fdbe006f920 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.709+0000 7fdbe84a3700 1 --2- 172.21.15.52:0/2162728565 >> v2:172.21.15.52:3300/0 conn(0x7fdbe0071640 0x7fdbe0071aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.709+0000 7fdbe84a3700 1 -- 172.21.15.52:0/2162728565 >> 172.21.15.52:0/2162728565 conn(0x7fdbe00bc170 msgr2=0x7fdbe00bc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:58.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.710+0000 7f58a77fe700 1 -- 172.21.15.52:0/2897182666 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351095801 0 0) 0x7f58a80b7c40 con 0x7f58a814e7b0 2023-06-23T18:44:58.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.710+0000 7f58a77fe700 1 -- 172.21.15.52:0/2897182666 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58900035b0 con 0x7f58a814e7b0 2023-06-23T18:44:58.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.710+0000 7fdbe84a3700 1 -- 172.21.15.52:0/2162728565 shutdown_connections 2023-06-23T18:44:58.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.710+0000 7f58a77fe700 1 -- 172.21.15.52:0/2897182666 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 951055503 0 0) 0x7f58900035b0 con 0x7f58a814e7b0 2023-06-23T18:44:58.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.710+0000 7f58a77fe700 1 -- 172.21.15.52:0/2897182666 >> v2:172.21.15.89:3300/0 conn(0x7f58a8071640 msgr2=0x7f58a8071aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T18:44:58.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.710+0000 7f58a77fe700 1 --2- 172.21.15.52:0/2897182666 >> v2:172.21.15.89:3300/0 conn(0x7f58a8071640 0x7f58a8071aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.710+0000 7f58a77fe700 1 -- 172.21.15.52:0/2897182666 >> v1:172.21.15.89:6789/0 conn(0x7f58a8148b90 legacy=0x7f58a806f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.710+0000 7f58a77fe700 1 -- 172.21.15.52:0/2897182666 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a80b7e90 con 0x7f58a814e7b0 2023-06-23T18:44:58.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.710+0000 7f58a77fe700 1 -- 172.21.15.52:0/2897182666 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7f5898001670 con 0x7f58a814e7b0 2023-06-23T18:44:58.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.710+0000 7f58a77fe700 1 -- 172.21.15.52:0/2897182666 >> v1:172.21.15.52:6789/0 conn(0x7f58a814e7b0 legacy=0x7f58a81590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.710+0000 7f58a77fe700 1 --2- 172.21.15.52:0/2897182666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5890003a00 0x7f5890003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.710+0000 7f58a77fe700 1 --2- 172.21.15.52:0/2897182666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5890004850 0x7f5890004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.710+0000 7f58a77fe700 1 --2- 172.21.15.52:0/2897182666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58900052d0 0x7f589000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.710+0000 7f58a77fe700 1 -- 172.21.15.52:0/2897182666 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589000c1d0 con 0x7f58900052d0 2023-06-23T18:44:58.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.710+0000 7f58a77fe700 1 -- 172.21.15.52:0/2897182666 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589000c340 con 0x7f5890004850 2023-06-23T18:44:58.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.710+0000 7f58a77fe700 1 -- 172.21.15.52:0/2897182666 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f589000c500 con 0x7f5890003a00 2023-06-23T18:44:58.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.711+0000 7f58ad18d700 1 --2- 172.21.15.52:0/2897182666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58900052d0 0x7f589000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.710+0000 7fdbe84a3700 1 -- 172.21.15.52:0/2162728565 wait complete. 2023-06-23T18:44:58.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.711+0000 7fdbe84a3700 1 Processor -- start 2023-06-23T18:44:58.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.712+0000 7f855fd8c700 1 -- 172.21.15.52:0/2391973900 shutdown_connections 2023-06-23T18:44:58.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.710+0000 7f1a3dc7f700 1 Processor -- start 2023-06-23T18:44:58.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.710+0000 7f1a3dc7f700 1 -- start start 2023-06-23T18:44:58.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.711+0000 7f1a3dc7f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1a38157ce0 0x7f1a38070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.711+0000 7f1a3dc7f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f1a380b7c60 0x7f1a3806f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.711+0000 7f1a3dc7f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a380b8a20 con 0x7f1a38071620 2023-06-23T18:44:58.730 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.711+0000 7f1a3dc7f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a38089270 con 0x7f1a380b7c60 2023-06-23T18:44:58.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.711+0000 7f1a3dc7f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a381580b0 con 0x7f1a38157ce0 2023-06-23T18:44:58.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.711+0000 7f1a37fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f1a38071620 0x7f1a3815a6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44828/0 (socket says 172.21.15.52:44828) 2023-06-23T18:44:58.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.711+0000 7f1a37fff700 1 -- 172.21.15.52:0/2863023883 learned_addr learned my addr 172.21.15.52:0/2863023883 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:58.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.712+0000 7f1a377fe700 1 --2- 172.21.15.52:0/2863023883 >> v2:172.21.15.89:3300/0 conn(0x7f1a38157ce0 0x7f1a38070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.712+0000 7f1a36ffd700 1 --2- 172.21.15.52:0/2863023883 >> v2:172.21.15.52:3300/0 conn(0x7f1a380b7c60 0x7f1a3806f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.711+0000 7fdbe84a3700 1 -- start start 2023-06-23T18:44:58.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.712+0000 7fdbe84a3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbe0071640 0x7fdbe00b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.712+0000 7fdbe84a3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbe0148b90 0x7fdbe00b2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.712+0000 7fdbe84a3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbe014e7b0 0x7fdbe01e78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.712+0000 7fdbe84a3700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe00b1bd0 con 0x7fdbe014e7b0 2023-06-23T18:44:58.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.713+0000 7fdbe84a3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe00af810 con 0x7fdbe0148b90 2023-06-23T18:44:58.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.713+0000 7fdbe84a3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe00b58f0 con 0x7fdbe0071640 2023-06-23T18:44:58.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.712+0000 7f58ad18d700 1 -- 172.21.15.52:0/2897182666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5890003a00 msgr2=0x7f5890003e10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-23T18:44:58.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.712+0000 7f58ad18d700 1 --2- 172.21.15.52:0/2897182666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5890003a00 0x7f5890003e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.712+0000 7f58ad18d700 1 -- 172.21.15.52:0/2897182666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5890004850 msgr2=0x7f5890004cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-23T18:44:58.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.712+0000 7f58ad18d700 1 --2- 172.21.15.52:0/2897182666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5890004850 0x7f5890004cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.712+0000 7f58ad18d700 1 -- 172.21.15.52:0/2897182666 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a80b7e90 con 0x7f58900052d0 2023-06-23T18:44:58.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.712+0000 7f58ad18d700 1 -- 172.21.15.52:0/2897182666 reap_dead start 2023-06-23T18:44:58.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.712+0000 7f58ad18d700 1 --2- 172.21.15.52:0/2897182666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58900052d0 0x7f589000ba10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f589800c340 tx=0x7f5890005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b5c7f015dbf452 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:58.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.713+0000 7fdbe623f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbe0071640 0x7fdbe00b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.713+0000 7fdbe623f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbe0071640 0x7fdbe00b13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.52:49148/0 (socket says 172.21.15.52:49148) 2023-06-23T18:44:58.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.713+0000 7fdbe623f700 1 -- 172.21.15.52:0/3433294539 learned_addr learned my addr 172.21.15.52:0/3433294539 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:58.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.713+0000 7fdbe6a40700 1 --2- 172.21.15.52:0/3433294539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbe014e7b0 0x7fdbe01e78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.712+0000 7f855fd8c700 1 -- 172.21.15.52:0/2391973900 wait complete. 2023-06-23T18:44:58.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.713+0000 7f855fd8c700 1 Processor -- start 2023-06-23T18:44:58.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.713+0000 7fdbe623f700 1 -- 172.21.15.52:0/3433294539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbe0148b90 msgr2=0x7fdbe00b2360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-23T18:44:58.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.713+0000 7fdbe623f700 1 --2- 172.21.15.52:0/3433294539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbe0148b90 0x7fdbe00b2360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.713+0000 7fdbe623f700 1 -- 172.21.15.52:0/3433294539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbe014e7b0 msgr2=0x7fdbe01e78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.713+0000 7fdbe623f700 1 --2- 172.21.15.52:0/3433294539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbe014e7b0 0x7fdbe01e78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.713+0000 7fdbe623f700 1 -- 172.21.15.52:0/3433294539 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd8009a70 con 0x7fdbe0071640 2023-06-23T18:44:58.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.714+0000 7fdbe623f700 1 --2- 172.21.15.52:0/3433294539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbe0071640 0x7fdbe00b13a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8000f80 tx=0x7fdbd8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:58.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.713+0000 7f58a77fe700 1 -- 172.21.15.52:0/2897182666 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589800ce80 con 0x7f58900052d0 2023-06-23T18:44:58.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.713+0000 7f58a77fe700 1 -- 172.21.15.52:0/2897182666 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5898005960 con 0x7f58900052d0 2023-06-23T18:44:58.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.713+0000 7f58a77fe700 1 -- 172.21.15.52:0/2897182666 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5898005cf0 con 0x7f58900052d0 2023-06-23T18:44:58.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.714+0000 7f58aebf0700 1 -- 172.21.15.52:0/2897182666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58900052d0 msgr2=0x7f589000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.714+0000 7f58aebf0700 1 --2- 172.21.15.52:0/2897182666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58900052d0 0x7f589000ba10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f589800c340 tx=0x7f5890005880 comp rx=0 tx=0).stop 2023-06-23T18:44:58.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.714+0000 7f58aebf0700 1 -- 172.21.15.52:0/2897182666 shutdown_connections 2023-06-23T18:44:58.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.714+0000 7f58aebf0700 1 --2- 172.21.15.52:0/2897182666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58900052d0 0x7f589000ba10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.714+0000 7f58aebf0700 1 -- 172.21.15.52:0/2897182666 >> 172.21.15.52:0/2897182666 conn(0x7f58a80bc170 msgr2=0x7f58a80bc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:58.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.713+0000 7f1a36ffd700 1 -- 172.21.15.52:0/2863023883 >> v2:172.21.15.89:3300/0 conn(0x7f1a38157ce0 msgr2=0x7f1a38070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:58.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.713+0000 7f1a36ffd700 1 --2- 172.21.15.52:0/2863023883 >> v2:172.21.15.89:3300/0 conn(0x7f1a38157ce0 0x7f1a38070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.713+0000 7f1a36ffd700 1 -- 172.21.15.52:0/2863023883 >> v1:172.21.15.52:6789/0 conn(0x7f1a38071620 legacy=0x7f1a3815a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.713+0000 7f1a36ffd700 1 -- 172.21.15.52:0/2863023883 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a380b8460 con 0x7f1a380b7c60 2023-06-23T18:44:58.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.715+0000 7f58aebf0700 1 -- 172.21.15.52:0/2897182666 shutdown_connections 2023-06-23T18:44:58.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.713+0000 7f855fd8c700 1 -- start start 2023-06-23T18:44:58.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.715+0000 7f855fd8c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8558071a80 0x7f85581e4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.715+0000 7f855fd8c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8558143b90 0x7f8558147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.715+0000 7f855fd8c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8558146a00 0x7f85580bafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.715+0000 7f855fd8c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85580bb500 con 0x7f8558146a00 2023-06-23T18:44:58.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.715+0000 7f855fd8c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85580b5250 con 0x7f8558071a80 2023-06-23T18:44:58.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.715+0000 7f855fd8c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85580b4c90 con 0x7f8558143b90 2023-06-23T18:44:58.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.715+0000 7f1a36ffd700 1 --2- 172.21.15.52:0/2863023883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a380b7c60 0x7f1a3806f9a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1a380b70a0 tx=0x7f1a2800d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6650e8a1fa6fd606 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:58.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.715+0000 7f855d327700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8558143b90 0x7f8558147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.715+0000 7f855db28700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8558071a80 0x7f85581e4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.715+0000 7ff138aee700 1 Processor -- start 2023-06-23T18:44:58.741 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.715+0000 7ff138aee700 1 -- start start 2023-06-23T18:44:58.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.715+0000 7f855d327700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8558143b90 0x7f8558147f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.52:49156/0 (socket says 172.21.15.52:49156) 2023-06-23T18:44:58.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.715+0000 7f855d327700 1 -- 172.21.15.52:0/1727806736 learned_addr learned my addr 172.21.15.52:0/1727806736 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:58.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.715+0000 7f58aebf0700 1 -- 172.21.15.52:0/2897182666 wait complete. 2023-06-23T18:44:58.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.716+0000 7f855db28700 1 -- 172.21.15.52:0/1727806736 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8558143b90 msgr2=0x7f8558147f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.716+0000 7f855db28700 1 --2- 172.21.15.52:0/1727806736 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8558143b90 0x7f8558147f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.716+0000 7f855db28700 1 -- 172.21.15.52:0/1727806736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8558146a00 msgr2=0x7f85580bafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.716+0000 7f855db28700 1 --2- 172.21.15.52:0/1727806736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8558146a00 0x7f85580bafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.716+0000 7f855db28700 1 -- 172.21.15.52:0/1727806736 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85540085d0 con 0x7f8558071a80 2023-06-23T18:44:58.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.716+0000 7f855db28700 1 --2- 172.21.15.52:0/1727806736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8558071a80 0x7f85581e4050 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f855000bb80 tx=0x7f855000be90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:58.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.717+0000 7f58aebf0700 1 Processor -- start 2023-06-23T18:44:58.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.717+0000 7f58aebf0700 1 -- start start 2023-06-23T18:44:58.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.717+0000 7f1a367fc700 1 -- 172.21.15.52:0/2863023883 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a28010070 con 0x7f1a380b7c60 2023-06-23T18:44:58.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.717+0000 7f1a367fc700 1 -- 172.21.15.52:0/2863023883 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a28004030 con 0x7f1a380b7c60 2023-06-23T18:44:58.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.717+0000 7f1a367fc700 1 -- 172.21.15.52:0/2863023883 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a28008a50 con 0x7f1a380b7c60 2023-06-23T18:44:58.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.716+0000 7fdbd6ffd700 1 -- 172.21.15.52:0/3433294539 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8004540 con 0x7fdbe0071640 2023-06-23T18:44:58.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.716+0000 7fdbd6ffd700 1 -- 172.21.15.52:0/3433294539 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd80046a0 con 0x7fdbe0071640 2023-06-23T18:44:58.745 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.716+0000 7fdbd6ffd700 1 -- 172.21.15.52:0/3433294539 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8012450 con 0x7fdbe0071640 2023-06-23T18:44:58.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.718+0000 7ff138aee700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff134071640 0x7ff134071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.718+0000 7ff138aee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff13414e7b0 0x7ff13414ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.718+0000 7ff138aee700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1340b7c40 con 0x7ff134148b90 2023-06-23T18:44:58.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.718+0000 7ff138aee700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff13406b7a0 con 0x7ff134071640 2023-06-23T18:44:58.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.718+0000 7ff138aee700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff134148f60 con 0x7ff13414e7b0 2023-06-23T18:44:58.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.718+0000 7ff131d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff134071640 0x7ff134071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.718+0000 7ff131d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff134071640 0x7ff134071aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52180/0 (socket says 172.21.15.52:52180) 2023-06-23T18:44:58.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.718+0000 7ff131d9b700 1 -- 172.21.15.52:0/3059220544 learned_addr learned my addr 172.21.15.52:0/3059220544 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:58.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.718+0000 7f58aebf0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58900052d0 0x7f58a814a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.718+0000 7f58aebf0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58a814f900 0x7f58a8147b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.718+0000 7f58aebf0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58a814fd70 0x7f58a8148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.718+0000 7f58aebf0700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a814acc0 con 0x7f58a814f900 2023-06-23T18:44:58.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.718+0000 7f58aebf0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a80b3470 con 0x7f58a814fd70 2023-06-23T18:44:58.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.718+0000 7f58aebf0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a80b3ce0 con 0x7f58900052d0 2023-06-23T18:44:58.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.718+0000 7f58a7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58a814f900 0x7f58a8147b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.718+0000 7f58a7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58a814f900 0x7f58a8147b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52184/0 (socket says 172.21.15.52:52184) 2023-06-23T18:44:58.748 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.719+0000 7f58a7fff700 1 -- 172.21.15.52:0/3722730500 learned_addr learned my addr 172.21.15.52:0/3722730500 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:58.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.719+0000 7ff131d9b700 1 -- 172.21.15.52:0/3059220544 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff13414e7b0 msgr2=0x7ff13414ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-23T18:44:58.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.719+0000 7ff131d9b700 1 --2- 172.21.15.52:0/3059220544 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff13414e7b0 0x7ff13414ebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.719+0000 7ff131d9b700 1 -- 172.21.15.52:0/3059220544 >> v1:172.21.15.52:6789/0 conn(0x7ff134148b90 legacy=0x7ff13406f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:58.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.719+0000 7ff131d9b700 1 -- 172.21.15.52:0/3059220544 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff134070fb0 con 0x7ff134071640 2023-06-23T18:44:58.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.717+0000 7fdbe84a3700 1 -- 172.21.15.52:0/3433294539 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe00b5bd0 con 0x7fdbe0071640 2023-06-23T18:44:58.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.718+0000 7fdbe84a3700 1 -- 172.21.15.52:0/3433294539 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe00b6190 con 0x7fdbe0071640 2023-06-23T18:44:58.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.719+0000 7fdbe84a3700 1 -- 172.21.15.52:0/3433294539 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe00b63b0 con 0x7fdbe0071640 2023-06-23T18:44:58.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.719+0000 7f58ac98c700 1 --2- 172.21.15.52:0/3722730500 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58900052d0 0x7f58a814a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.719+0000 7f58ad18d700 1 --2- 172.21.15.52:0/3722730500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58a814fd70 0x7f58a8148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.719+0000 7f58a7fff700 1 -- 172.21.15.52:0/3722730500 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58900052d0 msgr2=0x7f58a814a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.719+0000 7f58a7fff700 1 --2- 172.21.15.52:0/3722730500 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58900052d0 0x7f58a814a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.719+0000 7f58a7fff700 1 -- 172.21.15.52:0/3722730500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58a814fd70 msgr2=0x7f58a8148070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.719+0000 7f58a7fff700 1 --2- 172.21.15.52:0/3722730500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58a814fd70 0x7f58a8148070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.719+0000 7f58a7fff700 1 -- 172.21.15.52:0/3722730500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a8152440 con 0x7f58a814f900 2023-06-23T18:44:58.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.719+0000 7f58ad18d700 1 --2- 172.21.15.52:0/3722730500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58a814fd70 0x7f58a8148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:44:58.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.719+0000 7f854e7fc700 1 -- 172.21.15.52:0/1727806736 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855000cab0 con 0x7f8558071a80 2023-06-23T18:44:58.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.719+0000 7f854e7fc700 1 -- 172.21.15.52:0/1727806736 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855000cc10 con 0x7f8558071a80 2023-06-23T18:44:58.752 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.719+0000 7ff131d9b700 1 --2- 172.21.15.52:0/3059220544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff134071640 0x7ff134071aa0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff128009920 tx=0x7ff128009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e34e9140e91a089 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:58.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.719+0000 7f854e7fc700 1 -- 172.21.15.52:0/1727806736 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8550014440 con 0x7f8558071a80 2023-06-23T18:44:58.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.719+0000 7f58a7fff700 1 --2- 172.21.15.52:0/3722730500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58a814f900 0x7f58a8147b30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f58a000bde0 tx=0x7f58a0009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:58.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.721+0000 7f855fd8c700 1 -- 172.21.15.52:0/1727806736 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85580b4f70 con 0x7f8558071a80 2023-06-23T18:44:58.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.720+0000 7ff13159a700 1 -- 172.21.15.52:0/3059220544 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff128004230 con 0x7ff134071640 2023-06-23T18:44:58.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.720+0000 7ff13159a700 1 -- 172.21.15.52:0/3059220544 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff128004390 con 0x7ff134071640 2023-06-23T18:44:58.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.720+0000 7ff13159a700 1 -- 172.21.15.52:0/3059220544 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff128009e70 con 0x7ff134071640 2023-06-23T18:44:58.754 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.720+0000 7f1a3dc7f700 1 -- 172.21.15.52:0/2863023883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a380b7c60 msgr2=0x7f1a3806f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.720+0000 7f1a3dc7f700 1 --2- 172.21.15.52:0/2863023883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a380b7c60 0x7f1a3806f9a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1a380b70a0 tx=0x7f1a2800d330 comp rx=0 tx=0).stop 2023-06-23T18:44:58.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.721+0000 7f77ed27e700 1 Processor -- start 2023-06-23T18:44:58.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.720+0000 7f58a57fa700 1 -- 172.21.15.52:0/3722730500 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a000ccb0 con 0x7f58a814f900 2023-06-23T18:44:58.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.720+0000 7f58a57fa700 1 -- 172.21.15.52:0/3722730500 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a000ce10 con 0x7f58a814f900 2023-06-23T18:44:58.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.720+0000 7f58a57fa700 1 -- 172.21.15.52:0/3722730500 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a0014680 con 0x7f58a814f900 2023-06-23T18:44:58.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.721+0000 7fdbd6ffd700 1 -- 172.21.15.52:0/3433294539 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdbd80125b0 con 0x7fdbe0071640 2023-06-23T18:44:58.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.721+0000 7f58aebf0700 1 -- 172.21.15.52:0/3722730500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a80b2b80 con 0x7f58a814f900 2023-06-23T18:44:58.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.721+0000 7f58aebf0700 1 -- 172.21.15.52:0/3722730500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a8152690 con 0x7f58a814f900 2023-06-23T18:44:58.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.721+0000 7ff138aee700 1 -- 172.21.15.52:0/3059220544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff134071640 msgr2=0x7ff134071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.721+0000 7ff138aee700 1 --2- 172.21.15.52:0/3059220544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff134071640 0x7ff134071aa0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff128009920 tx=0x7ff128009c30 comp rx=0 tx=0).stop 2023-06-23T18:44:58.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.721+0000 7fdbd6ffd700 1 --2- 172.21.15.52:0/3433294539 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdbc406adb0 0x7fdbc406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.721+0000 7fdbd6ffd700 1 -- 172.21.15.52:0/3433294539 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdbd808b690 con 0x7fdbe0071640 2023-06-23T18:44:58.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.721+0000 7f77ed27e700 1 -- start start 2023-06-23T18:44:58.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.721+0000 7f855fd8c700 1 -- 172.21.15.52:0/1727806736 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8558149410 con 0x7f8558071a80 2023-06-23T18:44:58.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.722+0000 7f855fd8c700 1 -- 172.21.15.52:0/1727806736 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8558147c80 con 0x7f8558071a80 2023-06-23T18:44:58.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.722+0000 7f1a3dc7f700 1 -- 172.21.15.52:0/2863023883 shutdown_connections 2023-06-23T18:44:58.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.722+0000 7f1a3dc7f700 1 --2- 172.21.15.52:0/2863023883 >> v2:172.21.15.89:3300/0 conn(0x7f1a38157ce0 0x7f1a38070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.722+0000 7f1a3dc7f700 1 --2- 172.21.15.52:0/2863023883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a380b7c60 0x7f1a3806f9a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.722+0000 7f1a3dc7f700 1 -- 172.21.15.52:0/2863023883 >> 172.21.15.52:0/2863023883 conn(0x7f1a380bc170 msgr2=0x7f1a380bc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:58.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.722+0000 7f77ed27e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f77e8148820 0x7f77e8148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.722+0000 7f77ed27e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e80701d0 con 0x7f77e80b8ca0 2023-06-23T18:44:58.759 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.722+0000 7f77ed27e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e8071880 con 0x7f77e806b0e0 2023-06-23T18:44:58.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.722+0000 7f77ed27e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e8070420 con 0x7f77e8148820 2023-06-23T18:44:58.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.722+0000 7fdbe5a3e700 1 --2- 172.21.15.52:0/3433294539 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdbc406adb0 0x7fdbc406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.722+0000 7fb04e817700 1 Processor -- start 2023-06-23T18:44:58.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.722+0000 7fb04e817700 1 -- start start 2023-06-23T18:44:58.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.722+0000 7ff138aee700 1 -- 172.21.15.52:0/3059220544 shutdown_connections 2023-06-23T18:44:58.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.722+0000 7ff138aee700 1 --2- 172.21.15.52:0/3059220544 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff13414e7b0 0x7ff13414ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.722+0000 7ff138aee700 1 --2- 172.21.15.52:0/3059220544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff134071640 0x7ff134071aa0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.722+0000 7ff138aee700 1 -- 172.21.15.52:0/3059220544 >> 172.21.15.52:0/3059220544 conn(0x7ff1340bc170 msgr2=0x7ff1340bc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:58.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.722+0000 7f1a3dc7f700 1 -- 172.21.15.52:0/2863023883 shutdown_connections 2023-06-23T18:44:58.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.722+0000 7ff138aee700 1 -- 172.21.15.52:0/3059220544 shutdown_connections 2023-06-23T18:44:58.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.722+0000 7f77e77fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f77e8148820 0x7f77e8148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.722+0000 7f77e77fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f77e8148820 0x7f77e8148cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.52:59228/0 (socket says 172.21.15.52:59228) 2023-06-23T18:44:58.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.722+0000 7f77e77fe700 1 -- 172.21.15.52:0/3660984925 learned_addr learned my addr 172.21.15.52:0/3660984925 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:58.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.723+0000 7f77e77fe700 1 -- 172.21.15.52:0/3660984925 >> v1:172.21.15.89:6789/0 conn(0x7f77e806b0e0 legacy=0x7f77e814e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:58.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.723+0000 7f77e77fe700 1 -- 172.21.15.52:0/3660984925 >> v1:172.21.15.52:6789/0 conn(0x7f77e80b8ca0 legacy=0x7f77e8071f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:58.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.722+0000 7f58aebf0700 1 -- 172.21.15.52:0/3722730500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a80b35e0 con 0x7f58a814f900 2023-06-23T18:44:58.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.723+0000 7f77e77fe700 1 -- 172.21.15.52:0/3660984925 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e8070700 con 0x7f77e8148820 2023-06-23T18:44:58.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.723+0000 7fb04e817700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb0480b7c60 0x7fb048070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.723+0000 7fb04e817700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb048071b70 0x7fb048157190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.723+0000 7fb04e817700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0481580d0 con 0x7fb04806fd10 2023-06-23T18:44:58.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.723+0000 7fb04e817700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0480b8a80 con 0x7fb048071b70 2023-06-23T18:44:58.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.723+0000 7fb04e817700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb048089270 con 0x7fb0480b7c60 2023-06-23T18:44:58.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.723+0000 7fb047fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb0480b7c60 0x7fb048070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.724+0000 7fb047fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb0480b7c60 0x7fb048070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.52:59240/0 (socket says 172.21.15.52:59240) 2023-06-23T18:44:58.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.724+0000 7fb047fff700 1 -- 172.21.15.52:0/3496893536 learned_addr learned my addr 172.21.15.52:0/3496893536 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:58.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.724+0000 7fb0477fe700 1 --2- 172.21.15.52:0/3496893536 >> v2:172.21.15.52:3300/0 conn(0x7fb048071b70 0x7fb048157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.724+0000 7fb0477fe700 1 -- 172.21.15.52:0/3496893536 >> v2:172.21.15.89:3300/0 conn(0x7fb0480b7c60 msgr2=0x7fb048070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:58.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.724+0000 7fb0477fe700 1 --2- 172.21.15.52:0/3496893536 >> v2:172.21.15.89:3300/0 conn(0x7fb0480b7c60 0x7fb048070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.724+0000 7fb0477fe700 1 -- 172.21.15.52:0/3496893536 >> v1:172.21.15.52:6789/0 conn(0x7fb04806fd10 legacy=0x7fb04815a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.724+0000 7fb0477fe700 1 -- 172.21.15.52:0/3496893536 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0480b87a0 con 0x7fb048071b70 2023-06-23T18:44:58.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.724+0000 7fb0477fe700 1 --2- 172.21.15.52:0/3496893536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb048071b70 0x7fb048157190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb0480bcca0 tx=0x7fb03800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42f4d9aca664ad server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:58.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.723+0000 7ff138aee700 1 -- 172.21.15.52:0/3059220544 wait complete. 2023-06-23T18:44:58.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.724+0000 7f58a57fa700 1 -- 172.21.15.52:0/3722730500 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f58a001d3b0 con 0x7f58a814f900 2023-06-23T18:44:58.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.722+0000 7f1a3dc7f700 1 -- 172.21.15.52:0/2863023883 wait complete. 2023-06-23T18:44:58.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.724+0000 7f1a3dc7f700 1 Processor -- start 2023-06-23T18:44:58.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.725+0000 7ff138aee700 1 Processor -- start 2023-06-23T18:44:58.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.725+0000 7f77e77fe700 1 --2- 172.21.15.52:0/3660984925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77e8148820 0x7f77e8148cc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f77d80098f0 tx=0x7f77d8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fded8303f0b6c1c2 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:58.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.725+0000 7fdbe5a3e700 1 --2- 172.21.15.52:0/3433294539 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdbc406adb0 0x7fdbc406d260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdbe01483c0 tx=0x7fdbd0009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:58.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.725+0000 7f58a57fa700 1 --2- 172.21.15.52:0/3722730500 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f589406adb0 0x7f589406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.725+0000 7f58a57fa700 1 -- 172.21.15.52:0/3722730500 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f58a00896c0 con 0x7f58a814f900 2023-06-23T18:44:58.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.725+0000 7f58ac98c700 1 --2- 172.21.15.52:0/3722730500 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f589406adb0 0x7f589406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.725+0000 7ff138aee700 1 -- start start 2023-06-23T18:44:58.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.726+0000 7f58ac98c700 1 --2- 172.21.15.52:0/3722730500 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f589406adb0 0x7f589406d260 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f58a8069950 tx=0x7f589c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:58.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.725+0000 7f854e7fc700 1 -- 172.21.15.52:0/1727806736 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f85500145a0 con 0x7f8558071a80 2023-06-23T18:44:58.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.726+0000 7f854e7fc700 1 --2- 172.21.15.52:0/1727806736 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f853c06adb0 0x7f853c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.726+0000 7f854e7fc700 1 -- 172.21.15.52:0/1727806736 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8550089940 con 0x7f8558071a80 2023-06-23T18:44:58.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.726+0000 7f1a3dc7f700 1 -- start start 2023-06-23T18:44:58.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.726+0000 7ff138aee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff134071640 0x7ff1340b3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.726+0000 7ff138aee700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff134148b90 0x7ff13414b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.726+0000 7ff138aee700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff13414e7b0 0x7ff1341e64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.726+0000 7ff138aee700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1340b3dd0 con 0x7ff134148b90 2023-06-23T18:44:58.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.726+0000 7ff138aee700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff134152ca0 con 0x7ff13414e7b0 2023-06-23T18:44:58.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.726+0000 7ff138aee700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1340b4020 con 0x7ff134071640 2023-06-23T18:44:58.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.726+0000 7fdbd6ffd700 1 -- 172.21.15.52:0/3433294539 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdbd80568d0 con 0x7fdbe0071640 2023-06-23T18:44:58.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.726+0000 7f855d327700 1 --2- 172.21.15.52:0/1727806736 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f853c06adb0 0x7f853c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.727+0000 7f855d327700 1 --2- 172.21.15.52:0/1727806736 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f853c06adb0 0x7f853c06d260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f85580b77a0 tx=0x7f855400d000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:58.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.727+0000 7ff132d9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff13414e7b0 0x7ff1341e64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.727+0000 7ff132d9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff13414e7b0 0x7ff1341e64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.52:59242/0 (socket says 172.21.15.52:59242) 2023-06-23T18:44:58.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.727+0000 7ff132d9d700 1 -- 172.21.15.52:0/3276088457 learned_addr learned my addr 172.21.15.52:0/3276088457 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:58.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.727+0000 7ff13259c700 1 --2- 172.21.15.52:0/3276088457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff134071640 0x7ff1340b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.727+0000 7ff131d9b700 1 --2- 172.21.15.52:0/3276088457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff134148b90 0x7ff13414b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.727+0000 7ff13259c700 1 -- 172.21.15.52:0/3276088457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff13414e7b0 msgr2=0x7ff1341e64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.727+0000 7ff13259c700 1 --2- 172.21.15.52:0/3276088457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff13414e7b0 0x7ff1341e64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.727+0000 7ff13259c700 1 -- 172.21.15.52:0/3276088457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff134148b90 msgr2=0x7ff13414b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.727+0000 7ff13259c700 1 --2- 172.21.15.52:0/3276088457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff134148b90 0x7ff13414b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.727+0000 7ff13259c700 1 -- 172.21.15.52:0/3276088457 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff128009550 con 0x7ff134071640 2023-06-23T18:44:58.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.727+0000 7f1a3dc7f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1a38071620 0x7f1a38154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.727+0000 7f1a3dc7f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a380b7c60 0x7f1a38153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.727+0000 7f1a3dc7f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a38157ce0 0x7f1a38155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.727+0000 7f1a3dc7f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a38153ed0 con 0x7f1a380b7c60 2023-06-23T18:44:58.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.727+0000 7f1a3dc7f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a38152f10 con 0x7f1a38157ce0 2023-06-23T18:44:58.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.727+0000 7f1a3dc7f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a380afd10 con 0x7f1a38071620 2023-06-23T18:44:58.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.727+0000 7f1a37fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a38157ce0 0x7f1a38155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.727+0000 7f1a37fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a38157ce0 0x7f1a38155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.52:59246/0 (socket says 172.21.15.52:59246) 2023-06-23T18:44:58.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.727+0000 7f1a37fff700 1 -- 172.21.15.52:0/498667791 learned_addr learned my addr 172.21.15.52:0/498667791 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.727+0000 7f1a377fe700 1 --2- 172.21.15.52:0/498667791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1a38071620 0x7f1a38154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.727+0000 7f1a36ffd700 1 --2- 172.21.15.52:0/498667791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a380b7c60 0x7f1a38153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.727+0000 7ff13259c700 1 --2- 172.21.15.52:0/3276088457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff134071640 0x7ff1340b3890 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff12400c3e0 tx=0x7ff12400c6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:58.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.728+0000 7f1a377fe700 1 -- 172.21.15.52:0/498667791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a38157ce0 msgr2=0x7f1a38155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.728+0000 7f1a377fe700 1 --2- 172.21.15.52:0/498667791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a38157ce0 0x7f1a38155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.728+0000 7f1a377fe700 1 -- 172.21.15.52:0/498667791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a380b7c60 msgr2=0x7f1a38153990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.728+0000 7f1a377fe700 1 --2- 172.21.15.52:0/498667791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a380b7c60 0x7f1a38153990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.728+0000 7f1a377fe700 1 -- 172.21.15.52:0/498667791 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a28008610 con 0x7f1a38071620 2023-06-23T18:44:58.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.728+0000 7ff122ffd700 1 -- 172.21.15.52:0/3276088457 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12400cea0 con 0x7ff134071640 2023-06-23T18:44:58.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.728+0000 7ff122ffd700 1 -- 172.21.15.52:0/3276088457 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1240054e0 con 0x7ff134071640 2023-06-23T18:44:58.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.728+0000 7ff122ffd700 1 -- 172.21.15.52:0/3276088457 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1240038c0 con 0x7ff134071640 2023-06-23T18:44:58.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.728+0000 7ff138aee700 1 -- 172.21.15.52:0/3276088457 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff134152000 con 0x7ff134071640 2023-06-23T18:44:58.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.728+0000 7ff138aee700 1 -- 172.21.15.52:0/3276088457 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff134152930 con 0x7ff134071640 2023-06-23T18:44:58.779 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.728+0000 7f1a377fe700 1 --2- 172.21.15.52:0/498667791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1a38071620 0x7f1a38154940 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00e870 tx=0x7f1a2c00eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:58.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.728+0000 7f1a1ffff700 1 -- 172.21.15.52:0/498667791 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c013680 con 0x7f1a38071620 2023-06-23T18:44:58.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.728+0000 7f1a1ffff700 1 -- 172.21.15.52:0/498667791 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2c0137e0 con 0x7f1a38071620 2023-06-23T18:44:58.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.728+0000 7f1a1ffff700 1 -- 172.21.15.52:0/498667791 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c013b70 con 0x7f1a38071620 2023-06-23T18:44:58.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.728+0000 7f1a3dc7f700 1 -- 172.21.15.52:0/498667791 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a381531b0 con 0x7f1a38071620 2023-06-23T18:44:58.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.728+0000 7f1a3dc7f700 1 -- 172.21.15.52:0/498667791 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a380b43c0 con 0x7f1a38071620 2023-06-23T18:44:58.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.729+0000 7fb046ffd700 1 -- 172.21.15.52:0/3496893536 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03800e070 con 0x7fb048071b70 2023-06-23T18:44:58.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.729+0000 7f854e7fc700 1 -- 172.21.15.52:0/1727806736 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8550054b10 con 0x7f8558071a80 2023-06-23T18:44:58.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.729+0000 7fb046ffd700 1 -- 172.21.15.52:0/3496893536 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03800bb20 con 0x7fb048071b70 2023-06-23T18:44:58.781 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.729+0000 7fb046ffd700 1 -- 172.21.15.52:0/3496893536 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb038012430 con 0x7fb048071b70 2023-06-23T18:44:58.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.729+0000 7ff138aee700 1 -- 172.21.15.52:0/3276088457 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1180052e0 con 0x7ff134071640 2023-06-23T18:44:58.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.730+0000 7fb04e817700 1 -- 172.21.15.52:0/3496893536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb048071b70 msgr2=0x7fb048157190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.730+0000 7fb04e817700 1 --2- 172.21.15.52:0/3496893536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb048071b70 0x7fb048157190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb0480bcca0 tx=0x7fb03800b330 comp rx=0 tx=0).stop 2023-06-23T18:44:58.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.730+0000 7fb04e817700 1 -- 172.21.15.52:0/3496893536 shutdown_connections 2023-06-23T18:44:58.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.730+0000 7fb04e817700 1 --2- 172.21.15.52:0/3496893536 >> v2:172.21.15.89:3300/0 conn(0x7fb0480b7c60 0x7fb048070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.730+0000 7fb04e817700 1 --2- 172.21.15.52:0/3496893536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb048071b70 0x7fb048157190 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.730+0000 7fb04e817700 1 -- 172.21.15.52:0/3496893536 >> 172.21.15.52:0/3496893536 conn(0x7fb0480bc170 msgr2=0x7fb0480bc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:58.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.730+0000 7fb04e817700 1 -- 172.21.15.52:0/3496893536 shutdown_connections 2023-06-23T18:44:58.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.730+0000 7f77e5ffb700 1 -- 172.21.15.52:0/3660984925 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d8004230 con 0x7f77e8148820 2023-06-23T18:44:58.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.730+0000 7f77e5ffb700 1 -- 172.21.15.52:0/3660984925 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d8004390 con 0x7f77e8148820 2023-06-23T18:44:58.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.730+0000 7f77e5ffb700 1 -- 172.21.15.52:0/3660984925 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d80036a0 con 0x7f77e8148820 2023-06-23T18:44:58.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.730+0000 7f58a57fa700 1 -- 172.21.15.52:0/3722730500 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f58a00547e0 con 0x7f58a814f900 2023-06-23T18:44:58.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.730+0000 7fb04e817700 1 -- 172.21.15.52:0/3496893536 wait complete. 2023-06-23T18:44:58.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.731+0000 7f1a1ffff700 1 -- 172.21.15.52:0/498667791 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1a2c013cd0 con 0x7f1a38071620 2023-06-23T18:44:58.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.731+0000 7f1a1ffff700 1 --2- 172.21.15.52:0/498667791 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f1a2406ace0 0x7f1a2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.785 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.731+0000 7f1a1ffff700 1 -- 172.21.15.52:0/498667791 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1a2c089310 con 0x7f1a38071620 2023-06-23T18:44:58.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.731+0000 7fb04e817700 1 Processor -- start 2023-06-23T18:44:58.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.732+0000 7f77ed27e700 1 -- 172.21.15.52:0/3660984925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77e8148820 msgr2=0x7f77e8148cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.732+0000 7f77ed27e700 1 --2- 172.21.15.52:0/3660984925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77e8148820 0x7f77e8148cc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f77d80098f0 tx=0x7f77d8009c00 comp rx=0 tx=0).stop 2023-06-23T18:44:58.786 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.732+0000 7f1a36ffd700 1 --2- 172.21.15.52:0/498667791 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f1a2406ace0 0x7f1a2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.732+0000 7fb04e817700 1 -- start start 2023-06-23T18:44:58.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.732+0000 7fb04e817700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb04806fd10 0x7fb0480b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.732+0000 7fb04e817700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb048071b70 0x7fb0480a8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.787 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.732+0000 7fb04e817700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0480b7c60 0x7fb0480a9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.732+0000 7fb04e817700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0480b5750 con 0x7fb0480b7c60 2023-06-23T18:44:58.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.732+0000 7fb04e817700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0480aae40 con 0x7fb04806fd10 2023-06-23T18:44:58.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.732+0000 7fb04e817700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0480b5af0 con 0x7fb048071b70 2023-06-23T18:44:58.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.732+0000 7fb047fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb04806fd10 0x7fb0480b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.732+0000 7fb047fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb04806fd10 0x7fb0480b5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.52:59252/0 (socket says 172.21.15.52:59252) 2023-06-23T18:44:58.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.732+0000 7fb047fff700 1 -- 172.21.15.52:0/2082675284 learned_addr learned my addr 172.21.15.52:0/2082675284 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:58.788 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.733+0000 7fb04cdb4700 1 --2- 172.21.15.52:0/2082675284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0480b7c60 0x7fb0480a9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.733+0000 7f1a36ffd700 1 --2- 172.21.15.52:0/498667791 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f1a2406ace0 0x7f1a2406d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1a28000c00 tx=0x7f1a28012000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:58.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.733+0000 7f77ed27e700 1 -- 172.21.15.52:0/3660984925 shutdown_connections 2023-06-23T18:44:58.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.733+0000 7f77ed27e700 1 --2- 172.21.15.52:0/3660984925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77e8148820 0x7f77e8148cc0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.789 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.733+0000 7f77ed27e700 1 -- 172.21.15.52:0/3660984925 >> 172.21.15.52:0/3660984925 conn(0x7f77e80bd350 msgr2=0x7f77e80b9140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:58.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.733+0000 7fb047fff700 1 -- 172.21.15.52:0/2082675284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb048071b70 msgr2=0x7fb0480a8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.733+0000 7fb047fff700 1 --2- 172.21.15.52:0/2082675284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb048071b70 0x7fb0480a8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.733+0000 7fb047fff700 1 -- 172.21.15.52:0/2082675284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0480b7c60 msgr2=0x7fb0480a9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.733+0000 7fb047fff700 1 --2- 172.21.15.52:0/2082675284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0480b7c60 0x7fb0480a9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.733+0000 7fb047fff700 1 -- 172.21.15.52:0/2082675284 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb038009a70 con 0x7fb04806fd10 2023-06-23T18:44:58.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.733+0000 7f77ed27e700 1 -- 172.21.15.52:0/3660984925 shutdown_connections 2023-06-23T18:44:58.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.733+0000 7f77ed27e700 1 -- 172.21.15.52:0/3660984925 wait complete. 2023-06-23T18:44:58.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.733+0000 7fb047fff700 1 --2- 172.21.15.52:0/2082675284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb04806fd10 0x7fb0480b5210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb03000b6c0 tx=0x7fb03000b9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:58.792 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.735+0000 7f77ed27e700 1 Processor -- start 2023-06-23T18:44:58.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.735+0000 7f77ed27e700 1 -- start start 2023-06-23T18:44:58.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.736+0000 7f77ed27e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77e806b0e0 0x7f77e80b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.736+0000 7f77ed27e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77e80b8ca0 0x7f77e8141790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.736+0000 7f77ed27e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77e8148820 0x7f77e81e3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.736+0000 7f77ed27e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e81e3a40 con 0x7f77e80b8ca0 2023-06-23T18:44:58.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.736+0000 7f77ed27e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e80b5470 con 0x7f77e8148820 2023-06-23T18:44:58.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.736+0000 7f77ed27e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e80b3ea0 con 0x7f77e806b0e0 2023-06-23T18:44:58.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.736+0000 7f77e67fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77e80b8ca0 0x7f77e8141790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.736+0000 7f77e67fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77e80b8ca0 0x7f77e8141790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52232/0 (socket says 172.21.15.52:52232) 2023-06-23T18:44:58.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.736+0000 7f77e67fc700 1 -- 172.21.15.52:0/3256760532 learned_addr learned my addr 172.21.15.52:0/3256760532 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:58.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.736+0000 7f77e6ffd700 1 --2- 172.21.15.52:0/3256760532 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77e806b0e0 0x7f77e80b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.736+0000 7f77e77fe700 1 --2- 172.21.15.52:0/3256760532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77e8148820 0x7f77e81e3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.736+0000 7f77e67fc700 1 -- 172.21.15.52:0/3256760532 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77e806b0e0 msgr2=0x7f77e80b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.736+0000 7f77e67fc700 1 --2- 172.21.15.52:0/3256760532 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77e806b0e0 0x7f77e80b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.736+0000 7f77e67fc700 1 -- 172.21.15.52:0/3256760532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77e8148820 msgr2=0x7f77e81e3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:58.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.736+0000 7f77e67fc700 1 --2- 172.21.15.52:0/3256760532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77e8148820 0x7f77e81e3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:58.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.736+0000 7f77e67fc700 1 -- 172.21.15.52:0/3256760532 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d8009550 con 0x7f77e80b8ca0 2023-06-23T18:44:58.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.736+0000 7f77e77fe700 1 --2- 172.21.15.52:0/3256760532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77e8148820 0x7f77e81e3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:44:58.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.737+0000 7f77e67fc700 1 --2- 172.21.15.52:0/3256760532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77e80b8ca0 0x7f77e8141790 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00c4a0 tx=0x7f77dc00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:58.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.737+0000 7f77cf7fe700 1 -- 172.21.15.52:0/3256760532 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc0054e0 con 0x7f77e80b8ca0 2023-06-23T18:44:58.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.737+0000 7f77cf7fe700 1 -- 172.21.15.52:0/3256760532 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77dc003680 con 0x7f77e80b8ca0 2023-06-23T18:44:58.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.737+0000 7f77cf7fe700 1 -- 172.21.15.52:0/3256760532 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc003a10 con 0x7f77e80b8ca0 2023-06-23T18:44:58.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.737+0000 7f77ed27e700 1 -- 172.21.15.52:0/3256760532 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e80b4180 con 0x7f77e80b8ca0 2023-06-23T18:44:58.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.737+0000 7f77ed27e700 1 -- 172.21.15.52:0/3256760532 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e80b5670 con 0x7f77e80b8ca0 2023-06-23T18:44:58.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.738+0000 7f77cf7fe700 1 -- 172.21.15.52:0/3256760532 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f77dc003b70 con 0x7f77e80b8ca0 2023-06-23T18:44:58.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.739+0000 7f77ed27e700 1 -- 172.21.15.52:0/3256760532 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e81e3b80 con 0x7f77e80b8ca0 2023-06-23T18:44:58.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.739+0000 7f77cf7fe700 1 --2- 172.21.15.52:0/3256760532 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f77d406ace0 0x7f77d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.739+0000 7f77cf7fe700 1 -- 172.21.15.52:0/3256760532 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f77dc0885e0 con 0x7f77e80b8ca0 2023-06-23T18:44:58.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.739+0000 7f77e6ffd700 1 --2- 172.21.15.52:0/3256760532 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f77d406ace0 0x7f77d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.739+0000 7f77e6ffd700 1 --2- 172.21.15.52:0/3256760532 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f77d406ace0 0x7f77d406d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f77e000f300 tx=0x7f77e00042c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:58.797 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.730+0000 7ff122ffd700 1 -- 172.21.15.52:0/3276088457 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff124003a20 con 0x7ff134071640 2023-06-23T18:44:58.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.731+0000 7ff122ffd700 1 --2- 172.21.15.52:0/3276088457 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff11406ad10 0x7ff11406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.731+0000 7ff122ffd700 1 -- 172.21.15.52:0/3276088457 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff1240883e0 con 0x7ff134071640 2023-06-23T18:44:58.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.735+0000 7ff131d9b700 1 --2- 172.21.15.52:0/3276088457 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff11406ad10 0x7ff11406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.744+0000 7f77cf7fe700 1 -- 172.21.15.52:0/3256760532 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f77e81e3b80 con 0x7f77e80b8ca0 2023-06-23T18:44:58.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.743+0000 7ff122ffd700 1 -- 172.21.15.52:0/3276088457 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff1240533f0 con 0x7ff134071640 2023-06-23T18:44:58.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.746+0000 7f1a3dc7f700 1 -- 172.21.15.52:0/498667791 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a38153340 con 0x7f1a38071620 2023-06-23T18:44:58.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.746+0000 7fb044ff9700 1 -- 172.21.15.52:0/2082675284 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb030010040 con 0x7fb04806fd10 2023-06-23T18:44:58.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.746+0000 7fb044ff9700 1 -- 172.21.15.52:0/2082675284 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03000e5b0 con 0x7fb04806fd10 2023-06-23T18:44:58.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.746+0000 7fb044ff9700 1 -- 172.21.15.52:0/2082675284 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb030009460 con 0x7fb04806fd10 2023-06-23T18:44:58.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.747+0000 7fb04e817700 1 -- 172.21.15.52:0/2082675284 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0480aa7f0 con 0x7fb04806fd10 2023-06-23T18:44:58.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.747+0000 7fb04e817700 1 -- 172.21.15.52:0/2082675284 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0480bbc50 con 0x7fb04806fd10 2023-06-23T18:44:58.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.748+0000 7fb04e817700 1 -- 172.21.15.52:0/2082675284 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0480aa650 con 0x7fb04806fd10 2023-06-23T18:44:58.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.749+0000 7fb044ff9700 1 -- 172.21.15.52:0/2082675284 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb03000e940 con 0x7fb04806fd10 2023-06-23T18:44:58.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.749+0000 7fb044ff9700 1 --2- 172.21.15.52:0/2082675284 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fb02806adb0 0x7fb02806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:58.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.749+0000 7fb044ff9700 1 -- 172.21.15.52:0/2082675284 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb030089200 con 0x7fb04806fd10 2023-06-23T18:44:58.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.750+0000 7fb0477fe700 1 --2- 172.21.15.52:0/2082675284 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fb02806adb0 0x7fb02806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:58.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.750+0000 7ff131d9b700 1 --2- 172.21.15.52:0/3276088457 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff11406ad10 0x7ff11406d1c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff128009920 tx=0x7ff128008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:58.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.750+0000 7fb0477fe700 1 --2- 172.21.15.52:0/2082675284 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fb02806adb0 0x7fb02806d260 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb0480a8a40 tx=0x7fb038010000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:58.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.751+0000 7f1a1ffff700 1 -- 172.21.15.52:0/498667791 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1a2c0543b0 con 0x7f1a38071620 2023-06-23T18:44:58.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:58.754+0000 7fb044ff9700 1 -- 172.21.15.52:0/2082675284 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb0480aa650 con 0x7fb04806fd10 2023-06-23T18:44:59.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.097+0000 7fe109e1f700 1 -- 172.21.15.52:0/1302872821 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe0e4005860 con 0x7fe104157ce0 2023-06-23T18:44:59.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.101+0000 7fe0ebfff700 1 -- 172.21.15.52:0/1302872821 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe0f8058300 con 0x7fe104157ce0 2023-06-23T18:44:59.108 INFO:teuthology.orchestra.run.smithi052.stdout:55834574852 2023-06-23T18:44:59.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.110+0000 7fe109e1f700 1 -- 172.21.15.52:0/1302872821 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe0f006ad30 msgr2=0x7fe0f006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.110+0000 7fe109e1f700 1 --2- 172.21.15.52:0/1302872821 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe0f006ad30 0x7fe0f006d1e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc00c3f0 tx=0x7fe0fc00a000 comp rx=0 tx=0).stop 2023-06-23T18:44:59.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.110+0000 7fe109e1f700 1 -- 172.21.15.52:0/1302872821 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe104157ce0 msgr2=0x7fe1041ea2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.110+0000 7fe109e1f700 1 --2- 172.21.15.52:0/1302872821 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe104157ce0 0x7fe1041ea2a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe0f800ecc0 tx=0x7fe0f800d630 comp rx=0 tx=0).stop 2023-06-23T18:44:59.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.110+0000 7fe109e1f700 1 -- 172.21.15.52:0/1302872821 shutdown_connections 2023-06-23T18:44:59.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.110+0000 7fe109e1f700 1 --2- 172.21.15.52:0/1302872821 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe0f006ad30 0x7fe0f006d1e0 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc00c3f0 tx=0x7fe0fc00a000 comp rx=0 tx=0).stop 2023-06-23T18:44:59.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.110+0000 7fe109e1f700 1 --2- 172.21.15.52:0/1302872821 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe104157ce0 0x7fe1041ea2a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.110+0000 7fe109e1f700 1 --2- 172.21.15.52:0/1302872821 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe104071620 0x7fe1041f8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.110+0000 7fe109e1f700 1 --2- 172.21.15.52:0/1302872821 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1040b7c60 0x7fe1041f6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.110+0000 7fe109e1f700 1 -- 172.21.15.52:0/1302872821 >> 172.21.15.52:0/1302872821 conn(0x7fe1040bc170 msgr2=0x7fe1040ba070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:59.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.110+0000 7fe109e1f700 1 -- 172.21.15.52:0/1302872821 shutdown_connections 2023-06-23T18:44:59.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.111+0000 7fe109e1f700 1 -- 172.21.15.52:0/1302872821 wait complete. 2023-06-23T18:44:59.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.124+0000 7f58aebf0700 1 -- 172.21.15.52:0/3722730500 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f58a80b35e0 con 0x7f58a814f900 2023-06-23T18:44:59.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.124+0000 7f58a57fa700 1 -- 172.21.15.52:0/3722730500 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f58a80b35e0 con 0x7f58a814f900 2023-06-23T18:44:59.131 INFO:teuthology.orchestra.run.smithi052.stdout:55834574853 2023-06-23T18:44:59.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.128+0000 7f58aebf0700 1 -- 172.21.15.52:0/3722730500 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f589406adb0 msgr2=0x7f589406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.128+0000 7f58aebf0700 1 --2- 172.21.15.52:0/3722730500 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f589406adb0 0x7f589406d260 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f58a8069950 tx=0x7f589c009040 comp rx=0 tx=0).stop 2023-06-23T18:44:59.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.128+0000 7f58aebf0700 1 -- 172.21.15.52:0/3722730500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58a814f900 msgr2=0x7f58a8147b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.128+0000 7f58aebf0700 1 --2- 172.21.15.52:0/3722730500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58a814f900 0x7f58a8147b30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f58a000bde0 tx=0x7f58a0009f00 comp rx=0 tx=0).stop 2023-06-23T18:44:59.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.128+0000 7f58aebf0700 1 -- 172.21.15.52:0/3722730500 shutdown_connections 2023-06-23T18:44:59.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.128+0000 7f58aebf0700 1 --2- 172.21.15.52:0/3722730500 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f589406adb0 0x7f589406d260 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.128+0000 7f58aebf0700 1 --2- 172.21.15.52:0/3722730500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58a814fd70 0x7f58a8148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.134 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.128+0000 7f58aebf0700 1 --2- 172.21.15.52:0/3722730500 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58900052d0 0x7f58a814a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.128+0000 7f58aebf0700 1 --2- 172.21.15.52:0/3722730500 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f58a814f900 0x7f58a8147b30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.128+0000 7f58aebf0700 1 -- 172.21.15.52:0/3722730500 >> 172.21.15.52:0/3722730500 conn(0x7f58a80bc170 msgr2=0x7f58a80ba840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:59.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2023-06-23T18:44:59.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.129+0000 7f58aebf0700 1 -- 172.21.15.52:0/3722730500 shutdown_connections 2023-06-23T18:44:59.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.129+0000 7f58aebf0700 1 -- 172.21.15.52:0/3722730500 wait complete. 2023-06-23T18:44:59.136 DEBUG:teuthology.parallel:result is None 2023-06-23T18:44:59.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.136+0000 7fdbe84a3700 1 -- 172.21.15.52:0/3433294539 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fdbe00b5a30 con 0x7fdbe0071640 2023-06-23T18:44:59.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.139+0000 7fdbd6ffd700 1 -- 172.21.15.52:0/3433294539 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdbe00b5a30 con 0x7fdbe0071640 2023-06-23T18:44:59.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.139+0000 7f855fd8c700 1 -- 172.21.15.52:0/1727806736 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f855804e1d0 con 0x7f8558071a80 2023-06-23T18:44:59.144 INFO:teuthology.orchestra.run.smithi052.stdout:55834574853 2023-06-23T18:44:59.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.140+0000 7f854e7fc700 1 -- 172.21.15.52:0/1727806736 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8550019020 con 0x7f8558071a80 2023-06-23T18:44:59.145 INFO:teuthology.orchestra.run.smithi052.stdout:55834574855 2023-06-23T18:44:59.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.142+0000 7fdbe84a3700 1 -- 172.21.15.52:0/3433294539 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdbc406adb0 msgr2=0x7fdbc406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.142+0000 7fdbe84a3700 1 --2- 172.21.15.52:0/3433294539 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdbc406adb0 0x7fdbc406d260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdbe01483c0 tx=0x7fdbd0009210 comp rx=0 tx=0).stop 2023-06-23T18:44:59.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.142+0000 7fdbe84a3700 1 -- 172.21.15.52:0/3433294539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbe0071640 msgr2=0x7fdbe00b13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.142+0000 7fdbe84a3700 1 --2- 172.21.15.52:0/3433294539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbe0071640 0x7fdbe00b13a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8000f80 tx=0x7fdbd8004ad0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.142+0000 7fdbe84a3700 1 -- 172.21.15.52:0/3433294539 shutdown_connections 2023-06-23T18:44:59.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.142+0000 7fdbe84a3700 1 --2- 172.21.15.52:0/3433294539 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdbc406adb0 0x7fdbc406d260 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.142+0000 7fdbe84a3700 1 --2- 172.21.15.52:0/3433294539 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdbe014e7b0 0x7fdbe01e78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.142+0000 7fdbe84a3700 1 --2- 172.21.15.52:0/3433294539 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbe0071640 0x7fdbe00b13a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.142+0000 7fdbe84a3700 1 --2- 172.21.15.52:0/3433294539 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbe0148b90 0x7fdbe00b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.142+0000 7fdbe84a3700 1 -- 172.21.15.52:0/3433294539 >> 172.21.15.52:0/3433294539 conn(0x7fdbe00bc170 msgr2=0x7fdbe014d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:59.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2023-06-23T18:44:59.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.142+0000 7fdbe84a3700 1 -- 172.21.15.52:0/3433294539 shutdown_connections 2023-06-23T18:44:59.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.143+0000 7fdbe84a3700 1 -- 172.21.15.52:0/3433294539 wait complete. 2023-06-23T18:44:59.150 DEBUG:teuthology.parallel:result is None 2023-06-23T18:44:59.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.143+0000 7f855fd8c700 1 -- 172.21.15.52:0/1727806736 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f853c06adb0 msgr2=0x7f853c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.143+0000 7f855fd8c700 1 --2- 172.21.15.52:0/1727806736 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f853c06adb0 0x7f853c06d260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f85580b77a0 tx=0x7f855400d000 comp rx=0 tx=0).stop 2023-06-23T18:44:59.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.143+0000 7f855fd8c700 1 -- 172.21.15.52:0/1727806736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8558071a80 msgr2=0x7f85581e4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.143+0000 7f855fd8c700 1 --2- 172.21.15.52:0/1727806736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8558071a80 0x7f85581e4050 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f855000bb80 tx=0x7f855000be90 comp rx=0 tx=0).stop 2023-06-23T18:44:59.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.143+0000 7f855fd8c700 1 -- 172.21.15.52:0/1727806736 shutdown_connections 2023-06-23T18:44:59.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.143+0000 7f855fd8c700 1 --2- 172.21.15.52:0/1727806736 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f853c06adb0 0x7f853c06d260 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.143+0000 7f855fd8c700 1 --2- 172.21.15.52:0/1727806736 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8558146a00 0x7f85580bafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.143+0000 7f855fd8c700 1 --2- 172.21.15.52:0/1727806736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8558071a80 0x7f85581e4050 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.143+0000 7f855fd8c700 1 --2- 172.21.15.52:0/1727806736 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8558143b90 0x7f8558147f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.143+0000 7f855fd8c700 1 -- 172.21.15.52:0/1727806736 >> 172.21.15.52:0/1727806736 conn(0x7f85580bc170 msgr2=0x7f855813d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:59.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.143+0000 7f855fd8c700 1 -- 172.21.15.52:0/1727806736 shutdown_connections 2023-06-23T18:44:59.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.143+0000 7f855fd8c700 1 -- 172.21.15.52:0/1727806736 wait complete. 2023-06-23T18:44:59.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.159+0000 7ff138aee700 1 -- 172.21.15.52:0/3276088457 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff118005590 con 0x7ff134071640 2023-06-23T18:44:59.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.161+0000 7ff122ffd700 1 -- 172.21.15.52:0/3276088457 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff124056a10 con 0x7ff134071640 2023-06-23T18:44:59.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.160+0000 7f77ed27e700 1 -- 172.21.15.52:0/3256760532 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f77e81e3b80 con 0x7f77e80b8ca0 2023-06-23T18:44:59.167 INFO:teuthology.orchestra.run.smithi052.stdout:55834574853 2023-06-23T18:44:59.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.161+0000 7f77cf7fe700 1 -- 172.21.15.52:0/3256760532 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f77e81e3b80 con 0x7f77e80b8ca0 2023-06-23T18:44:59.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2023-06-23T18:44:59.169 INFO:teuthology.orchestra.run.smithi052.stdout:55834574853 2023-06-23T18:44:59.170 DEBUG:teuthology.parallel:result is None 2023-06-23T18:44:59.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2023-06-23T18:44:59.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.164+0000 7f77ed27e700 1 -- 172.21.15.52:0/3256760532 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f77d406ace0 msgr2=0x7f77d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.164+0000 7f77ed27e700 1 --2- 172.21.15.52:0/3256760532 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f77d406ace0 0x7f77d406d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f77e000f300 tx=0x7f77e00042c0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.164+0000 7f77ed27e700 1 -- 172.21.15.52:0/3256760532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77e80b8ca0 msgr2=0x7f77e8141790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.164+0000 7f77ed27e700 1 --2- 172.21.15.52:0/3256760532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77e80b8ca0 0x7f77e8141790 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00c4a0 tx=0x7f77dc00c7b0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.172 DEBUG:teuthology.parallel:result is None 2023-06-23T18:44:59.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.164+0000 7ff138aee700 1 -- 172.21.15.52:0/3276088457 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff11406ad10 msgr2=0x7ff11406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.164+0000 7ff138aee700 1 --2- 172.21.15.52:0/3276088457 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff11406ad10 0x7ff11406d1c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff128009920 tx=0x7ff128008030 comp rx=0 tx=0).stop 2023-06-23T18:44:59.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.164+0000 7ff138aee700 1 -- 172.21.15.52:0/3276088457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff134071640 msgr2=0x7ff1340b3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.164+0000 7ff138aee700 1 --2- 172.21.15.52:0/3276088457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff134071640 0x7ff1340b3890 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff12400c3e0 tx=0x7ff12400c6f0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.164+0000 7ff138aee700 1 -- 172.21.15.52:0/3276088457 shutdown_connections 2023-06-23T18:44:59.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.164+0000 7ff138aee700 1 --2- 172.21.15.52:0/3276088457 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff11406ad10 0x7ff11406d1c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.164+0000 7ff138aee700 1 --2- 172.21.15.52:0/3276088457 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff13414e7b0 0x7ff1341e64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.164+0000 7ff138aee700 1 --2- 172.21.15.52:0/3276088457 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff134071640 0x7ff1340b3890 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.164+0000 7ff138aee700 1 --2- 172.21.15.52:0/3276088457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff134148b90 0x7ff13414b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.164+0000 7ff138aee700 1 -- 172.21.15.52:0/3276088457 >> 172.21.15.52:0/3276088457 conn(0x7ff1340bc170 msgr2=0x7ff134069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:59.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.164+0000 7f77ed27e700 1 -- 172.21.15.52:0/3256760532 shutdown_connections 2023-06-23T18:44:59.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.164+0000 7f77ed27e700 1 --2- 172.21.15.52:0/3256760532 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f77d406ace0 0x7f77d406d190 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.164+0000 7f77ed27e700 1 --2- 172.21.15.52:0/3256760532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77e8148820 0x7f77e81e3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.164+0000 7f77ed27e700 1 --2- 172.21.15.52:0/3256760532 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77e806b0e0 0x7f77e80b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.164+0000 7f77ed27e700 1 --2- 172.21.15.52:0/3256760532 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f77e80b8ca0 0x7f77e8141790 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.164+0000 7f77ed27e700 1 -- 172.21.15.52:0/3256760532 >> 172.21.15.52:0/3256760532 conn(0x7f77e80bd350 msgr2=0x7f77e8146460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:59.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.164+0000 7ff138aee700 1 -- 172.21.15.52:0/3276088457 shutdown_connections 2023-06-23T18:44:59.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.164+0000 7ff138aee700 1 -- 172.21.15.52:0/3276088457 wait complete. 2023-06-23T18:44:59.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.165+0000 7f77ed27e700 1 -- 172.21.15.52:0/3256760532 shutdown_connections 2023-06-23T18:44:59.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.165+0000 7f77ed27e700 1 -- 172.21.15.52:0/3256760532 wait complete. 2023-06-23T18:44:59.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.168+0000 7f1a3dc7f700 1 -- 172.21.15.52:0/498667791 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1a3804e1d0 con 0x7f1a38071620 2023-06-23T18:44:59.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.168+0000 7fb04e817700 1 -- 172.21.15.52:0/2082675284 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb0480aa650 con 0x7fb04806fd10 2023-06-23T18:44:59.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.169+0000 7f1a1ffff700 1 -- 172.21.15.52:0/498667791 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a2c021070 con 0x7f1a38071620 2023-06-23T18:44:59.178 INFO:teuthology.orchestra.run.smithi052.stdout:55834574853 2023-06-23T18:44:59.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.169+0000 7fb044ff9700 1 -- 172.21.15.52:0/2082675284 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb0480aa650 con 0x7fb04806fd10 2023-06-23T18:44:59.179 INFO:teuthology.orchestra.run.smithi052.stdout:55834574852 2023-06-23T18:44:59.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.171+0000 7f1a3dc7f700 1 -- 172.21.15.52:0/498667791 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f1a2406ace0 msgr2=0x7f1a2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.171+0000 7f1a3dc7f700 1 --2- 172.21.15.52:0/498667791 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f1a2406ace0 0x7f1a2406d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1a28000c00 tx=0x7f1a28012000 comp rx=0 tx=0).stop 2023-06-23T18:44:59.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.171+0000 7f1a3dc7f700 1 -- 172.21.15.52:0/498667791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1a38071620 msgr2=0x7f1a38154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.171+0000 7f1a3dc7f700 1 --2- 172.21.15.52:0/498667791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1a38071620 0x7f1a38154940 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00e870 tx=0x7f1a2c00eb80 comp rx=0 tx=0).stop 2023-06-23T18:44:59.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.171+0000 7f1a3dc7f700 1 -- 172.21.15.52:0/498667791 shutdown_connections 2023-06-23T18:44:59.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.171+0000 7f1a3dc7f700 1 --2- 172.21.15.52:0/498667791 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f1a2406ace0 0x7f1a2406d190 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.171+0000 7f1a3dc7f700 1 --2- 172.21.15.52:0/498667791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a38157ce0 0x7f1a38155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.180 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.171+0000 7f1a3dc7f700 1 --2- 172.21.15.52:0/498667791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1a38071620 0x7f1a38154940 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.171+0000 7f1a3dc7f700 1 --2- 172.21.15.52:0/498667791 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1a380b7c60 0x7f1a38153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.171+0000 7f1a3dc7f700 1 -- 172.21.15.52:0/498667791 >> 172.21.15.52:0/498667791 conn(0x7f1a380bc170 msgr2=0x7f1a380ba4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:59.181 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.171+0000 7fb04e817700 1 -- 172.21.15.52:0/2082675284 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fb02806adb0 msgr2=0x7fb02806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.171+0000 7fb04e817700 1 --2- 172.21.15.52:0/2082675284 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fb02806adb0 0x7fb02806d260 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb0480a8a40 tx=0x7fb038010000 comp rx=0 tx=0).stop 2023-06-23T18:44:59.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.171+0000 7fb04e817700 1 -- 172.21.15.52:0/2082675284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb04806fd10 msgr2=0x7fb0480b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.171+0000 7fb04e817700 1 --2- 172.21.15.52:0/2082675284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb04806fd10 0x7fb0480b5210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb03000b6c0 tx=0x7fb03000b9d0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.171+0000 7fb04e817700 1 -- 172.21.15.52:0/2082675284 shutdown_connections 2023-06-23T18:44:59.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.171+0000 7fb04e817700 1 --2- 172.21.15.52:0/2082675284 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fb02806adb0 0x7fb02806d260 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.171+0000 7fb04e817700 1 --2- 172.21.15.52:0/2082675284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0480b7c60 0x7fb0480a9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.182 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.171+0000 7fb04e817700 1 --2- 172.21.15.52:0/2082675284 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb04806fd10 0x7fb0480b5210 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb03000b6c0 tx=0x7fb03000b9d0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.171+0000 7fb04e817700 1 --2- 172.21.15.52:0/2082675284 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb048071b70 0x7fb0480a8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.171+0000 7fb04e817700 1 -- 172.21.15.52:0/2082675284 >> 172.21.15.52:0/2082675284 conn(0x7fb0480bc170 msgr2=0x7fb0480b8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:59.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.171+0000 7fb04e817700 1 -- 172.21.15.52:0/2082675284 shutdown_connections 2023-06-23T18:44:59.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.171+0000 7f1a3dc7f700 1 -- 172.21.15.52:0/498667791 shutdown_connections 2023-06-23T18:44:59.183 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.171+0000 7f1a3dc7f700 1 -- 172.21.15.52:0/498667791 wait complete. 2023-06-23T18:44:59.184 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.171+0000 7fb04e817700 1 -- 172.21.15.52:0/2082675284 wait complete. 2023-06-23T18:44:59.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2023-06-23T18:44:59.192 DEBUG:teuthology.parallel:result is None 2023-06-23T18:44:59.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.4 2023-06-23T18:44:59.193 DEBUG:teuthology.parallel:result is None 2023-06-23T18:44:59.194 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2023-06-23T18:44:59.194 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2023-06-23T18:44:59.195 DEBUG:teuthology.parallel:result is None 2023-06-23T18:44:59.195 DEBUG:teuthology.parallel:result is None 2023-06-23T18:44:59.195 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-06-23T18:44:59.195 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T18:44:59.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.353+0000 7f15c81e0700 1 Processor -- start 2023-06-23T18:44:59.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.353+0000 7f15c81e0700 1 -- start start 2023-06-23T18:44:59.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.354+0000 7f15c81e0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f15c014da40 0x7f15c00b8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:59.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.354+0000 7f15c81e0700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c00b98a0 con 0x7f15c006c1f0 2023-06-23T18:44:59.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.354+0000 7f15c81e0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c014a6a0 con 0x7f15c00b9310 2023-06-23T18:44:59.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.354+0000 7f15c81e0700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c014a980 con 0x7f15c014da40 2023-06-23T18:44:59.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.354+0000 7f15c577b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f15c014da40 0x7f15c00b8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:59.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.354+0000 7f15c5f7c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f15c006c1f0 0x7f15c014aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44872/0 (socket says 172.21.15.52:44872) 2023-06-23T18:44:59.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.354+0000 7f15c5f7c700 1 -- 172.21.15.52:0/2696410531 learned_addr learned my addr 172.21.15.52:0/2696410531 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:44:59.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.354+0000 7f15c577b700 1 -- 172.21.15.52:0/2696410531 >> v1:172.21.15.89:6789/0 conn(0x7f15c00b9310 legacy=0x7f15c01443e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.354+0000 7f15c577b700 1 -- 172.21.15.52:0/2696410531 >> v1:172.21.15.52:6789/0 conn(0x7f15c006c1f0 legacy=0x7f15c014aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.354+0000 7f15c577b700 1 -- 172.21.15.52:0/2696410531 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c0144af0 con 0x7f15c014da40 2023-06-23T18:44:59.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.354+0000 7f15c4f7a700 1 -- 172.21.15.52:0/2696410531 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2152744898 0 0) 0x7f15c00b98a0 con 0x7f15c006c1f0 2023-06-23T18:44:59.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.355+0000 7f15c577b700 1 --2- 172.21.15.52:0/2696410531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15c014da40 0x7f15c00b8870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f15bc009840 tx=0x7f15bc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f525c9ad3323e240 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:59.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.355+0000 7f15c4f7a700 1 -- 172.21.15.52:0/2696410531 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc011830 con 0x7f15c014da40 2023-06-23T18:44:59.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.355+0000 7f15c4f7a700 1 -- 172.21.15.52:0/2696410531 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15bc011990 con 0x7f15c014da40 2023-06-23T18:44:59.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.355+0000 7f15c4f7a700 1 -- 172.21.15.52:0/2696410531 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc011d20 con 0x7f15c014da40 2023-06-23T18:44:59.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.355+0000 7f15c81e0700 1 -- 172.21.15.52:0/2696410531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15c014da40 msgr2=0x7f15c00b8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.355+0000 7f15c81e0700 1 --2- 172.21.15.52:0/2696410531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15c014da40 0x7f15c00b8870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f15bc009840 tx=0x7f15bc009b50 comp rx=0 tx=0).stop 2023-06-23T18:44:59.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.355+0000 7f15c81e0700 1 -- 172.21.15.52:0/2696410531 shutdown_connections 2023-06-23T18:44:59.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.355+0000 7f15c81e0700 1 --2- 172.21.15.52:0/2696410531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15c014da40 0x7f15c00b8870 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.355+0000 7f15c81e0700 1 -- 172.21.15.52:0/2696410531 >> 172.21.15.52:0/2696410531 conn(0x7f15c00bdf30 msgr2=0x7f15c00b9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:59.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.355+0000 7f15c81e0700 1 -- 172.21.15.52:0/2696410531 shutdown_connections 2023-06-23T18:44:59.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.355+0000 7f15c81e0700 1 -- 172.21.15.52:0/2696410531 wait complete. 2023-06-23T18:44:59.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.356+0000 7f15c81e0700 1 Processor -- start 2023-06-23T18:44:59.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.357+0000 7f15c81e0700 1 -- start start 2023-06-23T18:44:59.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.357+0000 7f15c81e0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15c006c1f0 0x7f15c014c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:59.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.357+0000 7f15c81e0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15c00b9310 0x7f15c01d5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:59.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.357+0000 7f15c81e0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f15c014da40 0x7f15c00b2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:59.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.357+0000 7f15c81e0700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c014ca80 con 0x7f15c00b9310 2023-06-23T18:44:59.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.357+0000 7f15c81e0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c01d6e30 con 0x7f15c006c1f0 2023-06-23T18:44:59.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.357+0000 7f15c81e0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c00b21c0 con 0x7f15c014da40 2023-06-23T18:44:59.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.357+0000 7f15c577b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15c00b9310 0x7f15c01d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:59.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.357+0000 7f15c577b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15c00b9310 0x7f15c01d5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52250/0 (socket says 172.21.15.52:52250) 2023-06-23T18:44:59.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.357+0000 7f15c577b700 1 -- 172.21.15.52:0/1529557686 learned_addr learned my addr 172.21.15.52:0/1529557686 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:59.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.357+0000 7f15c677d700 1 --2- 172.21.15.52:0/1529557686 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f15c014da40 0x7f15c00b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:59.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.357+0000 7f15c5f7c700 1 --2- 172.21.15.52:0/1529557686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15c006c1f0 0x7f15c014c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:59.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.357+0000 7f15c577b700 1 -- 172.21.15.52:0/1529557686 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f15c014da40 msgr2=0x7f15c00b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.357+0000 7f15c577b700 1 --2- 172.21.15.52:0/1529557686 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f15c014da40 0x7f15c00b2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.357+0000 7f15c577b700 1 -- 172.21.15.52:0/1529557686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15c006c1f0 msgr2=0x7f15c014c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.358+0000 7f15c577b700 1 --2- 172.21.15.52:0/1529557686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15c006c1f0 0x7f15c014c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.358+0000 7f15c577b700 1 -- 172.21.15.52:0/1529557686 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15bc0094a0 con 0x7f15c00b9310 2023-06-23T18:44:59.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.358+0000 7f15c577b700 1 --2- 172.21.15.52:0/1529557686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15c00b9310 0x7f15c01d5c50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f15bc0090b0 tx=0x7f15bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:59.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.358+0000 7f15b67fc700 1 -- 172.21.15.52:0/1529557686 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc01a8c0 con 0x7f15c00b9310 2023-06-23T18:44:59.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.358+0000 7f15b67fc700 1 -- 172.21.15.52:0/1529557686 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15bc01aa20 con 0x7f15c00b9310 2023-06-23T18:44:59.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.358+0000 7f15b67fc700 1 -- 172.21.15.52:0/1529557686 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc01ad90 con 0x7f15c00b9310 2023-06-23T18:44:59.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.358+0000 7f15c81e0700 1 -- 172.21.15.52:0/1529557686 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c01d6190 con 0x7f15c00b9310 2023-06-23T18:44:59.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.358+0000 7f15c81e0700 1 -- 172.21.15.52:0/1529557686 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c01d7310 con 0x7f15c00b9310 2023-06-23T18:44:59.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.359+0000 7f15c81e0700 1 -- 172.21.15.52:0/1529557686 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c004e1d0 con 0x7f15c00b9310 2023-06-23T18:44:59.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.359+0000 7f15b67fc700 1 -- 172.21.15.52:0/1529557686 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f15bc022070 con 0x7f15c00b9310 2023-06-23T18:44:59.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.360+0000 7f15b67fc700 1 --2- 172.21.15.52:0/1529557686 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f15a406ace0 0x7f15a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:59.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.360+0000 7f15b67fc700 1 -- 172.21.15.52:0/1529557686 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15bc08a690 con 0x7f15c00b9310 2023-06-23T18:44:59.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.360+0000 7f15c5f7c700 1 --2- 172.21.15.52:0/1529557686 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f15a406ace0 0x7f15a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:59.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.360+0000 7f15c5f7c700 1 --2- 172.21.15.52:0/1529557686 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f15a406ace0 0x7f15a406d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f15b0000f60 tx=0x7f15b0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:59.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.364+0000 7f15b67fc700 1 -- 172.21.15.52:0/1529557686 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f15bc055900 con 0x7f15c00b9310 2023-06-23T18:44:59.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.558+0000 7f15c81e0700 1 -- 172.21.15.52:0/1529557686 --> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f15c00b7c70 con 0x7f15a406ace0 2023-06-23T18:44:59.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.566+0000 7f15b67fc700 1 -- 172.21.15.52:0/1529557686 <== mgr.4106 v2:172.21.15.89:6832/397406548 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286864 (secure 0 0 0) 0x7f15b00070d0 con 0x7f15a406ace0 2023-06-23T18:44:59.574 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:44:59.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.569+0000 7f15c81e0700 1 -- 172.21.15.52:0/1529557686 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f15a406ace0 msgr2=0x7f15a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.569+0000 7f15c81e0700 1 --2- 172.21.15.52:0/1529557686 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f15a406ace0 0x7f15a406d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f15b0000f60 tx=0x7f15b0009040 comp rx=0 tx=0).stop 2023-06-23T18:44:59.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.569+0000 7f15c81e0700 1 -- 172.21.15.52:0/1529557686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15c00b9310 msgr2=0x7f15c01d5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.569+0000 7f15c81e0700 1 --2- 172.21.15.52:0/1529557686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15c00b9310 0x7f15c01d5c50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f15bc0090b0 tx=0x7f15bc004750 comp rx=0 tx=0).stop 2023-06-23T18:44:59.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.569+0000 7f15c81e0700 1 -- 172.21.15.52:0/1529557686 shutdown_connections 2023-06-23T18:44:59.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.569+0000 7f15c81e0700 1 --2- 172.21.15.52:0/1529557686 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f15a406ace0 0x7f15a406d190 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.569+0000 7f15c81e0700 1 --2- 172.21.15.52:0/1529557686 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f15c014da40 0x7f15c00b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.569+0000 7f15c81e0700 1 --2- 172.21.15.52:0/1529557686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15c006c1f0 0x7f15c014c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.569+0000 7f15c81e0700 1 --2- 172.21.15.52:0/1529557686 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15c00b9310 0x7f15c01d5c50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.569+0000 7f15c81e0700 1 -- 172.21.15.52:0/1529557686 >> 172.21.15.52:0/1529557686 conn(0x7f15c00bdf30 msgr2=0x7f15c00bcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:59.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.569+0000 7f15c81e0700 1 -- 172.21.15.52:0/1529557686 shutdown_connections 2023-06-23T18:44:59.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.569+0000 7f15c81e0700 1 -- 172.21.15.52:0/1529557686 wait complete. 2023-06-23T18:44:59.578 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-06-23T18:44:59.586 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-06-23T18:44:57.777487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218532,"kb_used_data":2916,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756188,"statfs":{"total":773094113280,"available":772870336512,"internally_reserved":0,"allocated":2985984,"data_stored":1817291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.549603"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083789+0000","last_change":"2023-06-23T18:44:50.669535+0000","last_active":"2023-06-23T18:44:53.083789+0000","last_peered":"2023-06-23T18:44:53.083789+0000","last_clean":"2023-06-23T18:44:53.083789+0000","last_became_active":"2023-06-23T18:44:50.669314+0000","last_became_peered":"2023-06-23T18:44:50.669314+0000","last_unstale":"2023-06-23T18:44:53.083789+0000","last_undegraded":"2023-06-23T18:44:53.083789+0000","last_fullsized":"2023-06-23T18:44:53.083789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:50:32.317342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083758+0000","last_change":"2023-06-23T18:44:50.655548+0000","last_active":"2023-06-23T18:44:53.083758+0000","last_peered":"2023-06-23T18:44:53.083758+0000","last_clean":"2023-06-23T18:44:53.083758+0000","last_became_active":"2023-06-23T18:44:50.655143+0000","last_became_peered":"2023-06-23T18:44:50.655143+0000","last_unstale":"2023-06-23T18:44:53.083758+0000","last_undegraded":"2023-06-23T18:44:53.083758+0000","last_fullsized":"2023-06-23T18:44:53.083758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:23:07.364903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498122+0000","last_change":"2023-06-23T18:44:50.667478+0000","last_active":"2023-06-23T18:44:52.498122+0000","last_peered":"2023-06-23T18:44:52.498122+0000","last_clean":"2023-06-23T18:44:52.498122+0000","last_became_active":"2023-06-23T18:44:50.667142+0000","last_became_peered":"2023-06-23T18:44:50.667142+0000","last_unstale":"2023-06-23T18:44:52.498122+0000","last_undegraded":"2023-06-23T18:44:52.498122+0000","last_fullsized":"2023-06-23T18:44:52.498122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:48:26.644150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655406+0000","last_change":"2023-06-23T18:44:50.663624+0000","last_active":"2023-06-23T18:44:51.655406+0000","last_peered":"2023-06-23T18:44:51.655406+0000","last_clean":"2023-06-23T18:44:51.655406+0000","last_became_active":"2023-06-23T18:44:50.663376+0000","last_became_peered":"2023-06-23T18:44:50.663376+0000","last_unstale":"2023-06-23T18:44:51.655406+0000","last_undegraded":"2023-06-23T18:44:51.655406+0000","last_fullsized":"2023-06-23T18:44:51.655406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:17:28.994298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404393+0000","last_change":"2023-06-23T18:44:50.671557+0000","last_active":"2023-06-23T18:44:52.404393+0000","last_peered":"2023-06-23T18:44:52.404393+0000","last_clean":"2023-06-23T18:44:52.404393+0000","last_became_active":"2023-06-23T18:44:50.671298+0000","last_became_peered":"2023-06-23T18:44:50.671298+0000","last_unstale":"2023-06-23T18:44:52.404393+0000","last_undegraded":"2023-06-23T18:44:52.404393+0000","last_fullsized":"2023-06-23T18:44:52.404393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:06:39.243693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498058+0000","last_change":"2023-06-23T18:44:50.664406+0000","last_active":"2023-06-23T18:44:52.498058+0000","last_peered":"2023-06-23T18:44:52.498058+0000","last_clean":"2023-06-23T18:44:52.498058+0000","last_became_active":"2023-06-23T18:44:50.664144+0000","last_became_peered":"2023-06-23T18:44:50.664144+0000","last_unstale":"2023-06-23T18:44:52.498058+0000","last_undegraded":"2023-06-23T18:44:52.498058+0000","last_fullsized":"2023-06-23T18:44:52.498058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:43:05.880234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006057+0000","last_change":"2023-06-23T18:44:50.669048+0000","last_active":"2023-06-23T18:44:52.006057+0000","last_peered":"2023-06-23T18:44:52.006057+0000","last_clean":"2023-06-23T18:44:52.006057+0000","last_became_active":"2023-06-23T18:44:50.668771+0000","last_became_peered":"2023-06-23T18:44:50.668771+0000","last_unstale":"2023-06-23T18:44:52.006057+0000","last_undegraded":"2023-06-23T18:44:52.006057+0000","last_fullsized":"2023-06-23T18:44:52.006057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:43:05.880234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083512+0000","last_change":"2023-06-23T18:44:50.667476+0000","last_active":"2023-06-23T18:44:53.083512+0000","last_peered":"2023-06-23T18:44:53.083512+0000","last_clean":"2023-06-23T18:44:53.083512+0000","last_became_active":"2023-06-23T18:44:50.667193+0000","last_became_peered":"2023-06-23T18:44:50.667193+0000","last_unstale":"2023-06-23T18:44:53.083512+0000","last_undegraded":"2023-06-23T18:44:53.083512+0000","last_fullsized":"2023-06-23T18:44:53.083512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:57:46.437032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404434+0000","last_change":"2023-06-23T18:44:50.659873+0000","last_active":"2023-06-23T18:44:52.404434+0000","last_peered":"2023-06-23T18:44:52.404434+0000","last_clean":"2023-06-23T18:44:52.404434+0000","last_became_active":"2023-06-23T18:44:50.659596+0000","last_became_peered":"2023-06-23T18:44:50.659596+0000","last_unstale":"2023-06-23T18:44:52.404434+0000","last_undegraded":"2023-06-23T18:44:52.404434+0000","last_fullsized":"2023-06-23T18:44:52.404434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:11:35.546421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083943+0000","last_change":"2023-06-23T18:44:50.662516+0000","last_active":"2023-06-23T18:44:53.083943+0000","last_peered":"2023-06-23T18:44:53.083943+0000","last_clean":"2023-06-23T18:44:53.083943+0000","last_became_active":"2023-06-23T18:44:50.662228+0000","last_became_peered":"2023-06-23T18:44:50.662228+0000","last_unstale":"2023-06-23T18:44:53.083943+0000","last_undegraded":"2023-06-23T18:44:53.083943+0000","last_fullsized":"2023-06-23T18:44:53.083943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:27:54.238055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498265+0000","last_change":"2023-06-23T18:44:50.669567+0000","last_active":"2023-06-23T18:44:52.498265+0000","last_peered":"2023-06-23T18:44:52.498265+0000","last_clean":"2023-06-23T18:44:52.498265+0000","last_became_active":"2023-06-23T18:44:50.667154+0000","last_became_peered":"2023-06-23T18:44:50.667154+0000","last_unstale":"2023-06-23T18:44:52.498265+0000","last_undegraded":"2023-06-23T18:44:52.498265+0000","last_fullsized":"2023-06-23T18:44:52.498265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:34:35.075905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083158+0000","last_change":"2023-06-23T18:44:50.667100+0000","last_active":"2023-06-23T18:44:53.083158+0000","last_peered":"2023-06-23T18:44:53.083158+0000","last_clean":"2023-06-23T18:44:53.083158+0000","last_became_active":"2023-06-23T18:44:50.666768+0000","last_became_peered":"2023-06-23T18:44:50.666768+0000","last_unstale":"2023-06-23T18:44:53.083158+0000","last_undegraded":"2023-06-23T18:44:53.083158+0000","last_fullsized":"2023-06-23T18:44:53.083158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:41:16.719001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083296+0000","last_change":"2023-06-23T18:44:50.670413+0000","last_active":"2023-06-23T18:44:53.083296+0000","last_peered":"2023-06-23T18:44:53.083296+0000","last_clean":"2023-06-23T18:44:53.083296+0000","last_became_active":"2023-06-23T18:44:50.670105+0000","last_became_peered":"2023-06-23T18:44:50.670105+0000","last_unstale":"2023-06-23T18:44:53.083296+0000","last_undegraded":"2023-06-23T18:44:53.083296+0000","last_fullsized":"2023-06-23T18:44:53.083296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:51:27.271916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083805+0000","last_change":"2023-06-23T18:44:50.655737+0000","last_active":"2023-06-23T18:44:53.083805+0000","last_peered":"2023-06-23T18:44:53.083805+0000","last_clean":"2023-06-23T18:44:53.083805+0000","last_became_active":"2023-06-23T18:44:50.655253+0000","last_became_peered":"2023-06-23T18:44:50.655253+0000","last_unstale":"2023-06-23T18:44:53.083805+0000","last_undegraded":"2023-06-23T18:44:53.083805+0000","last_fullsized":"2023-06-23T18:44:53.083805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:53:28.521694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006225+0000","last_change":"2023-06-23T18:44:50.669573+0000","last_active":"2023-06-23T18:44:52.006225+0000","last_peered":"2023-06-23T18:44:52.006225+0000","last_clean":"2023-06-23T18:44:52.006225+0000","last_became_active":"2023-06-23T18:44:50.668886+0000","last_became_peered":"2023-06-23T18:44:50.668886+0000","last_unstale":"2023-06-23T18:44:52.006225+0000","last_undegraded":"2023-06-23T18:44:52.006225+0000","last_fullsized":"2023-06-23T18:44:52.006225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:00:29.622659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.497857+0000","last_change":"2023-06-23T18:44:50.664890+0000","last_active":"2023-06-23T18:44:52.497857+0000","last_peered":"2023-06-23T18:44:52.497857+0000","last_clean":"2023-06-23T18:44:52.497857+0000","last_became_active":"2023-06-23T18:44:50.664571+0000","last_became_peered":"2023-06-23T18:44:50.664571+0000","last_unstale":"2023-06-23T18:44:52.497857+0000","last_undegraded":"2023-06-23T18:44:52.497857+0000","last_fullsized":"2023-06-23T18:44:52.497857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:24:20.739761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404406+0000","last_change":"2023-06-23T18:44:50.672231+0000","last_active":"2023-06-23T18:44:52.404406+0000","last_peered":"2023-06-23T18:44:52.404406+0000","last_clean":"2023-06-23T18:44:52.404406+0000","last_became_active":"2023-06-23T18:44:50.671979+0000","last_became_peered":"2023-06-23T18:44:50.671979+0000","last_unstale":"2023-06-23T18:44:52.404406+0000","last_undegraded":"2023-06-23T18:44:52.404406+0000","last_fullsized":"2023-06-23T18:44:52.404406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:53:28.521694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498218+0000","last_change":"2023-06-23T18:44:50.667846+0000","last_active":"2023-06-23T18:44:52.498218+0000","last_peered":"2023-06-23T18:44:52.498218+0000","last_clean":"2023-06-23T18:44:52.498218+0000","last_became_active":"2023-06-23T18:44:50.667545+0000","last_became_peered":"2023-06-23T18:44:50.667545+0000","last_unstale":"2023-06-23T18:44:52.498218+0000","last_undegraded":"2023-06-23T18:44:52.498218+0000","last_fullsized":"2023-06-23T18:44:52.498218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:59:07.537499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083734+0000","last_change":"2023-06-23T18:44:50.662459+0000","last_active":"2023-06-23T18:44:53.083734+0000","last_peered":"2023-06-23T18:44:53.083734+0000","last_clean":"2023-06-23T18:44:53.083734+0000","last_became_active":"2023-06-23T18:44:50.662128+0000","last_became_peered":"2023-06-23T18:44:50.662128+0000","last_unstale":"2023-06-23T18:44:53.083734+0000","last_undegraded":"2023-06-23T18:44:53.083734+0000","last_fullsized":"2023-06-23T18:44:53.083734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:20:59.100212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498229+0000","last_change":"2023-06-23T18:44:50.670686+0000","last_active":"2023-06-23T18:44:52.498229+0000","last_peered":"2023-06-23T18:44:52.498229+0000","last_clean":"2023-06-23T18:44:52.498229+0000","last_became_active":"2023-06-23T18:44:50.670397+0000","last_became_peered":"2023-06-23T18:44:50.670397+0000","last_unstale":"2023-06-23T18:44:52.498229+0000","last_undegraded":"2023-06-23T18:44:52.498229+0000","last_fullsized":"2023-06-23T18:44:52.498229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:29:44.651970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006353+0000","last_change":"2023-06-23T18:44:50.676320+0000","last_active":"2023-06-23T18:44:52.006353+0000","last_peered":"2023-06-23T18:44:52.006353+0000","last_clean":"2023-06-23T18:44:52.006353+0000","last_became_active":"2023-06-23T18:44:50.676054+0000","last_became_peered":"2023-06-23T18:44:50.676054+0000","last_unstale":"2023-06-23T18:44:52.006353+0000","last_undegraded":"2023-06-23T18:44:52.006353+0000","last_fullsized":"2023-06-23T18:44:52.006353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:59:07.537499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404037+0000","last_change":"2023-06-23T18:44:50.663287+0000","last_active":"2023-06-23T18:44:52.404037+0000","last_peered":"2023-06-23T18:44:52.404037+0000","last_clean":"2023-06-23T18:44:52.404037+0000","last_became_active":"2023-06-23T18:44:50.663006+0000","last_became_peered":"2023-06-23T18:44:50.663006+0000","last_unstale":"2023-06-23T18:44:52.404037+0000","last_undegraded":"2023-06-23T18:44:52.404037+0000","last_fullsized":"2023-06-23T18:44:52.404037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:17:28.994298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083234+0000","last_change":"2023-06-23T18:44:50.668418+0000","last_active":"2023-06-23T18:44:53.083234+0000","last_peered":"2023-06-23T18:44:53.083234+0000","last_clean":"2023-06-23T18:44:53.083234+0000","last_became_active":"2023-06-23T18:44:50.668029+0000","last_became_peered":"2023-06-23T18:44:50.668029+0000","last_unstale":"2023-06-23T18:44:53.083234+0000","last_undegraded":"2023-06-23T18:44:53.083234+0000","last_fullsized":"2023-06-23T18:44:53.083234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:11:35.546421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006017+0000","last_change":"2023-06-23T18:44:50.675363+0000","last_active":"2023-06-23T18:44:52.006017+0000","last_peered":"2023-06-23T18:44:52.006017+0000","last_clean":"2023-06-23T18:44:52.006017+0000","last_became_active":"2023-06-23T18:44:50.675099+0000","last_became_peered":"2023-06-23T18:44:50.675099+0000","last_unstale":"2023-06-23T18:44:52.006017+0000","last_undegraded":"2023-06-23T18:44:52.006017+0000","last_fullsized":"2023-06-23T18:44:52.006017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:24:00.797602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650898+0000","last_change":"2023-06-23T18:44:50.662603+0000","last_active":"2023-06-23T18:44:51.650898+0000","last_peered":"2023-06-23T18:44:51.650898+0000","last_clean":"2023-06-23T18:44:51.650898+0000","last_became_active":"2023-06-23T18:44:50.662318+0000","last_became_peered":"2023-06-23T18:44:50.662318+0000","last_unstale":"2023-06-23T18:44:51.650898+0000","last_undegraded":"2023-06-23T18:44:51.650898+0000","last_fullsized":"2023-06-23T18:44:51.650898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:23:07.364903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650929+0000","last_change":"2023-06-23T18:44:50.655943+0000","last_active":"2023-06-23T18:44:51.650929+0000","last_peered":"2023-06-23T18:44:51.650929+0000","last_clean":"2023-06-23T18:44:51.650929+0000","last_became_active":"2023-06-23T18:44:50.655672+0000","last_became_peered":"2023-06-23T18:44:50.655672+0000","last_unstale":"2023-06-23T18:44:51.650929+0000","last_undegraded":"2023-06-23T18:44:51.650929+0000","last_fullsized":"2023-06-23T18:44:51.650929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:53:28.521694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083680+0000","last_change":"2023-06-23T18:44:50.670220+0000","last_active":"2023-06-23T18:44:53.083680+0000","last_peered":"2023-06-23T18:44:53.083680+0000","last_clean":"2023-06-23T18:44:53.083680+0000","last_became_active":"2023-06-23T18:44:50.669773+0000","last_became_peered":"2023-06-23T18:44:50.669773+0000","last_unstale":"2023-06-23T18:44:53.083680+0000","last_undegraded":"2023-06-23T18:44:53.083680+0000","last_fullsized":"2023-06-23T18:44:53.083680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:26:23.851192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498027+0000","last_change":"2023-06-23T18:44:50.246485+0000","last_active":"2023-06-23T18:44:52.498027+0000","last_peered":"2023-06-23T18:44:52.498027+0000","last_clean":"2023-06-23T18:44:52.498027+0000","last_became_active":"2023-06-23T18:44:50.246186+0000","last_became_peered":"2023-06-23T18:44:50.246186+0000","last_unstale":"2023-06-23T18:44:52.498027+0000","last_undegraded":"2023-06-23T18:44:52.498027+0000","last_fullsized":"2023-06-23T18:44:52.498027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:00:28.617628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083532+0000","last_change":"2023-06-23T18:44:50.665653+0000","last_active":"2023-06-23T18:44:53.083532+0000","last_peered":"2023-06-23T18:44:53.083532+0000","last_clean":"2023-06-23T18:44:53.083532+0000","last_became_active":"2023-06-23T18:44:50.665383+0000","last_became_peered":"2023-06-23T18:44:50.665383+0000","last_unstale":"2023-06-23T18:44:53.083532+0000","last_undegraded":"2023-06-23T18:44:53.083532+0000","last_fullsized":"2023-06-23T18:44:53.083532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:24:20.739761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650418+0000","last_change":"2023-06-23T18:44:50.244604+0000","last_active":"2023-06-23T18:44:51.650418+0000","last_peered":"2023-06-23T18:44:51.650418+0000","last_clean":"2023-06-23T18:44:51.650418+0000","last_became_active":"2023-06-23T18:44:50.244307+0000","last_became_peered":"2023-06-23T18:44:50.244307+0000","last_unstale":"2023-06-23T18:44:51.650418+0000","last_undegraded":"2023-06-23T18:44:51.650418+0000","last_fullsized":"2023-06-23T18:44:51.650418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:04:47.082248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404529+0000","last_change":"2023-06-23T18:44:50.674014+0000","last_active":"2023-06-23T18:44:52.404529+0000","last_peered":"2023-06-23T18:44:52.404529+0000","last_clean":"2023-06-23T18:44:52.404529+0000","last_became_active":"2023-06-23T18:44:50.673751+0000","last_became_peered":"2023-06-23T18:44:50.673751+0000","last_unstale":"2023-06-23T18:44:52.404529+0000","last_undegraded":"2023-06-23T18:44:52.404529+0000","last_fullsized":"2023-06-23T18:44:52.404529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:24:00.797602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083215+0000","last_change":"2023-06-23T18:44:50.241541+0000","last_active":"2023-06-23T18:44:53.083215+0000","last_peered":"2023-06-23T18:44:53.083215+0000","last_clean":"2023-06-23T18:44:53.083215+0000","last_became_active":"2023-06-23T18:44:50.241250+0000","last_became_peered":"2023-06-23T18:44:50.241250+0000","last_unstale":"2023-06-23T18:44:53.083215+0000","last_undegraded":"2023-06-23T18:44:53.083215+0000","last_fullsized":"2023-06-23T18:44:53.083215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:53:27.516664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655460+0000","last_change":"2023-06-23T18:44:50.665987+0000","last_active":"2023-06-23T18:44:51.655460+0000","last_peered":"2023-06-23T18:44:51.655460+0000","last_clean":"2023-06-23T18:44:51.655460+0000","last_became_active":"2023-06-23T18:44:50.665705+0000","last_became_peered":"2023-06-23T18:44:50.665705+0000","last_unstale":"2023-06-23T18:44:51.655460+0000","last_undegraded":"2023-06-23T18:44:51.655460+0000","last_fullsized":"2023-06-23T18:44:51.655460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:26:23.851192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404593+0000","last_change":"2023-06-23T18:44:50.240166+0000","last_active":"2023-06-23T18:44:52.404593+0000","last_peered":"2023-06-23T18:44:52.404593+0000","last_clean":"2023-06-23T18:44:52.404593+0000","last_became_active":"2023-06-23T18:44:50.239596+0000","last_became_peered":"2023-06-23T18:44:50.239596+0000","last_unstale":"2023-06-23T18:44:52.404593+0000","last_undegraded":"2023-06-23T18:44:52.404593+0000","last_fullsized":"2023-06-23T18:44:52.404593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:43:04.875204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083177+0000","last_change":"2023-06-23T18:44:50.663993+0000","last_active":"2023-06-23T18:44:53.083177+0000","last_peered":"2023-06-23T18:44:53.083177+0000","last_clean":"2023-06-23T18:44:53.083177+0000","last_became_active":"2023-06-23T18:44:50.663754+0000","last_became_peered":"2023-06-23T18:44:50.663754+0000","last_unstale":"2023-06-23T18:44:53.083177+0000","last_undegraded":"2023-06-23T18:44:53.083177+0000","last_fullsized":"2023-06-23T18:44:53.083177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:06:39.243693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083757+0000","last_change":"2023-06-23T18:44:50.244382+0000","last_active":"2023-06-23T18:44:53.083757+0000","last_peered":"2023-06-23T18:44:53.083757+0000","last_clean":"2023-06-23T18:44:53.083757+0000","last_became_active":"2023-06-23T18:44:50.244129+0000","last_became_peered":"2023-06-23T18:44:50.244129+0000","last_unstale":"2023-06-23T18:44:53.083757+0000","last_undegraded":"2023-06-23T18:44:53.083757+0000","last_fullsized":"2023-06-23T18:44:53.083757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:09:26.749689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083543+0000","last_change":"2023-06-23T18:44:50.670667+0000","last_active":"2023-06-23T18:44:53.083543+0000","last_peered":"2023-06-23T18:44:53.083543+0000","last_clean":"2023-06-23T18:44:53.083543+0000","last_became_active":"2023-06-23T18:44:50.670402+0000","last_became_peered":"2023-06-23T18:44:50.670402+0000","last_unstale":"2023-06-23T18:44:53.083543+0000","last_undegraded":"2023-06-23T18:44:53.083543+0000","last_fullsized":"2023-06-23T18:44:53.083543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:30:37.852223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006302+0000","last_change":"2023-06-23T18:44:50.249346+0000","last_active":"2023-06-23T18:44:52.006302+0000","last_peered":"2023-06-23T18:44:52.006302+0000","last_clean":"2023-06-23T18:44:52.006302+0000","last_became_active":"2023-06-23T18:44:50.249071+0000","last_became_peered":"2023-06-23T18:44:50.249071+0000","last_unstale":"2023-06-23T18:44:52.006302+0000","last_undegraded":"2023-06-23T18:44:52.006302+0000","last_fullsized":"2023-06-23T18:44:52.006302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:48:25.639120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650607+0000","last_change":"2023-06-23T18:44:50.663115+0000","last_active":"2023-06-23T18:44:51.650607+0000","last_peered":"2023-06-23T18:44:51.650607+0000","last_clean":"2023-06-23T18:44:51.650607+0000","last_became_active":"2023-06-23T18:44:50.662843+0000","last_became_peered":"2023-06-23T18:44:50.662843+0000","last_unstale":"2023-06-23T18:44:51.650607+0000","last_undegraded":"2023-06-23T18:44:51.650607+0000","last_fullsized":"2023-06-23T18:44:51.650607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:17:28.994298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498336+0000","last_change":"2023-06-23T18:44:50.247158+0000","last_active":"2023-06-23T18:44:52.498336+0000","last_peered":"2023-06-23T18:44:52.498336+0000","last_clean":"2023-06-23T18:44:52.498336+0000","last_became_active":"2023-06-23T18:44:50.246857+0000","last_became_peered":"2023-06-23T18:44:50.246857+0000","last_unstale":"2023-06-23T18:44:52.498336+0000","last_undegraded":"2023-06-23T18:44:52.498336+0000","last_fullsized":"2023-06-23T18:44:52.498336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:04:29.395928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498272+0000","last_change":"2023-06-23T18:44:50.667952+0000","last_active":"2023-06-23T18:44:52.498272+0000","last_peered":"2023-06-23T18:44:52.498272+0000","last_clean":"2023-06-23T18:44:52.498272+0000","last_became_active":"2023-06-23T18:44:50.667653+0000","last_became_peered":"2023-06-23T18:44:50.667653+0000","last_unstale":"2023-06-23T18:44:52.498272+0000","last_undegraded":"2023-06-23T18:44:52.498272+0000","last_fullsized":"2023-06-23T18:44:52.498272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:17:33.321718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006119+0000","last_change":"2023-06-23T18:44:50.248101+0000","last_active":"2023-06-23T18:44:52.006119+0000","last_peered":"2023-06-23T18:44:52.006119+0000","last_clean":"2023-06-23T18:44:52.006119+0000","last_became_active":"2023-06-23T18:44:50.247805+0000","last_became_peered":"2023-06-23T18:44:50.247805+0000","last_unstale":"2023-06-23T18:44:52.006119+0000","last_undegraded":"2023-06-23T18:44:52.006119+0000","last_fullsized":"2023-06-23T18:44:52.006119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:24:19.734731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083396+0000","last_change":"2023-06-23T18:44:50.667698+0000","last_active":"2023-06-23T18:44:53.083396+0000","last_peered":"2023-06-23T18:44:53.083396+0000","last_clean":"2023-06-23T18:44:53.083396+0000","last_became_active":"2023-06-23T18:44:50.667423+0000","last_became_peered":"2023-06-23T18:44:50.667423+0000","last_unstale":"2023-06-23T18:44:53.083396+0000","last_undegraded":"2023-06-23T18:44:53.083396+0000","last_fullsized":"2023-06-23T18:44:53.083396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:00:29.622659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404201+0000","last_change":"2023-06-23T18:44:50.247136+0000","last_active":"2023-06-23T18:44:52.404201+0000","last_peered":"2023-06-23T18:44:52.404201+0000","last_clean":"2023-06-23T18:44:52.404201+0000","last_became_active":"2023-06-23T18:44:50.246862+0000","last_became_peered":"2023-06-23T18:44:50.246862+0000","last_unstale":"2023-06-23T18:44:52.404201+0000","last_undegraded":"2023-06-23T18:44:52.404201+0000","last_fullsized":"2023-06-23T18:44:52.404201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:33:31.904138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083823+0000","last_change":"2023-06-23T18:44:50.670045+0000","last_active":"2023-06-23T18:44:53.083823+0000","last_peered":"2023-06-23T18:44:53.083823+0000","last_clean":"2023-06-23T18:44:53.083823+0000","last_became_active":"2023-06-23T18:44:50.669434+0000","last_became_peered":"2023-06-23T18:44:50.669434+0000","last_unstale":"2023-06-23T18:44:53.083823+0000","last_undegraded":"2023-06-23T18:44:53.083823+0000","last_fullsized":"2023-06-23T18:44:53.083823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:11:35.546421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006195+0000","last_change":"2023-06-23T18:44:50.248720+0000","last_active":"2023-06-23T18:44:52.006195+0000","last_peered":"2023-06-23T18:44:52.006195+0000","last_clean":"2023-06-23T18:44:52.006195+0000","last_became_active":"2023-06-23T18:44:50.248413+0000","last_became_peered":"2023-06-23T18:44:50.248413+0000","last_unstale":"2023-06-23T18:44:52.006195+0000","last_undegraded":"2023-06-23T18:44:52.006195+0000","last_fullsized":"2023-06-23T18:44:52.006195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:29:43.646940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404302+0000","last_change":"2023-06-23T18:44:50.670389+0000","last_active":"2023-06-23T18:44:52.404302+0000","last_peered":"2023-06-23T18:44:52.404302+0000","last_clean":"2023-06-23T18:44:52.404302+0000","last_became_active":"2023-06-23T18:44:50.670097+0000","last_became_peered":"2023-06-23T18:44:50.670097+0000","last_unstale":"2023-06-23T18:44:52.404302+0000","last_undegraded":"2023-06-23T18:44:52.404302+0000","last_fullsized":"2023-06-23T18:44:52.404302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:09:27.754720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.654985+0000","last_change":"2023-06-23T18:44:50.248018+0000","last_active":"2023-06-23T18:44:51.654985+0000","last_peered":"2023-06-23T18:44:51.654985+0000","last_clean":"2023-06-23T18:44:51.654985+0000","last_became_active":"2023-06-23T18:44:50.247728+0000","last_became_peered":"2023-06-23T18:44:50.247728+0000","last_unstale":"2023-06-23T18:44:51.654985+0000","last_undegraded":"2023-06-23T18:44:51.654985+0000","last_fullsized":"2023-06-23T18:44:51.654985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:26:27.403377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.084085+0000","last_change":"2023-06-23T18:44:50.671378+0000","last_active":"2023-06-23T18:44:53.084085+0000","last_peered":"2023-06-23T18:44:53.084085+0000","last_clean":"2023-06-23T18:44:53.084085+0000","last_became_active":"2023-06-23T18:44:50.671070+0000","last_became_peered":"2023-06-23T18:44:50.671070+0000","last_unstale":"2023-06-23T18:44:53.084085+0000","last_undegraded":"2023-06-23T18:44:53.084085+0000","last_fullsized":"2023-06-23T18:44:53.084085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:59:07.537499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006489+0000","last_change":"2023-06-23T18:44:50.248058+0000","last_active":"2023-06-23T18:44:52.006489+0000","last_peered":"2023-06-23T18:44:52.006489+0000","last_clean":"2023-06-23T18:44:52.006489+0000","last_became_active":"2023-06-23T18:44:50.247761+0000","last_became_peered":"2023-06-23T18:44:50.247761+0000","last_unstale":"2023-06-23T18:44:52.006489+0000","last_undegraded":"2023-06-23T18:44:52.006489+0000","last_fullsized":"2023-06-23T18:44:52.006489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:51:58.116537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083517+0000","last_change":"2023-06-23T18:44:50.669693+0000","last_active":"2023-06-23T18:44:53.083517+0000","last_peered":"2023-06-23T18:44:53.083517+0000","last_clean":"2023-06-23T18:44:53.083517+0000","last_became_active":"2023-06-23T18:44:50.669380+0000","last_became_peered":"2023-06-23T18:44:50.669380+0000","last_unstale":"2023-06-23T18:44:53.083517+0000","last_undegraded":"2023-06-23T18:44:53.083517+0000","last_fullsized":"2023-06-23T18:44:53.083517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:17:28.994298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006321+0000","last_change":"2023-06-23T18:44:50.248597+0000","last_active":"2023-06-23T18:44:52.006321+0000","last_peered":"2023-06-23T18:44:52.006321+0000","last_clean":"2023-06-23T18:44:52.006321+0000","last_became_active":"2023-06-23T18:44:50.248309+0000","last_became_peered":"2023-06-23T18:44:50.248309+0000","last_unstale":"2023-06-23T18:44:52.006321+0000","last_undegraded":"2023-06-23T18:44:52.006321+0000","last_fullsized":"2023-06-23T18:44:52.006321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:36:18.947220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.497799+0000","last_change":"2023-06-23T18:44:50.667519+0000","last_active":"2023-06-23T18:44:52.497799+0000","last_peered":"2023-06-23T18:44:52.497799+0000","last_clean":"2023-06-23T18:44:52.497799+0000","last_became_active":"2023-06-23T18:44:50.667042+0000","last_became_peered":"2023-06-23T18:44:50.667042+0000","last_unstale":"2023-06-23T18:44:52.497799+0000","last_undegraded":"2023-06-23T18:44:52.497799+0000","last_fullsized":"2023-06-23T18:44:52.497799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:39:47.275362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006335+0000","last_change":"2023-06-23T18:44:50.247778+0000","last_active":"2023-06-23T18:44:52.006335+0000","last_peered":"2023-06-23T18:44:52.006335+0000","last_clean":"2023-06-23T18:44:52.006335+0000","last_became_active":"2023-06-23T18:44:50.247501+0000","last_became_peered":"2023-06-23T18:44:50.247501+0000","last_unstale":"2023-06-23T18:44:52.006335+0000","last_undegraded":"2023-06-23T18:44:52.006335+0000","last_fullsized":"2023-06-23T18:44:52.006335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:29:14.124932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655300+0000","last_change":"2023-06-23T18:44:50.666494+0000","last_active":"2023-06-23T18:44:51.655300+0000","last_peered":"2023-06-23T18:44:51.655300+0000","last_clean":"2023-06-23T18:44:51.655300+0000","last_became_active":"2023-06-23T18:44:50.666222+0000","last_became_peered":"2023-06-23T18:44:50.666222+0000","last_unstale":"2023-06-23T18:44:51.655300+0000","last_undegraded":"2023-06-23T18:44:51.655300+0000","last_fullsized":"2023-06-23T18:44:51.655300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:01:09.268705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083811+0000","last_change":"2023-06-23T18:44:50.242391+0000","last_active":"2023-06-23T18:44:53.083811+0000","last_peered":"2023-06-23T18:44:53.083811+0000","last_clean":"2023-06-23T18:44:53.083811+0000","last_became_active":"2023-06-23T18:44:50.242109+0000","last_became_peered":"2023-06-23T18:44:50.242109+0000","last_unstale":"2023-06-23T18:44:53.083811+0000","last_undegraded":"2023-06-23T18:44:53.083811+0000","last_fullsized":"2023-06-23T18:44:53.083811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:06:38.238662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404239+0000","last_change":"2023-06-23T18:44:50.663583+0000","last_active":"2023-06-23T18:44:52.404239+0000","last_peered":"2023-06-23T18:44:52.404239+0000","last_clean":"2023-06-23T18:44:52.404239+0000","last_became_active":"2023-06-23T18:44:50.663317+0000","last_became_peered":"2023-06-23T18:44:50.663317+0000","last_unstale":"2023-06-23T18:44:52.404239+0000","last_undegraded":"2023-06-23T18:44:52.404239+0000","last_fullsized":"2023-06-23T18:44:52.404239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:26:23.851192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083882+0000","last_change":"2023-06-23T18:44:50.241365+0000","last_active":"2023-06-23T18:44:53.083882+0000","last_peered":"2023-06-23T18:44:53.083882+0000","last_clean":"2023-06-23T18:44:53.083882+0000","last_became_active":"2023-06-23T18:44:50.241047+0000","last_became_peered":"2023-06-23T18:44:50.241047+0000","last_unstale":"2023-06-23T18:44:53.083882+0000","last_undegraded":"2023-06-23T18:44:53.083882+0000","last_fullsized":"2023-06-23T18:44:53.083882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:36:18.947220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498069+0000","last_change":"2023-06-23T18:44:50.675000+0000","last_active":"2023-06-23T18:44:52.498069+0000","last_peered":"2023-06-23T18:44:52.498069+0000","last_clean":"2023-06-23T18:44:52.498069+0000","last_became_active":"2023-06-23T18:44:50.674723+0000","last_became_peered":"2023-06-23T18:44:50.674723+0000","last_unstale":"2023-06-23T18:44:52.498069+0000","last_undegraded":"2023-06-23T18:44:52.498069+0000","last_fullsized":"2023-06-23T18:44:52.498069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:36:19.952251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655092+0000","last_change":"2023-06-23T18:44:50.247990+0000","last_active":"2023-06-23T18:44:51.655092+0000","last_peered":"2023-06-23T18:44:51.655092+0000","last_clean":"2023-06-23T18:44:51.655092+0000","last_became_active":"2023-06-23T18:44:50.247701+0000","last_became_peered":"2023-06-23T18:44:50.247701+0000","last_unstale":"2023-06-23T18:44:51.655092+0000","last_undegraded":"2023-06-23T18:44:51.655092+0000","last_fullsized":"2023-06-23T18:44:51.655092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:30:47.540693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498444+0000","last_change":"2023-06-23T18:44:50.666801+0000","last_active":"2023-06-23T18:44:52.498444+0000","last_peered":"2023-06-23T18:44:52.498444+0000","last_clean":"2023-06-23T18:44:52.498444+0000","last_became_active":"2023-06-23T18:44:50.666395+0000","last_became_peered":"2023-06-23T18:44:50.666395+0000","last_unstale":"2023-06-23T18:44:52.498444+0000","last_undegraded":"2023-06-23T18:44:52.498444+0000","last_fullsized":"2023-06-23T18:44:52.498444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:50:28.729386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498272+0000","last_change":"2023-06-23T18:44:50.240923+0000","last_active":"2023-06-23T18:44:52.498272+0000","last_peered":"2023-06-23T18:44:52.498272+0000","last_clean":"2023-06-23T18:44:52.498272+0000","last_became_active":"2023-06-23T18:44:50.240629+0000","last_became_peered":"2023-06-23T18:44:50.240629+0000","last_unstale":"2023-06-23T18:44:52.498272+0000","last_undegraded":"2023-06-23T18:44:52.498272+0000","last_fullsized":"2023-06-23T18:44:52.498272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:51:58.116537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498420+0000","last_change":"2023-06-23T18:44:50.669953+0000","last_active":"2023-06-23T18:44:52.498420+0000","last_peered":"2023-06-23T18:44:52.498420+0000","last_clean":"2023-06-23T18:44:52.498420+0000","last_became_active":"2023-06-23T18:44:50.668113+0000","last_became_peered":"2023-06-23T18:44:50.668113+0000","last_unstale":"2023-06-23T18:44:52.498420+0000","last_undegraded":"2023-06-23T18:44:52.498420+0000","last_fullsized":"2023-06-23T18:44:52.498420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:20:58.258094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083089+0000","last_change":"2023-06-23T18:44:50.248367+0000","last_active":"2023-06-23T18:44:53.083089+0000","last_peered":"2023-06-23T18:44:53.083089+0000","last_clean":"2023-06-23T18:44:53.083089+0000","last_became_active":"2023-06-23T18:44:50.248058+0000","last_became_peered":"2023-06-23T18:44:50.248058+0000","last_unstale":"2023-06-23T18:44:53.083089+0000","last_undegraded":"2023-06-23T18:44:53.083089+0000","last_fullsized":"2023-06-23T18:44:53.083089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:23:06.359872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.651039+0000","last_change":"2023-06-23T18:44:50.668275+0000","last_active":"2023-06-23T18:44:51.651039+0000","last_peered":"2023-06-23T18:44:51.651039+0000","last_clean":"2023-06-23T18:44:51.651039+0000","last_became_active":"2023-06-23T18:44:50.668011+0000","last_became_peered":"2023-06-23T18:44:50.668011+0000","last_unstale":"2023-06-23T18:44:51.651039+0000","last_undegraded":"2023-06-23T18:44:51.651039+0000","last_fullsized":"2023-06-23T18:44:51.651039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:11:35.546421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083964+0000","last_change":"2023-06-23T18:44:50.247291+0000","last_active":"2023-06-23T18:44:53.083964+0000","last_peered":"2023-06-23T18:44:53.083964+0000","last_clean":"2023-06-23T18:44:53.083964+0000","last_became_active":"2023-06-23T18:44:50.246993+0000","last_became_peered":"2023-06-23T18:44:50.246993+0000","last_unstale":"2023-06-23T18:44:53.083964+0000","last_undegraded":"2023-06-23T18:44:53.083964+0000","last_fullsized":"2023-06-23T18:44:53.083964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:29:14.124932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498255+0000","last_change":"2023-06-23T18:44:45.192683+0000","last_active":"2023-06-23T18:44:52.498255+0000","last_peered":"2023-06-23T18:44:52.498255+0000","last_clean":"2023-06-23T18:44:52.498255+0000","last_became_active":"2023-06-23T18:44:45.192364+0000","last_became_peered":"2023-06-23T18:44:45.192364+0000","last_unstale":"2023-06-23T18:44:52.498255+0000","last_undegraded":"2023-06-23T18:44:52.498255+0000","last_fullsized":"2023-06-23T18:44:52.498255+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:18:43.258051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083022+0000","last_change":"2023-06-23T18:44:50.669848+0000","last_active":"2023-06-23T18:44:53.083022+0000","last_peered":"2023-06-23T18:44:53.083022+0000","last_clean":"2023-06-23T18:44:53.083022+0000","last_became_active":"2023-06-23T18:44:50.669597+0000","last_became_peered":"2023-06-23T18:44:50.669597+0000","last_unstale":"2023-06-23T18:44:53.083022+0000","last_undegraded":"2023-06-23T18:44:53.083022+0000","last_fullsized":"2023-06-23T18:44:53.083022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:09:27.754720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083471+0000","last_change":"2023-06-23T18:44:45.194010+0000","last_active":"2023-06-23T18:44:53.083471+0000","last_peered":"2023-06-23T18:44:53.083471+0000","last_clean":"2023-06-23T18:44:53.083471+0000","last_became_active":"2023-06-23T18:44:45.193665+0000","last_became_peered":"2023-06-23T18:44:45.193665+0000","last_unstale":"2023-06-23T18:44:53.083471+0000","last_undegraded":"2023-06-23T18:44:53.083471+0000","last_fullsized":"2023-06-23T18:44:53.083471+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:42:59.835944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.832747+0000","last_change":"2023-06-23T18:44:50.248035+0000","last_active":"2023-06-23T18:44:52.832747+0000","last_peered":"2023-06-23T18:44:52.832747+0000","last_clean":"2023-06-23T18:44:52.832747+0000","last_became_active":"2023-06-23T18:44:50.247776+0000","last_became_peered":"2023-06-23T18:44:50.247776+0000","last_unstale":"2023-06-23T18:44:52.832747+0000","last_undegraded":"2023-06-23T18:44:52.832747+0000","last_fullsized":"2023-06-23T18:44:52.832747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:27:53.233025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.497839+0000","last_change":"2023-06-23T18:44:50.665741+0000","last_active":"2023-06-23T18:44:52.497839+0000","last_peered":"2023-06-23T18:44:52.497839+0000","last_clean":"2023-06-23T18:44:52.497839+0000","last_became_active":"2023-06-23T18:44:50.665276+0000","last_became_peered":"2023-06-23T18:44:50.665276+0000","last_unstale":"2023-06-23T18:44:52.497839+0000","last_undegraded":"2023-06-23T18:44:52.497839+0000","last_fullsized":"2023-06-23T18:44:52.497839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:24:00.797602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650429+0000","last_change":"2023-06-23T18:44:45.192024+0000","last_active":"2023-06-23T18:44:51.650429+0000","last_peered":"2023-06-23T18:44:51.650429+0000","last_clean":"2023-06-23T18:44:51.650429+0000","last_became_active":"2023-06-23T18:44:45.191752+0000","last_became_peered":"2023-06-23T18:44:45.191752+0000","last_unstale":"2023-06-23T18:44:51.650429+0000","last_undegraded":"2023-06-23T18:44:51.650429+0000","last_fullsized":"2023-06-23T18:44:51.650429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:01:03.224415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006092+0000","last_change":"2023-06-23T18:44:45.193018+0000","last_active":"2023-06-23T18:44:52.006092+0000","last_peered":"2023-06-23T18:44:52.006092+0000","last_clean":"2023-06-23T18:44:52.006092+0000","last_became_active":"2023-06-23T18:44:45.192689+0000","last_became_peered":"2023-06-23T18:44:45.192689+0000","last_unstale":"2023-06-23T18:44:52.006092+0000","last_undegraded":"2023-06-23T18:44:52.006092+0000","last_fullsized":"2023-06-23T18:44:52.006092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:30:31.807933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404052+0000","last_change":"2023-06-23T18:44:50.244324+0000","last_active":"2023-06-23T18:44:52.404052+0000","last_peered":"2023-06-23T18:44:52.404052+0000","last_clean":"2023-06-23T18:44:52.404052+0000","last_became_active":"2023-06-23T18:44:50.242219+0000","last_became_peered":"2023-06-23T18:44:50.242219+0000","last_unstale":"2023-06-23T18:44:52.404052+0000","last_undegraded":"2023-06-23T18:44:52.404052+0000","last_fullsized":"2023-06-23T18:44:52.404052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:57:45.432002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404339+0000","last_change":"2023-06-23T18:44:50.660290+0000","last_active":"2023-06-23T18:44:52.404339+0000","last_peered":"2023-06-23T18:44:52.404339+0000","last_clean":"2023-06-23T18:44:52.404339+0000","last_became_active":"2023-06-23T18:44:50.660095+0000","last_became_peered":"2023-06-23T18:44:50.660095+0000","last_unstale":"2023-06-23T18:44:52.404339+0000","last_undegraded":"2023-06-23T18:44:52.404339+0000","last_fullsized":"2023-06-23T18:44:52.404339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:23:07.364903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.005876+0000","last_change":"2023-06-23T18:44:45.577146+0000","last_active":"2023-06-23T18:44:52.005876+0000","last_peered":"2023-06-23T18:44:52.005876+0000","last_clean":"2023-06-23T18:44:52.005876+0000","last_became_active":"2023-06-23T18:44:45.576835+0000","last_became_peered":"2023-06-23T18:44:45.576835+0000","last_unstale":"2023-06-23T18:44:52.005876+0000","last_undegraded":"2023-06-23T18:44:52.005876+0000","last_fullsized":"2023-06-23T18:44:52.005876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:39:41.231072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650345+0000","last_change":"2023-06-23T18:44:50.242675+0000","last_active":"2023-06-23T18:44:51.650345+0000","last_peered":"2023-06-23T18:44:51.650345+0000","last_clean":"2023-06-23T18:44:51.650345+0000","last_became_active":"2023-06-23T18:44:50.242356+0000","last_became_peered":"2023-06-23T18:44:50.242356+0000","last_unstale":"2023-06-23T18:44:51.650345+0000","last_undegraded":"2023-06-23T18:44:51.650345+0000","last_fullsized":"2023-06-23T18:44:51.650345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:30:47.540693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650895+0000","last_change":"2023-06-23T18:44:50.661341+0000","last_active":"2023-06-23T18:44:51.650895+0000","last_peered":"2023-06-23T18:44:51.650895+0000","last_clean":"2023-06-23T18:44:51.650895+0000","last_became_active":"2023-06-23T18:44:50.661088+0000","last_became_peered":"2023-06-23T18:44:50.661088+0000","last_unstale":"2023-06-23T18:44:51.650895+0000","last_undegraded":"2023-06-23T18:44:51.650895+0000","last_fullsized":"2023-06-23T18:44:51.650895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:06:39.243693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.005910+0000","last_change":"2023-06-23T18:44:45.577304+0000","last_active":"2023-06-23T18:44:52.005910+0000","last_peered":"2023-06-23T18:44:52.005910+0000","last_clean":"2023-06-23T18:44:52.005910+0000","last_became_active":"2023-06-23T18:44:45.576846+0000","last_became_peered":"2023-06-23T18:44:45.576846+0000","last_unstale":"2023-06-23T18:44:52.005910+0000","last_undegraded":"2023-06-23T18:44:52.005910+0000","last_fullsized":"2023-06-23T18:44:52.005910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:27:48.193765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083316+0000","last_change":"2023-06-23T18:44:50.240634+0000","last_active":"2023-06-23T18:44:53.083316+0000","last_peered":"2023-06-23T18:44:53.083316+0000","last_clean":"2023-06-23T18:44:53.083316+0000","last_became_active":"2023-06-23T18:44:50.240328+0000","last_became_peered":"2023-06-23T18:44:50.240328+0000","last_unstale":"2023-06-23T18:44:53.083316+0000","last_undegraded":"2023-06-23T18:44:53.083316+0000","last_fullsized":"2023-06-23T18:44:53.083316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:39:46.270331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655442+0000","last_change":"2023-06-23T18:44:50.668726+0000","last_active":"2023-06-23T18:44:51.655442+0000","last_peered":"2023-06-23T18:44:51.655442+0000","last_clean":"2023-06-23T18:44:51.655442+0000","last_became_active":"2023-06-23T18:44:50.668435+0000","last_became_peered":"2023-06-23T18:44:50.668435+0000","last_unstale":"2023-06-23T18:44:51.655442+0000","last_undegraded":"2023-06-23T18:44:51.655442+0000","last_fullsized":"2023-06-23T18:44:51.655442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:33:32.909168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083490+0000","last_change":"2023-06-23T18:44:45.577154+0000","last_active":"2023-06-23T18:44:53.083490+0000","last_peered":"2023-06-23T18:44:53.083490+0000","last_clean":"2023-06-23T18:44:53.083490+0000","last_became_active":"2023-06-23T18:44:45.576819+0000","last_became_peered":"2023-06-23T18:44:45.576819+0000","last_unstale":"2023-06-23T18:44:53.083490+0000","last_undegraded":"2023-06-23T18:44:53.083490+0000","last_fullsized":"2023-06-23T18:44:53.083490+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:01:03.224415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498150+0000","last_change":"2023-06-23T18:44:50.248143+0000","last_active":"2023-06-23T18:44:52.498150+0000","last_peered":"2023-06-23T18:44:52.498150+0000","last_clean":"2023-06-23T18:44:52.498150+0000","last_became_active":"2023-06-23T18:44:50.247890+0000","last_became_peered":"2023-06-23T18:44:50.247890+0000","last_unstale":"2023-06-23T18:44:52.498150+0000","last_undegraded":"2023-06-23T18:44:52.498150+0000","last_fullsized":"2023-06-23T18:44:52.498150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:29:14.124932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650785+0000","last_change":"2023-06-23T18:44:50.661047+0000","last_active":"2023-06-23T18:44:51.650785+0000","last_peered":"2023-06-23T18:44:51.650785+0000","last_clean":"2023-06-23T18:44:51.650785+0000","last_became_active":"2023-06-23T18:44:50.660762+0000","last_became_peered":"2023-06-23T18:44:50.660762+0000","last_unstale":"2023-06-23T18:44:51.650785+0000","last_undegraded":"2023-06-23T18:44:51.650785+0000","last_fullsized":"2023-06-23T18:44:51.650785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:09:27.754720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655193+0000","last_change":"2023-06-23T18:44:45.577135+0000","last_active":"2023-06-23T18:44:51.655193+0000","last_peered":"2023-06-23T18:44:51.655193+0000","last_clean":"2023-06-23T18:44:51.655193+0000","last_became_active":"2023-06-23T18:44:45.576834+0000","last_became_peered":"2023-06-23T18:44:45.576834+0000","last_unstale":"2023-06-23T18:44:51.655193+0000","last_undegraded":"2023-06-23T18:44:51.655193+0000","last_fullsized":"2023-06-23T18:44:51.655193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:04:42.042988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650649+0000","last_change":"2023-06-23T18:44:50.244343+0000","last_active":"2023-06-23T18:44:51.650649+0000","last_peered":"2023-06-23T18:44:51.650649+0000","last_clean":"2023-06-23T18:44:51.650649+0000","last_became_active":"2023-06-23T18:44:50.244035+0000","last_became_peered":"2023-06-23T18:44:50.244035+0000","last_unstale":"2023-06-23T18:44:51.650649+0000","last_undegraded":"2023-06-23T18:44:51.650649+0000","last_fullsized":"2023-06-23T18:44:51.650649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:33:31.904138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404433+0000","last_change":"2023-06-23T18:44:50.658487+0000","last_active":"2023-06-23T18:44:52.404433+0000","last_peered":"2023-06-23T18:44:52.404433+0000","last_clean":"2023-06-23T18:44:52.404433+0000","last_became_active":"2023-06-23T18:44:50.656913+0000","last_became_peered":"2023-06-23T18:44:50.656913+0000","last_unstale":"2023-06-23T18:44:52.404433+0000","last_undegraded":"2023-06-23T18:44:52.404433+0000","last_fullsized":"2023-06-23T18:44:52.404433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:39:47.275362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655308+0000","last_change":"2023-06-23T18:44:45.192545+0000","last_active":"2023-06-23T18:44:51.655308+0000","last_peered":"2023-06-23T18:44:51.655308+0000","last_clean":"2023-06-23T18:44:51.655308+0000","last_became_active":"2023-06-23T18:44:45.192124+0000","last_became_peered":"2023-06-23T18:44:45.192124+0000","last_unstale":"2023-06-23T18:44:51.655308+0000","last_undegraded":"2023-06-23T18:44:51.655308+0000","last_fullsized":"2023-06-23T18:44:51.655308+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:57:40.392742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083879+0000","last_change":"2023-06-23T18:44:50.245977+0000","last_active":"2023-06-23T18:44:53.083879+0000","last_peered":"2023-06-23T18:44:53.083879+0000","last_clean":"2023-06-23T18:44:53.083879+0000","last_became_active":"2023-06-23T18:44:50.245656+0000","last_became_peered":"2023-06-23T18:44:50.245656+0000","last_unstale":"2023-06-23T18:44:53.083879+0000","last_undegraded":"2023-06-23T18:44:53.083879+0000","last_fullsized":"2023-06-23T18:44:53.083879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:39:46.270331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650648+0000","last_change":"2023-06-23T18:44:50.662985+0000","last_active":"2023-06-23T18:44:51.650648+0000","last_peered":"2023-06-23T18:44:51.650648+0000","last_clean":"2023-06-23T18:44:51.650648+0000","last_became_active":"2023-06-23T18:44:50.659614+0000","last_became_peered":"2023-06-23T18:44:50.659614+0000","last_unstale":"2023-06-23T18:44:51.650648+0000","last_undegraded":"2023-06-23T18:44:51.650648+0000","last_fullsized":"2023-06-23T18:44:51.650648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:26:23.851192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404590+0000","last_change":"2023-06-23T18:44:50.246331+0000","last_active":"2023-06-23T18:44:52.404590+0000","last_peered":"2023-06-23T18:44:52.404590+0000","last_clean":"2023-06-23T18:44:52.404590+0000","last_became_active":"2023-06-23T18:44:50.244789+0000","last_became_peered":"2023-06-23T18:44:50.244789+0000","last_unstale":"2023-06-23T18:44:52.404590+0000","last_undegraded":"2023-06-23T18:44:52.404590+0000","last_fullsized":"2023-06-23T18:44:52.404590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:24:19.734731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083457+0000","last_change":"2023-06-23T18:44:50.656054+0000","last_active":"2023-06-23T18:44:53.083457+0000","last_peered":"2023-06-23T18:44:53.083457+0000","last_clean":"2023-06-23T18:44:53.083457+0000","last_became_active":"2023-06-23T18:44:50.655781+0000","last_became_peered":"2023-06-23T18:44:50.655781+0000","last_unstale":"2023-06-23T18:44:53.083457+0000","last_undegraded":"2023-06-23T18:44:53.083457+0000","last_fullsized":"2023-06-23T18:44:53.083457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:31:28.989051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083546+0000","last_change":"2023-06-23T18:44:50.242527+0000","last_active":"2023-06-23T18:44:53.083546+0000","last_peered":"2023-06-23T18:44:53.083546+0000","last_clean":"2023-06-23T18:44:53.083546+0000","last_became_active":"2023-06-23T18:44:50.242265+0000","last_became_peered":"2023-06-23T18:44:50.242265+0000","last_unstale":"2023-06-23T18:44:53.083546+0000","last_undegraded":"2023-06-23T18:44:53.083546+0000","last_fullsized":"2023-06-23T18:44:53.083546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:33:31.904138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.497890+0000","last_change":"2023-06-23T18:44:50.673258+0000","last_active":"2023-06-23T18:44:52.497890+0000","last_peered":"2023-06-23T18:44:52.497890+0000","last_clean":"2023-06-23T18:44:52.497890+0000","last_became_active":"2023-06-23T18:44:50.672993+0000","last_became_peered":"2023-06-23T18:44:50.672993+0000","last_unstale":"2023-06-23T18:44:52.497890+0000","last_undegraded":"2023-06-23T18:44:52.497890+0000","last_fullsized":"2023-06-23T18:44:52.497890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:30:37.852223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.084007+0000","last_change":"2023-06-23T18:44:50.239578+0000","last_active":"2023-06-23T18:44:53.084007+0000","last_peered":"2023-06-23T18:44:53.084007+0000","last_clean":"2023-06-23T18:44:53.084007+0000","last_became_active":"2023-06-23T18:44:50.239290+0000","last_became_peered":"2023-06-23T18:44:50.239290+0000","last_unstale":"2023-06-23T18:44:53.084007+0000","last_undegraded":"2023-06-23T18:44:53.084007+0000","last_fullsized":"2023-06-23T18:44:53.084007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:23:59.792572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498376+0000","last_change":"2023-06-23T18:44:50.672381+0000","last_active":"2023-06-23T18:44:52.498376+0000","last_peered":"2023-06-23T18:44:52.498376+0000","last_clean":"2023-06-23T18:44:52.498376+0000","last_became_active":"2023-06-23T18:44:50.672098+0000","last_became_peered":"2023-06-23T18:44:50.672098+0000","last_unstale":"2023-06-23T18:44:52.498376+0000","last_undegraded":"2023-06-23T18:44:52.498376+0000","last_fullsized":"2023-06-23T18:44:52.498376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:59:11.512811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083560+0000","last_change":"2023-06-23T18:44:50.240690+0000","last_active":"2023-06-23T18:44:53.083560+0000","last_peered":"2023-06-23T18:44:53.083560+0000","last_clean":"2023-06-23T18:44:53.083560+0000","last_became_active":"2023-06-23T18:44:50.240111+0000","last_became_peered":"2023-06-23T18:44:50.240111+0000","last_unstale":"2023-06-23T18:44:53.083560+0000","last_undegraded":"2023-06-23T18:44:53.083560+0000","last_fullsized":"2023-06-23T18:44:53.083560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:29:43.646940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083395+0000","last_change":"2023-06-23T18:44:50.667526+0000","last_active":"2023-06-23T18:44:53.083395+0000","last_peered":"2023-06-23T18:44:53.083395+0000","last_clean":"2023-06-23T18:44:53.083395+0000","last_became_active":"2023-06-23T18:44:50.667214+0000","last_became_peered":"2023-06-23T18:44:50.667214+0000","last_unstale":"2023-06-23T18:44:53.083395+0000","last_undegraded":"2023-06-23T18:44:53.083395+0000","last_fullsized":"2023-06-23T18:44:53.083395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:24:00.797602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404617+0000","last_change":"2023-06-23T18:44:50.244989+0000","last_active":"2023-06-23T18:44:52.404617+0000","last_peered":"2023-06-23T18:44:52.404617+0000","last_clean":"2023-06-23T18:44:52.404617+0000","last_became_active":"2023-06-23T18:44:50.241979+0000","last_became_peered":"2023-06-23T18:44:50.241979+0000","last_unstale":"2023-06-23T18:44:52.404617+0000","last_undegraded":"2023-06-23T18:44:52.404617+0000","last_fullsized":"2023-06-23T18:44:52.404617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:30:36.847193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.497733+0000","last_change":"2023-06-23T18:44:50.670305+0000","last_active":"2023-06-23T18:44:52.497733+0000","last_peered":"2023-06-23T18:44:52.497733+0000","last_clean":"2023-06-23T18:44:52.497733+0000","last_became_active":"2023-06-23T18:44:50.668141+0000","last_became_peered":"2023-06-23T18:44:50.668141+0000","last_unstale":"2023-06-23T18:44:52.497733+0000","last_undegraded":"2023-06-23T18:44:52.497733+0000","last_fullsized":"2023-06-23T18:44:52.497733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:11:35.546421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655061+0000","last_change":"2023-06-23T18:44:50.656461+0000","last_active":"2023-06-23T18:44:51.655061+0000","last_peered":"2023-06-23T18:44:51.655061+0000","last_clean":"2023-06-23T18:44:51.655061+0000","last_became_active":"2023-06-23T18:44:50.656193+0000","last_became_peered":"2023-06-23T18:44:50.656193+0000","last_unstale":"2023-06-23T18:44:51.655061+0000","last_undegraded":"2023-06-23T18:44:51.655061+0000","last_fullsized":"2023-06-23T18:44:51.655061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:46:59.173048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083323+0000","last_change":"2023-06-23T18:44:50.668275+0000","last_active":"2023-06-23T18:44:53.083323+0000","last_peered":"2023-06-23T18:44:53.083323+0000","last_clean":"2023-06-23T18:44:53.083323+0000","last_became_active":"2023-06-23T18:44:50.667755+0000","last_became_peered":"2023-06-23T18:44:50.667755+0000","last_unstale":"2023-06-23T18:44:53.083323+0000","last_undegraded":"2023-06-23T18:44:53.083323+0000","last_fullsized":"2023-06-23T18:44:53.083323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:27:54.238055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.497838+0000","last_change":"2023-06-23T18:44:50.671148+0000","last_active":"2023-06-23T18:44:52.497838+0000","last_peered":"2023-06-23T18:44:52.497838+0000","last_clean":"2023-06-23T18:44:52.497838+0000","last_became_active":"2023-06-23T18:44:50.667939+0000","last_became_peered":"2023-06-23T18:44:50.667939+0000","last_unstale":"2023-06-23T18:44:52.497838+0000","last_undegraded":"2023-06-23T18:44:52.497838+0000","last_fullsized":"2023-06-23T18:44:52.497838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:27:54.238055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083932+0000","last_change":"2023-06-23T18:44:50.675550+0000","last_active":"2023-06-23T18:44:53.083932+0000","last_peered":"2023-06-23T18:44:53.083932+0000","last_clean":"2023-06-23T18:44:53.083932+0000","last_became_active":"2023-06-23T18:44:50.674409+0000","last_became_peered":"2023-06-23T18:44:50.674409+0000","last_unstale":"2023-06-23T18:44:53.083932+0000","last_undegraded":"2023-06-23T18:44:53.083932+0000","last_fullsized":"2023-06-23T18:44:53.083932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:48:26.644150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650600+0000","last_change":"2023-06-23T18:44:50.672283+0000","last_active":"2023-06-23T18:44:51.650600+0000","last_peered":"2023-06-23T18:44:51.650600+0000","last_clean":"2023-06-23T18:44:51.650600+0000","last_became_active":"2023-06-23T18:44:50.672102+0000","last_became_peered":"2023-06-23T18:44:50.672102+0000","last_unstale":"2023-06-23T18:44:51.650600+0000","last_undegraded":"2023-06-23T18:44:51.650600+0000","last_fullsized":"2023-06-23T18:44:51.650600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:57:46.437032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":839680,"data_stored":671247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":79099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":669467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":79681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4179999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.488}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.577}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.516}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":78138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":80719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":225280,"data_stored":79751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T18:44:59.593 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T18:44:59.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.748+0000 7f63896de700 1 Processor -- start 2023-06-23T18:44:59.753 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.748+0000 7f63896de700 1 -- start start 2023-06-23T18:44:59.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.749+0000 7f63896de700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f63841444a0 0x7f63840b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:59.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.749+0000 7f63896de700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63840b5a20 0x7f6384154da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:59.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.749+0000 7f63896de700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63840b7aa0 con 0x7f638406a0d0 2023-06-23T18:44:59.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.749+0000 7f63896de700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63840bcfc0 con 0x7f63841444a0 2023-06-23T18:44:59.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.749+0000 7f63896de700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63840b5f30 con 0x7f63840b5a20 2023-06-23T18:44:59.755 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.749+0000 7f63827fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f63841444a0 0x7f63840b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:59.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.749+0000 7f63827fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f63841444a0 0x7f63840b54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52260/0 (socket says 172.21.15.52:52260) 2023-06-23T18:44:59.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.749+0000 7f63827fc700 1 -- 172.21.15.52:0/2177416555 learned_addr learned my addr 172.21.15.52:0/2177416555 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:59.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.749+0000 7f63837fe700 1 --2- 172.21.15.52:0/2177416555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63840b5a20 0x7f6384154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:59.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.749+0000 7f63827fc700 1 -- 172.21.15.52:0/2177416555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63840b5a20 msgr2=0x7f6384154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:44:59.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.749+0000 7f63827fc700 1 --2- 172.21.15.52:0/2177416555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63840b5a20 0x7f6384154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.756 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.749+0000 7f63827fc700 1 -- 172.21.15.52:0/2177416555 >> v1:172.21.15.89:6789/0 conn(0x7f638406a0d0 legacy=0x7f63840bc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.749+0000 7f63827fc700 1 -- 172.21.15.52:0/2177416555 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63840b6210 con 0x7f63841444a0 2023-06-23T18:44:59.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.749+0000 7f63827fc700 1 --2- 172.21.15.52:0/2177416555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63841444a0 0x7f63840b54e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f63780098f0 tx=0x7f6378009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307c575fa4a7d523 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:59.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.749+0000 7f6381ffb700 1 -- 172.21.15.52:0/2177416555 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6378011830 con 0x7f63841444a0 2023-06-23T18:44:59.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.749+0000 7f6381ffb700 1 -- 172.21.15.52:0/2177416555 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6378011990 con 0x7f63841444a0 2023-06-23T18:44:59.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.749+0000 7f6381ffb700 1 -- 172.21.15.52:0/2177416555 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6378011d20 con 0x7f63841444a0 2023-06-23T18:44:59.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.750+0000 7f63896de700 1 -- 172.21.15.52:0/2177416555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63841444a0 msgr2=0x7f63840b54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.757 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.750+0000 7f63896de700 1 --2- 172.21.15.52:0/2177416555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63841444a0 0x7f63840b54e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f63780098f0 tx=0x7f6378009c00 comp rx=0 tx=0).stop 2023-06-23T18:44:59.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.750+0000 7f63896de700 1 -- 172.21.15.52:0/2177416555 shutdown_connections 2023-06-23T18:44:59.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.750+0000 7f63896de700 1 --2- 172.21.15.52:0/2177416555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63840b5a20 0x7f6384154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.750+0000 7f63896de700 1 --2- 172.21.15.52:0/2177416555 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63841444a0 0x7f63840b54e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.750+0000 7f63896de700 1 -- 172.21.15.52:0/2177416555 >> 172.21.15.52:0/2177416555 conn(0x7f638406bb90 msgr2=0x7f638406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:59.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.750+0000 7f63896de700 1 -- 172.21.15.52:0/2177416555 shutdown_connections 2023-06-23T18:44:59.758 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.750+0000 7f63896de700 1 -- 172.21.15.52:0/2177416555 wait complete. 2023-06-23T18:44:59.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.752+0000 7f63896de700 1 Processor -- start 2023-06-23T18:44:59.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.752+0000 7f63896de700 1 -- start start 2023-06-23T18:44:59.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.752+0000 7f63896de700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f638406a0d0 0x7f63841e0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:59.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.753+0000 7f63896de700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63840b5a20 0x7f6384146ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:59.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.753+0000 7f63896de700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63841444a0 0x7f638413d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:59.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.753+0000 7f63896de700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63840b9650 con 0x7f63841444a0 2023-06-23T18:44:59.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.753+0000 7f63896de700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63841e0fa0 con 0x7f638406a0d0 2023-06-23T18:44:59.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.753+0000 7f63896de700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63841d0610 con 0x7f63840b5a20 2023-06-23T18:44:59.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.753+0000 7f63837fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63841444a0 0x7f638413d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:59.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.753+0000 7f63837fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63841444a0 0x7f638413d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52266/0 (socket says 172.21.15.52:52266) 2023-06-23T18:44:59.762 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.753+0000 7f63837fe700 1 -- 172.21.15.52:0/2752893111 learned_addr learned my addr 172.21.15.52:0/2752893111 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:44:59.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.753+0000 7f63827fc700 1 --2- 172.21.15.52:0/2752893111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63840b5a20 0x7f6384146ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:59.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.753+0000 7f6382ffd700 1 --2- 172.21.15.52:0/2752893111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f638406a0d0 0x7f63841e0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:59.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.753+0000 7f63837fe700 1 -- 172.21.15.52:0/2752893111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63840b5a20 msgr2=0x7f6384146ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.753+0000 7f63837fe700 1 --2- 172.21.15.52:0/2752893111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63840b5a20 0x7f6384146ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.753+0000 7f63837fe700 1 -- 172.21.15.52:0/2752893111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f638406a0d0 msgr2=0x7f63841e0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.753+0000 7f63837fe700 1 --2- 172.21.15.52:0/2752893111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f638406a0d0 0x7f63841e0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.753+0000 7f63837fe700 1 -- 172.21.15.52:0/2752893111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6378009550 con 0x7f63841444a0 2023-06-23T18:44:59.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.753+0000 7f63837fe700 1 --2- 172.21.15.52:0/2752893111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63841444a0 0x7f638413d430 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f637c009e30 tx=0x7f637c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:59.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.753+0000 7f636b7fe700 1 -- 172.21.15.52:0/2752893111 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c009ca0 con 0x7f63841444a0 2023-06-23T18:44:59.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.753+0000 7f636b7fe700 1 -- 172.21.15.52:0/2752893111 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637c00f040 con 0x7f63841444a0 2023-06-23T18:44:59.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.753+0000 7f63896de700 1 -- 172.21.15.52:0/2752893111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63841470e0 con 0x7f63841444a0 2023-06-23T18:44:59.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.753+0000 7f636b7fe700 1 -- 172.21.15.52:0/2752893111 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c014480 con 0x7f63841444a0 2023-06-23T18:44:59.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.753+0000 7f63896de700 1 -- 172.21.15.52:0/2752893111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63841e0950 con 0x7f63841444a0 2023-06-23T18:44:59.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.754+0000 7f63896de700 1 -- 172.21.15.52:0/2752893111 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6384144ef0 con 0x7f63841444a0 2023-06-23T18:44:59.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.755+0000 7f636b7fe700 1 -- 172.21.15.52:0/2752893111 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f637c0145e0 con 0x7f63841444a0 2023-06-23T18:44:59.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.755+0000 7f636b7fe700 1 --2- 172.21.15.52:0/2752893111 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f637006ace0 0x7f637006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:44:59.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.755+0000 7f636b7fe700 1 -- 172.21.15.52:0/2752893111 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f637c08a090 con 0x7f63841444a0 2023-06-23T18:44:59.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.755+0000 7f6382ffd700 1 --2- 172.21.15.52:0/2752893111 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f637006ace0 0x7f637006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:44:59.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.756+0000 7f6382ffd700 1 --2- 172.21.15.52:0/2752893111 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f637006ace0 0x7f637006d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6374007fd0 tx=0x7f6374009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:44:59.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.760+0000 7f636b7fe700 1 -- 172.21.15.52:0/2752893111 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6384144ef0 con 0x7f63841444a0 2023-06-23T18:44:59.955 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.951+0000 7f63896de700 1 -- 172.21.15.52:0/2752893111 --> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f63840b64f0 con 0x7f637006ace0 2023-06-23T18:44:59.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.959+0000 7f636b7fe700 1 -- 172.21.15.52:0/2752893111 <== mgr.4106 v2:172.21.15.89:6832/397406548 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286851 (secure 0 0 0) 0x7f6374001560 con 0x7f637006ace0 2023-06-23T18:44:59.967 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:44:59.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.962+0000 7f63896de700 1 -- 172.21.15.52:0/2752893111 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f637006ace0 msgr2=0x7f637006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.962+0000 7f63896de700 1 --2- 172.21.15.52:0/2752893111 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f637006ace0 0x7f637006d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6374007fd0 tx=0x7f6374009040 comp rx=0 tx=0).stop 2023-06-23T18:44:59.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.962+0000 7f63896de700 1 -- 172.21.15.52:0/2752893111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63841444a0 msgr2=0x7f638413d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:44:59.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.962+0000 7f63896de700 1 --2- 172.21.15.52:0/2752893111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63841444a0 0x7f638413d430 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f637c009e30 tx=0x7f637c00c3a0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.962+0000 7f63896de700 1 -- 172.21.15.52:0/2752893111 shutdown_connections 2023-06-23T18:44:59.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.962+0000 7f63896de700 1 --2- 172.21.15.52:0/2752893111 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f637006ace0 0x7f637006d190 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.962+0000 7f63896de700 1 --2- 172.21.15.52:0/2752893111 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63841444a0 0x7f638413d430 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.962+0000 7f63896de700 1 --2- 172.21.15.52:0/2752893111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f638406a0d0 0x7f63841e0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.962+0000 7f63896de700 1 --2- 172.21.15.52:0/2752893111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f63840b5a20 0x7f6384146ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:44:59.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.962+0000 7f63896de700 1 -- 172.21.15.52:0/2752893111 >> 172.21.15.52:0/2752893111 conn(0x7f638406bb90 msgr2=0x7f63841481b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:44:59.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.962+0000 7f63896de700 1 -- 172.21.15.52:0/2752893111 shutdown_connections 2023-06-23T18:44:59.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:44:59.962+0000 7f63896de700 1 -- 172.21.15.52:0/2752893111 wait complete. 2023-06-23T18:44:59.970 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-06-23T18:44:59.979 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-06-23T18:44:59.778022+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218532,"kb_used_data":2916,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756188,"statfs":{"total":773094113280,"available":772870336512,"internally_reserved":0,"allocated":2985984,"data_stored":1817291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.130489"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083789+0000","last_change":"2023-06-23T18:44:50.669535+0000","last_active":"2023-06-23T18:44:53.083789+0000","last_peered":"2023-06-23T18:44:53.083789+0000","last_clean":"2023-06-23T18:44:53.083789+0000","last_became_active":"2023-06-23T18:44:50.669314+0000","last_became_peered":"2023-06-23T18:44:50.669314+0000","last_unstale":"2023-06-23T18:44:53.083789+0000","last_undegraded":"2023-06-23T18:44:53.083789+0000","last_fullsized":"2023-06-23T18:44:53.083789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:50:32.317342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083758+0000","last_change":"2023-06-23T18:44:50.655548+0000","last_active":"2023-06-23T18:44:53.083758+0000","last_peered":"2023-06-23T18:44:53.083758+0000","last_clean":"2023-06-23T18:44:53.083758+0000","last_became_active":"2023-06-23T18:44:50.655143+0000","last_became_peered":"2023-06-23T18:44:50.655143+0000","last_unstale":"2023-06-23T18:44:53.083758+0000","last_undegraded":"2023-06-23T18:44:53.083758+0000","last_fullsized":"2023-06-23T18:44:53.083758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:23:07.364903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498122+0000","last_change":"2023-06-23T18:44:50.667478+0000","last_active":"2023-06-23T18:44:52.498122+0000","last_peered":"2023-06-23T18:44:52.498122+0000","last_clean":"2023-06-23T18:44:52.498122+0000","last_became_active":"2023-06-23T18:44:50.667142+0000","last_became_peered":"2023-06-23T18:44:50.667142+0000","last_unstale":"2023-06-23T18:44:52.498122+0000","last_undegraded":"2023-06-23T18:44:52.498122+0000","last_fullsized":"2023-06-23T18:44:52.498122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:48:26.644150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655406+0000","last_change":"2023-06-23T18:44:50.663624+0000","last_active":"2023-06-23T18:44:51.655406+0000","last_peered":"2023-06-23T18:44:51.655406+0000","last_clean":"2023-06-23T18:44:51.655406+0000","last_became_active":"2023-06-23T18:44:50.663376+0000","last_became_peered":"2023-06-23T18:44:50.663376+0000","last_unstale":"2023-06-23T18:44:51.655406+0000","last_undegraded":"2023-06-23T18:44:51.655406+0000","last_fullsized":"2023-06-23T18:44:51.655406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:17:28.994298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404393+0000","last_change":"2023-06-23T18:44:50.671557+0000","last_active":"2023-06-23T18:44:52.404393+0000","last_peered":"2023-06-23T18:44:52.404393+0000","last_clean":"2023-06-23T18:44:52.404393+0000","last_became_active":"2023-06-23T18:44:50.671298+0000","last_became_peered":"2023-06-23T18:44:50.671298+0000","last_unstale":"2023-06-23T18:44:52.404393+0000","last_undegraded":"2023-06-23T18:44:52.404393+0000","last_fullsized":"2023-06-23T18:44:52.404393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:06:39.243693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498058+0000","last_change":"2023-06-23T18:44:50.664406+0000","last_active":"2023-06-23T18:44:52.498058+0000","last_peered":"2023-06-23T18:44:52.498058+0000","last_clean":"2023-06-23T18:44:52.498058+0000","last_became_active":"2023-06-23T18:44:50.664144+0000","last_became_peered":"2023-06-23T18:44:50.664144+0000","last_unstale":"2023-06-23T18:44:52.498058+0000","last_undegraded":"2023-06-23T18:44:52.498058+0000","last_fullsized":"2023-06-23T18:44:52.498058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:43:05.880234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006057+0000","last_change":"2023-06-23T18:44:50.669048+0000","last_active":"2023-06-23T18:44:52.006057+0000","last_peered":"2023-06-23T18:44:52.006057+0000","last_clean":"2023-06-23T18:44:52.006057+0000","last_became_active":"2023-06-23T18:44:50.668771+0000","last_became_peered":"2023-06-23T18:44:50.668771+0000","last_unstale":"2023-06-23T18:44:52.006057+0000","last_undegraded":"2023-06-23T18:44:52.006057+0000","last_fullsized":"2023-06-23T18:44:52.006057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:43:05.880234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083512+0000","last_change":"2023-06-23T18:44:50.667476+0000","last_active":"2023-06-23T18:44:53.083512+0000","last_peered":"2023-06-23T18:44:53.083512+0000","last_clean":"2023-06-23T18:44:53.083512+0000","last_became_active":"2023-06-23T18:44:50.667193+0000","last_became_peered":"2023-06-23T18:44:50.667193+0000","last_unstale":"2023-06-23T18:44:53.083512+0000","last_undegraded":"2023-06-23T18:44:53.083512+0000","last_fullsized":"2023-06-23T18:44:53.083512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:57:46.437032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404434+0000","last_change":"2023-06-23T18:44:50.659873+0000","last_active":"2023-06-23T18:44:52.404434+0000","last_peered":"2023-06-23T18:44:52.404434+0000","last_clean":"2023-06-23T18:44:52.404434+0000","last_became_active":"2023-06-23T18:44:50.659596+0000","last_became_peered":"2023-06-23T18:44:50.659596+0000","last_unstale":"2023-06-23T18:44:52.404434+0000","last_undegraded":"2023-06-23T18:44:52.404434+0000","last_fullsized":"2023-06-23T18:44:52.404434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:11:35.546421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083943+0000","last_change":"2023-06-23T18:44:50.662516+0000","last_active":"2023-06-23T18:44:53.083943+0000","last_peered":"2023-06-23T18:44:53.083943+0000","last_clean":"2023-06-23T18:44:53.083943+0000","last_became_active":"2023-06-23T18:44:50.662228+0000","last_became_peered":"2023-06-23T18:44:50.662228+0000","last_unstale":"2023-06-23T18:44:53.083943+0000","last_undegraded":"2023-06-23T18:44:53.083943+0000","last_fullsized":"2023-06-23T18:44:53.083943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:27:54.238055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498265+0000","last_change":"2023-06-23T18:44:50.669567+0000","last_active":"2023-06-23T18:44:52.498265+0000","last_peered":"2023-06-23T18:44:52.498265+0000","last_clean":"2023-06-23T18:44:52.498265+0000","last_became_active":"2023-06-23T18:44:50.667154+0000","last_became_peered":"2023-06-23T18:44:50.667154+0000","last_unstale":"2023-06-23T18:44:52.498265+0000","last_undegraded":"2023-06-23T18:44:52.498265+0000","last_fullsized":"2023-06-23T18:44:52.498265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:34:35.075905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083158+0000","last_change":"2023-06-23T18:44:50.667100+0000","last_active":"2023-06-23T18:44:53.083158+0000","last_peered":"2023-06-23T18:44:53.083158+0000","last_clean":"2023-06-23T18:44:53.083158+0000","last_became_active":"2023-06-23T18:44:50.666768+0000","last_became_peered":"2023-06-23T18:44:50.666768+0000","last_unstale":"2023-06-23T18:44:53.083158+0000","last_undegraded":"2023-06-23T18:44:53.083158+0000","last_fullsized":"2023-06-23T18:44:53.083158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:41:16.719001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083296+0000","last_change":"2023-06-23T18:44:50.670413+0000","last_active":"2023-06-23T18:44:53.083296+0000","last_peered":"2023-06-23T18:44:53.083296+0000","last_clean":"2023-06-23T18:44:53.083296+0000","last_became_active":"2023-06-23T18:44:50.670105+0000","last_became_peered":"2023-06-23T18:44:50.670105+0000","last_unstale":"2023-06-23T18:44:53.083296+0000","last_undegraded":"2023-06-23T18:44:53.083296+0000","last_fullsized":"2023-06-23T18:44:53.083296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:51:27.271916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083805+0000","last_change":"2023-06-23T18:44:50.655737+0000","last_active":"2023-06-23T18:44:53.083805+0000","last_peered":"2023-06-23T18:44:53.083805+0000","last_clean":"2023-06-23T18:44:53.083805+0000","last_became_active":"2023-06-23T18:44:50.655253+0000","last_became_peered":"2023-06-23T18:44:50.655253+0000","last_unstale":"2023-06-23T18:44:53.083805+0000","last_undegraded":"2023-06-23T18:44:53.083805+0000","last_fullsized":"2023-06-23T18:44:53.083805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:53:28.521694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006225+0000","last_change":"2023-06-23T18:44:50.669573+0000","last_active":"2023-06-23T18:44:52.006225+0000","last_peered":"2023-06-23T18:44:52.006225+0000","last_clean":"2023-06-23T18:44:52.006225+0000","last_became_active":"2023-06-23T18:44:50.668886+0000","last_became_peered":"2023-06-23T18:44:50.668886+0000","last_unstale":"2023-06-23T18:44:52.006225+0000","last_undegraded":"2023-06-23T18:44:52.006225+0000","last_fullsized":"2023-06-23T18:44:52.006225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:00:29.622659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.497857+0000","last_change":"2023-06-23T18:44:50.664890+0000","last_active":"2023-06-23T18:44:52.497857+0000","last_peered":"2023-06-23T18:44:52.497857+0000","last_clean":"2023-06-23T18:44:52.497857+0000","last_became_active":"2023-06-23T18:44:50.664571+0000","last_became_peered":"2023-06-23T18:44:50.664571+0000","last_unstale":"2023-06-23T18:44:52.497857+0000","last_undegraded":"2023-06-23T18:44:52.497857+0000","last_fullsized":"2023-06-23T18:44:52.497857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:24:20.739761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404406+0000","last_change":"2023-06-23T18:44:50.672231+0000","last_active":"2023-06-23T18:44:52.404406+0000","last_peered":"2023-06-23T18:44:52.404406+0000","last_clean":"2023-06-23T18:44:52.404406+0000","last_became_active":"2023-06-23T18:44:50.671979+0000","last_became_peered":"2023-06-23T18:44:50.671979+0000","last_unstale":"2023-06-23T18:44:52.404406+0000","last_undegraded":"2023-06-23T18:44:52.404406+0000","last_fullsized":"2023-06-23T18:44:52.404406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:53:28.521694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498218+0000","last_change":"2023-06-23T18:44:50.667846+0000","last_active":"2023-06-23T18:44:52.498218+0000","last_peered":"2023-06-23T18:44:52.498218+0000","last_clean":"2023-06-23T18:44:52.498218+0000","last_became_active":"2023-06-23T18:44:50.667545+0000","last_became_peered":"2023-06-23T18:44:50.667545+0000","last_unstale":"2023-06-23T18:44:52.498218+0000","last_undegraded":"2023-06-23T18:44:52.498218+0000","last_fullsized":"2023-06-23T18:44:52.498218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:59:07.537499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083734+0000","last_change":"2023-06-23T18:44:50.662459+0000","last_active":"2023-06-23T18:44:53.083734+0000","last_peered":"2023-06-23T18:44:53.083734+0000","last_clean":"2023-06-23T18:44:53.083734+0000","last_became_active":"2023-06-23T18:44:50.662128+0000","last_became_peered":"2023-06-23T18:44:50.662128+0000","last_unstale":"2023-06-23T18:44:53.083734+0000","last_undegraded":"2023-06-23T18:44:53.083734+0000","last_fullsized":"2023-06-23T18:44:53.083734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:20:59.100212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498229+0000","last_change":"2023-06-23T18:44:50.670686+0000","last_active":"2023-06-23T18:44:52.498229+0000","last_peered":"2023-06-23T18:44:52.498229+0000","last_clean":"2023-06-23T18:44:52.498229+0000","last_became_active":"2023-06-23T18:44:50.670397+0000","last_became_peered":"2023-06-23T18:44:50.670397+0000","last_unstale":"2023-06-23T18:44:52.498229+0000","last_undegraded":"2023-06-23T18:44:52.498229+0000","last_fullsized":"2023-06-23T18:44:52.498229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:29:44.651970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006353+0000","last_change":"2023-06-23T18:44:50.676320+0000","last_active":"2023-06-23T18:44:52.006353+0000","last_peered":"2023-06-23T18:44:52.006353+0000","last_clean":"2023-06-23T18:44:52.006353+0000","last_became_active":"2023-06-23T18:44:50.676054+0000","last_became_peered":"2023-06-23T18:44:50.676054+0000","last_unstale":"2023-06-23T18:44:52.006353+0000","last_undegraded":"2023-06-23T18:44:52.006353+0000","last_fullsized":"2023-06-23T18:44:52.006353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:59:07.537499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404037+0000","last_change":"2023-06-23T18:44:50.663287+0000","last_active":"2023-06-23T18:44:52.404037+0000","last_peered":"2023-06-23T18:44:52.404037+0000","last_clean":"2023-06-23T18:44:52.404037+0000","last_became_active":"2023-06-23T18:44:50.663006+0000","last_became_peered":"2023-06-23T18:44:50.663006+0000","last_unstale":"2023-06-23T18:44:52.404037+0000","last_undegraded":"2023-06-23T18:44:52.404037+0000","last_fullsized":"2023-06-23T18:44:52.404037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:17:28.994298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083234+0000","last_change":"2023-06-23T18:44:50.668418+0000","last_active":"2023-06-23T18:44:53.083234+0000","last_peered":"2023-06-23T18:44:53.083234+0000","last_clean":"2023-06-23T18:44:53.083234+0000","last_became_active":"2023-06-23T18:44:50.668029+0000","last_became_peered":"2023-06-23T18:44:50.668029+0000","last_unstale":"2023-06-23T18:44:53.083234+0000","last_undegraded":"2023-06-23T18:44:53.083234+0000","last_fullsized":"2023-06-23T18:44:53.083234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:11:35.546421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006017+0000","last_change":"2023-06-23T18:44:50.675363+0000","last_active":"2023-06-23T18:44:52.006017+0000","last_peered":"2023-06-23T18:44:52.006017+0000","last_clean":"2023-06-23T18:44:52.006017+0000","last_became_active":"2023-06-23T18:44:50.675099+0000","last_became_peered":"2023-06-23T18:44:50.675099+0000","last_unstale":"2023-06-23T18:44:52.006017+0000","last_undegraded":"2023-06-23T18:44:52.006017+0000","last_fullsized":"2023-06-23T18:44:52.006017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:24:00.797602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650898+0000","last_change":"2023-06-23T18:44:50.662603+0000","last_active":"2023-06-23T18:44:51.650898+0000","last_peered":"2023-06-23T18:44:51.650898+0000","last_clean":"2023-06-23T18:44:51.650898+0000","last_became_active":"2023-06-23T18:44:50.662318+0000","last_became_peered":"2023-06-23T18:44:50.662318+0000","last_unstale":"2023-06-23T18:44:51.650898+0000","last_undegraded":"2023-06-23T18:44:51.650898+0000","last_fullsized":"2023-06-23T18:44:51.650898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:23:07.364903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650929+0000","last_change":"2023-06-23T18:44:50.655943+0000","last_active":"2023-06-23T18:44:51.650929+0000","last_peered":"2023-06-23T18:44:51.650929+0000","last_clean":"2023-06-23T18:44:51.650929+0000","last_became_active":"2023-06-23T18:44:50.655672+0000","last_became_peered":"2023-06-23T18:44:50.655672+0000","last_unstale":"2023-06-23T18:44:51.650929+0000","last_undegraded":"2023-06-23T18:44:51.650929+0000","last_fullsized":"2023-06-23T18:44:51.650929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:53:28.521694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083680+0000","last_change":"2023-06-23T18:44:50.670220+0000","last_active":"2023-06-23T18:44:53.083680+0000","last_peered":"2023-06-23T18:44:53.083680+0000","last_clean":"2023-06-23T18:44:53.083680+0000","last_became_active":"2023-06-23T18:44:50.669773+0000","last_became_peered":"2023-06-23T18:44:50.669773+0000","last_unstale":"2023-06-23T18:44:53.083680+0000","last_undegraded":"2023-06-23T18:44:53.083680+0000","last_fullsized":"2023-06-23T18:44:53.083680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:26:23.851192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498027+0000","last_change":"2023-06-23T18:44:50.246485+0000","last_active":"2023-06-23T18:44:52.498027+0000","last_peered":"2023-06-23T18:44:52.498027+0000","last_clean":"2023-06-23T18:44:52.498027+0000","last_became_active":"2023-06-23T18:44:50.246186+0000","last_became_peered":"2023-06-23T18:44:50.246186+0000","last_unstale":"2023-06-23T18:44:52.498027+0000","last_undegraded":"2023-06-23T18:44:52.498027+0000","last_fullsized":"2023-06-23T18:44:52.498027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:00:28.617628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083532+0000","last_change":"2023-06-23T18:44:50.665653+0000","last_active":"2023-06-23T18:44:53.083532+0000","last_peered":"2023-06-23T18:44:53.083532+0000","last_clean":"2023-06-23T18:44:53.083532+0000","last_became_active":"2023-06-23T18:44:50.665383+0000","last_became_peered":"2023-06-23T18:44:50.665383+0000","last_unstale":"2023-06-23T18:44:53.083532+0000","last_undegraded":"2023-06-23T18:44:53.083532+0000","last_fullsized":"2023-06-23T18:44:53.083532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:24:20.739761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650418+0000","last_change":"2023-06-23T18:44:50.244604+0000","last_active":"2023-06-23T18:44:51.650418+0000","last_peered":"2023-06-23T18:44:51.650418+0000","last_clean":"2023-06-23T18:44:51.650418+0000","last_became_active":"2023-06-23T18:44:50.244307+0000","last_became_peered":"2023-06-23T18:44:50.244307+0000","last_unstale":"2023-06-23T18:44:51.650418+0000","last_undegraded":"2023-06-23T18:44:51.650418+0000","last_fullsized":"2023-06-23T18:44:51.650418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:04:47.082248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404529+0000","last_change":"2023-06-23T18:44:50.674014+0000","last_active":"2023-06-23T18:44:52.404529+0000","last_peered":"2023-06-23T18:44:52.404529+0000","last_clean":"2023-06-23T18:44:52.404529+0000","last_became_active":"2023-06-23T18:44:50.673751+0000","last_became_peered":"2023-06-23T18:44:50.673751+0000","last_unstale":"2023-06-23T18:44:52.404529+0000","last_undegraded":"2023-06-23T18:44:52.404529+0000","last_fullsized":"2023-06-23T18:44:52.404529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:24:00.797602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083215+0000","last_change":"2023-06-23T18:44:50.241541+0000","last_active":"2023-06-23T18:44:53.083215+0000","last_peered":"2023-06-23T18:44:53.083215+0000","last_clean":"2023-06-23T18:44:53.083215+0000","last_became_active":"2023-06-23T18:44:50.241250+0000","last_became_peered":"2023-06-23T18:44:50.241250+0000","last_unstale":"2023-06-23T18:44:53.083215+0000","last_undegraded":"2023-06-23T18:44:53.083215+0000","last_fullsized":"2023-06-23T18:44:53.083215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:53:27.516664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655460+0000","last_change":"2023-06-23T18:44:50.665987+0000","last_active":"2023-06-23T18:44:51.655460+0000","last_peered":"2023-06-23T18:44:51.655460+0000","last_clean":"2023-06-23T18:44:51.655460+0000","last_became_active":"2023-06-23T18:44:50.665705+0000","last_became_peered":"2023-06-23T18:44:50.665705+0000","last_unstale":"2023-06-23T18:44:51.655460+0000","last_undegraded":"2023-06-23T18:44:51.655460+0000","last_fullsized":"2023-06-23T18:44:51.655460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:26:23.851192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404593+0000","last_change":"2023-06-23T18:44:50.240166+0000","last_active":"2023-06-23T18:44:52.404593+0000","last_peered":"2023-06-23T18:44:52.404593+0000","last_clean":"2023-06-23T18:44:52.404593+0000","last_became_active":"2023-06-23T18:44:50.239596+0000","last_became_peered":"2023-06-23T18:44:50.239596+0000","last_unstale":"2023-06-23T18:44:52.404593+0000","last_undegraded":"2023-06-23T18:44:52.404593+0000","last_fullsized":"2023-06-23T18:44:52.404593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:43:04.875204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083177+0000","last_change":"2023-06-23T18:44:50.663993+0000","last_active":"2023-06-23T18:44:53.083177+0000","last_peered":"2023-06-23T18:44:53.083177+0000","last_clean":"2023-06-23T18:44:53.083177+0000","last_became_active":"2023-06-23T18:44:50.663754+0000","last_became_peered":"2023-06-23T18:44:50.663754+0000","last_unstale":"2023-06-23T18:44:53.083177+0000","last_undegraded":"2023-06-23T18:44:53.083177+0000","last_fullsized":"2023-06-23T18:44:53.083177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:06:39.243693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083757+0000","last_change":"2023-06-23T18:44:50.244382+0000","last_active":"2023-06-23T18:44:53.083757+0000","last_peered":"2023-06-23T18:44:53.083757+0000","last_clean":"2023-06-23T18:44:53.083757+0000","last_became_active":"2023-06-23T18:44:50.244129+0000","last_became_peered":"2023-06-23T18:44:50.244129+0000","last_unstale":"2023-06-23T18:44:53.083757+0000","last_undegraded":"2023-06-23T18:44:53.083757+0000","last_fullsized":"2023-06-23T18:44:53.083757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:09:26.749689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083543+0000","last_change":"2023-06-23T18:44:50.670667+0000","last_active":"2023-06-23T18:44:53.083543+0000","last_peered":"2023-06-23T18:44:53.083543+0000","last_clean":"2023-06-23T18:44:53.083543+0000","last_became_active":"2023-06-23T18:44:50.670402+0000","last_became_peered":"2023-06-23T18:44:50.670402+0000","last_unstale":"2023-06-23T18:44:53.083543+0000","last_undegraded":"2023-06-23T18:44:53.083543+0000","last_fullsized":"2023-06-23T18:44:53.083543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:30:37.852223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006302+0000","last_change":"2023-06-23T18:44:50.249346+0000","last_active":"2023-06-23T18:44:52.006302+0000","last_peered":"2023-06-23T18:44:52.006302+0000","last_clean":"2023-06-23T18:44:52.006302+0000","last_became_active":"2023-06-23T18:44:50.249071+0000","last_became_peered":"2023-06-23T18:44:50.249071+0000","last_unstale":"2023-06-23T18:44:52.006302+0000","last_undegraded":"2023-06-23T18:44:52.006302+0000","last_fullsized":"2023-06-23T18:44:52.006302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:48:25.639120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650607+0000","last_change":"2023-06-23T18:44:50.663115+0000","last_active":"2023-06-23T18:44:51.650607+0000","last_peered":"2023-06-23T18:44:51.650607+0000","last_clean":"2023-06-23T18:44:51.650607+0000","last_became_active":"2023-06-23T18:44:50.662843+0000","last_became_peered":"2023-06-23T18:44:50.662843+0000","last_unstale":"2023-06-23T18:44:51.650607+0000","last_undegraded":"2023-06-23T18:44:51.650607+0000","last_fullsized":"2023-06-23T18:44:51.650607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:17:28.994298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498336+0000","last_change":"2023-06-23T18:44:50.247158+0000","last_active":"2023-06-23T18:44:52.498336+0000","last_peered":"2023-06-23T18:44:52.498336+0000","last_clean":"2023-06-23T18:44:52.498336+0000","last_became_active":"2023-06-23T18:44:50.246857+0000","last_became_peered":"2023-06-23T18:44:50.246857+0000","last_unstale":"2023-06-23T18:44:52.498336+0000","last_undegraded":"2023-06-23T18:44:52.498336+0000","last_fullsized":"2023-06-23T18:44:52.498336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:04:29.395928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498272+0000","last_change":"2023-06-23T18:44:50.667952+0000","last_active":"2023-06-23T18:44:52.498272+0000","last_peered":"2023-06-23T18:44:52.498272+0000","last_clean":"2023-06-23T18:44:52.498272+0000","last_became_active":"2023-06-23T18:44:50.667653+0000","last_became_peered":"2023-06-23T18:44:50.667653+0000","last_unstale":"2023-06-23T18:44:52.498272+0000","last_undegraded":"2023-06-23T18:44:52.498272+0000","last_fullsized":"2023-06-23T18:44:52.498272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:17:33.321718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006119+0000","last_change":"2023-06-23T18:44:50.248101+0000","last_active":"2023-06-23T18:44:52.006119+0000","last_peered":"2023-06-23T18:44:52.006119+0000","last_clean":"2023-06-23T18:44:52.006119+0000","last_became_active":"2023-06-23T18:44:50.247805+0000","last_became_peered":"2023-06-23T18:44:50.247805+0000","last_unstale":"2023-06-23T18:44:52.006119+0000","last_undegraded":"2023-06-23T18:44:52.006119+0000","last_fullsized":"2023-06-23T18:44:52.006119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:24:19.734731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083396+0000","last_change":"2023-06-23T18:44:50.667698+0000","last_active":"2023-06-23T18:44:53.083396+0000","last_peered":"2023-06-23T18:44:53.083396+0000","last_clean":"2023-06-23T18:44:53.083396+0000","last_became_active":"2023-06-23T18:44:50.667423+0000","last_became_peered":"2023-06-23T18:44:50.667423+0000","last_unstale":"2023-06-23T18:44:53.083396+0000","last_undegraded":"2023-06-23T18:44:53.083396+0000","last_fullsized":"2023-06-23T18:44:53.083396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:00:29.622659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404201+0000","last_change":"2023-06-23T18:44:50.247136+0000","last_active":"2023-06-23T18:44:52.404201+0000","last_peered":"2023-06-23T18:44:52.404201+0000","last_clean":"2023-06-23T18:44:52.404201+0000","last_became_active":"2023-06-23T18:44:50.246862+0000","last_became_peered":"2023-06-23T18:44:50.246862+0000","last_unstale":"2023-06-23T18:44:52.404201+0000","last_undegraded":"2023-06-23T18:44:52.404201+0000","last_fullsized":"2023-06-23T18:44:52.404201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:33:31.904138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083823+0000","last_change":"2023-06-23T18:44:50.670045+0000","last_active":"2023-06-23T18:44:53.083823+0000","last_peered":"2023-06-23T18:44:53.083823+0000","last_clean":"2023-06-23T18:44:53.083823+0000","last_became_active":"2023-06-23T18:44:50.669434+0000","last_became_peered":"2023-06-23T18:44:50.669434+0000","last_unstale":"2023-06-23T18:44:53.083823+0000","last_undegraded":"2023-06-23T18:44:53.083823+0000","last_fullsized":"2023-06-23T18:44:53.083823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:11:35.546421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006195+0000","last_change":"2023-06-23T18:44:50.248720+0000","last_active":"2023-06-23T18:44:52.006195+0000","last_peered":"2023-06-23T18:44:52.006195+0000","last_clean":"2023-06-23T18:44:52.006195+0000","last_became_active":"2023-06-23T18:44:50.248413+0000","last_became_peered":"2023-06-23T18:44:50.248413+0000","last_unstale":"2023-06-23T18:44:52.006195+0000","last_undegraded":"2023-06-23T18:44:52.006195+0000","last_fullsized":"2023-06-23T18:44:52.006195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:29:43.646940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404302+0000","last_change":"2023-06-23T18:44:50.670389+0000","last_active":"2023-06-23T18:44:52.404302+0000","last_peered":"2023-06-23T18:44:52.404302+0000","last_clean":"2023-06-23T18:44:52.404302+0000","last_became_active":"2023-06-23T18:44:50.670097+0000","last_became_peered":"2023-06-23T18:44:50.670097+0000","last_unstale":"2023-06-23T18:44:52.404302+0000","last_undegraded":"2023-06-23T18:44:52.404302+0000","last_fullsized":"2023-06-23T18:44:52.404302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:09:27.754720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.654985+0000","last_change":"2023-06-23T18:44:50.248018+0000","last_active":"2023-06-23T18:44:51.654985+0000","last_peered":"2023-06-23T18:44:51.654985+0000","last_clean":"2023-06-23T18:44:51.654985+0000","last_became_active":"2023-06-23T18:44:50.247728+0000","last_became_peered":"2023-06-23T18:44:50.247728+0000","last_unstale":"2023-06-23T18:44:51.654985+0000","last_undegraded":"2023-06-23T18:44:51.654985+0000","last_fullsized":"2023-06-23T18:44:51.654985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:26:27.403377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.084085+0000","last_change":"2023-06-23T18:44:50.671378+0000","last_active":"2023-06-23T18:44:53.084085+0000","last_peered":"2023-06-23T18:44:53.084085+0000","last_clean":"2023-06-23T18:44:53.084085+0000","last_became_active":"2023-06-23T18:44:50.671070+0000","last_became_peered":"2023-06-23T18:44:50.671070+0000","last_unstale":"2023-06-23T18:44:53.084085+0000","last_undegraded":"2023-06-23T18:44:53.084085+0000","last_fullsized":"2023-06-23T18:44:53.084085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:59:07.537499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006489+0000","last_change":"2023-06-23T18:44:50.248058+0000","last_active":"2023-06-23T18:44:52.006489+0000","last_peered":"2023-06-23T18:44:52.006489+0000","last_clean":"2023-06-23T18:44:52.006489+0000","last_became_active":"2023-06-23T18:44:50.247761+0000","last_became_peered":"2023-06-23T18:44:50.247761+0000","last_unstale":"2023-06-23T18:44:52.006489+0000","last_undegraded":"2023-06-23T18:44:52.006489+0000","last_fullsized":"2023-06-23T18:44:52.006489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:51:58.116537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083517+0000","last_change":"2023-06-23T18:44:50.669693+0000","last_active":"2023-06-23T18:44:53.083517+0000","last_peered":"2023-06-23T18:44:53.083517+0000","last_clean":"2023-06-23T18:44:53.083517+0000","last_became_active":"2023-06-23T18:44:50.669380+0000","last_became_peered":"2023-06-23T18:44:50.669380+0000","last_unstale":"2023-06-23T18:44:53.083517+0000","last_undegraded":"2023-06-23T18:44:53.083517+0000","last_fullsized":"2023-06-23T18:44:53.083517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:17:28.994298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006321+0000","last_change":"2023-06-23T18:44:50.248597+0000","last_active":"2023-06-23T18:44:52.006321+0000","last_peered":"2023-06-23T18:44:52.006321+0000","last_clean":"2023-06-23T18:44:52.006321+0000","last_became_active":"2023-06-23T18:44:50.248309+0000","last_became_peered":"2023-06-23T18:44:50.248309+0000","last_unstale":"2023-06-23T18:44:52.006321+0000","last_undegraded":"2023-06-23T18:44:52.006321+0000","last_fullsized":"2023-06-23T18:44:52.006321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:36:18.947220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.497799+0000","last_change":"2023-06-23T18:44:50.667519+0000","last_active":"2023-06-23T18:44:52.497799+0000","last_peered":"2023-06-23T18:44:52.497799+0000","last_clean":"2023-06-23T18:44:52.497799+0000","last_became_active":"2023-06-23T18:44:50.667042+0000","last_became_peered":"2023-06-23T18:44:50.667042+0000","last_unstale":"2023-06-23T18:44:52.497799+0000","last_undegraded":"2023-06-23T18:44:52.497799+0000","last_fullsized":"2023-06-23T18:44:52.497799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:39:47.275362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006335+0000","last_change":"2023-06-23T18:44:50.247778+0000","last_active":"2023-06-23T18:44:52.006335+0000","last_peered":"2023-06-23T18:44:52.006335+0000","last_clean":"2023-06-23T18:44:52.006335+0000","last_became_active":"2023-06-23T18:44:50.247501+0000","last_became_peered":"2023-06-23T18:44:50.247501+0000","last_unstale":"2023-06-23T18:44:52.006335+0000","last_undegraded":"2023-06-23T18:44:52.006335+0000","last_fullsized":"2023-06-23T18:44:52.006335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:29:14.124932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655300+0000","last_change":"2023-06-23T18:44:50.666494+0000","last_active":"2023-06-23T18:44:51.655300+0000","last_peered":"2023-06-23T18:44:51.655300+0000","last_clean":"2023-06-23T18:44:51.655300+0000","last_became_active":"2023-06-23T18:44:50.666222+0000","last_became_peered":"2023-06-23T18:44:50.666222+0000","last_unstale":"2023-06-23T18:44:51.655300+0000","last_undegraded":"2023-06-23T18:44:51.655300+0000","last_fullsized":"2023-06-23T18:44:51.655300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:01:09.268705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083811+0000","last_change":"2023-06-23T18:44:50.242391+0000","last_active":"2023-06-23T18:44:53.083811+0000","last_peered":"2023-06-23T18:44:53.083811+0000","last_clean":"2023-06-23T18:44:53.083811+0000","last_became_active":"2023-06-23T18:44:50.242109+0000","last_became_peered":"2023-06-23T18:44:50.242109+0000","last_unstale":"2023-06-23T18:44:53.083811+0000","last_undegraded":"2023-06-23T18:44:53.083811+0000","last_fullsized":"2023-06-23T18:44:53.083811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:06:38.238662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404239+0000","last_change":"2023-06-23T18:44:50.663583+0000","last_active":"2023-06-23T18:44:52.404239+0000","last_peered":"2023-06-23T18:44:52.404239+0000","last_clean":"2023-06-23T18:44:52.404239+0000","last_became_active":"2023-06-23T18:44:50.663317+0000","last_became_peered":"2023-06-23T18:44:50.663317+0000","last_unstale":"2023-06-23T18:44:52.404239+0000","last_undegraded":"2023-06-23T18:44:52.404239+0000","last_fullsized":"2023-06-23T18:44:52.404239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:26:23.851192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083882+0000","last_change":"2023-06-23T18:44:50.241365+0000","last_active":"2023-06-23T18:44:53.083882+0000","last_peered":"2023-06-23T18:44:53.083882+0000","last_clean":"2023-06-23T18:44:53.083882+0000","last_became_active":"2023-06-23T18:44:50.241047+0000","last_became_peered":"2023-06-23T18:44:50.241047+0000","last_unstale":"2023-06-23T18:44:53.083882+0000","last_undegraded":"2023-06-23T18:44:53.083882+0000","last_fullsized":"2023-06-23T18:44:53.083882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:36:18.947220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498069+0000","last_change":"2023-06-23T18:44:50.675000+0000","last_active":"2023-06-23T18:44:52.498069+0000","last_peered":"2023-06-23T18:44:52.498069+0000","last_clean":"2023-06-23T18:44:52.498069+0000","last_became_active":"2023-06-23T18:44:50.674723+0000","last_became_peered":"2023-06-23T18:44:50.674723+0000","last_unstale":"2023-06-23T18:44:52.498069+0000","last_undegraded":"2023-06-23T18:44:52.498069+0000","last_fullsized":"2023-06-23T18:44:52.498069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:36:19.952251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655092+0000","last_change":"2023-06-23T18:44:50.247990+0000","last_active":"2023-06-23T18:44:51.655092+0000","last_peered":"2023-06-23T18:44:51.655092+0000","last_clean":"2023-06-23T18:44:51.655092+0000","last_became_active":"2023-06-23T18:44:50.247701+0000","last_became_peered":"2023-06-23T18:44:50.247701+0000","last_unstale":"2023-06-23T18:44:51.655092+0000","last_undegraded":"2023-06-23T18:44:51.655092+0000","last_fullsized":"2023-06-23T18:44:51.655092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:30:47.540693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498444+0000","last_change":"2023-06-23T18:44:50.666801+0000","last_active":"2023-06-23T18:44:52.498444+0000","last_peered":"2023-06-23T18:44:52.498444+0000","last_clean":"2023-06-23T18:44:52.498444+0000","last_became_active":"2023-06-23T18:44:50.666395+0000","last_became_peered":"2023-06-23T18:44:50.666395+0000","last_unstale":"2023-06-23T18:44:52.498444+0000","last_undegraded":"2023-06-23T18:44:52.498444+0000","last_fullsized":"2023-06-23T18:44:52.498444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:50:28.729386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498272+0000","last_change":"2023-06-23T18:44:50.240923+0000","last_active":"2023-06-23T18:44:52.498272+0000","last_peered":"2023-06-23T18:44:52.498272+0000","last_clean":"2023-06-23T18:44:52.498272+0000","last_became_active":"2023-06-23T18:44:50.240629+0000","last_became_peered":"2023-06-23T18:44:50.240629+0000","last_unstale":"2023-06-23T18:44:52.498272+0000","last_undegraded":"2023-06-23T18:44:52.498272+0000","last_fullsized":"2023-06-23T18:44:52.498272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:51:58.116537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498420+0000","last_change":"2023-06-23T18:44:50.669953+0000","last_active":"2023-06-23T18:44:52.498420+0000","last_peered":"2023-06-23T18:44:52.498420+0000","last_clean":"2023-06-23T18:44:52.498420+0000","last_became_active":"2023-06-23T18:44:50.668113+0000","last_became_peered":"2023-06-23T18:44:50.668113+0000","last_unstale":"2023-06-23T18:44:52.498420+0000","last_undegraded":"2023-06-23T18:44:52.498420+0000","last_fullsized":"2023-06-23T18:44:52.498420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:20:58.258094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083089+0000","last_change":"2023-06-23T18:44:50.248367+0000","last_active":"2023-06-23T18:44:53.083089+0000","last_peered":"2023-06-23T18:44:53.083089+0000","last_clean":"2023-06-23T18:44:53.083089+0000","last_became_active":"2023-06-23T18:44:50.248058+0000","last_became_peered":"2023-06-23T18:44:50.248058+0000","last_unstale":"2023-06-23T18:44:53.083089+0000","last_undegraded":"2023-06-23T18:44:53.083089+0000","last_fullsized":"2023-06-23T18:44:53.083089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:23:06.359872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.651039+0000","last_change":"2023-06-23T18:44:50.668275+0000","last_active":"2023-06-23T18:44:51.651039+0000","last_peered":"2023-06-23T18:44:51.651039+0000","last_clean":"2023-06-23T18:44:51.651039+0000","last_became_active":"2023-06-23T18:44:50.668011+0000","last_became_peered":"2023-06-23T18:44:50.668011+0000","last_unstale":"2023-06-23T18:44:51.651039+0000","last_undegraded":"2023-06-23T18:44:51.651039+0000","last_fullsized":"2023-06-23T18:44:51.651039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:11:35.546421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083964+0000","last_change":"2023-06-23T18:44:50.247291+0000","last_active":"2023-06-23T18:44:53.083964+0000","last_peered":"2023-06-23T18:44:53.083964+0000","last_clean":"2023-06-23T18:44:53.083964+0000","last_became_active":"2023-06-23T18:44:50.246993+0000","last_became_peered":"2023-06-23T18:44:50.246993+0000","last_unstale":"2023-06-23T18:44:53.083964+0000","last_undegraded":"2023-06-23T18:44:53.083964+0000","last_fullsized":"2023-06-23T18:44:53.083964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:29:14.124932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498255+0000","last_change":"2023-06-23T18:44:45.192683+0000","last_active":"2023-06-23T18:44:52.498255+0000","last_peered":"2023-06-23T18:44:52.498255+0000","last_clean":"2023-06-23T18:44:52.498255+0000","last_became_active":"2023-06-23T18:44:45.192364+0000","last_became_peered":"2023-06-23T18:44:45.192364+0000","last_unstale":"2023-06-23T18:44:52.498255+0000","last_undegraded":"2023-06-23T18:44:52.498255+0000","last_fullsized":"2023-06-23T18:44:52.498255+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:18:43.258051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083022+0000","last_change":"2023-06-23T18:44:50.669848+0000","last_active":"2023-06-23T18:44:53.083022+0000","last_peered":"2023-06-23T18:44:53.083022+0000","last_clean":"2023-06-23T18:44:53.083022+0000","last_became_active":"2023-06-23T18:44:50.669597+0000","last_became_peered":"2023-06-23T18:44:50.669597+0000","last_unstale":"2023-06-23T18:44:53.083022+0000","last_undegraded":"2023-06-23T18:44:53.083022+0000","last_fullsized":"2023-06-23T18:44:53.083022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:09:27.754720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083471+0000","last_change":"2023-06-23T18:44:45.194010+0000","last_active":"2023-06-23T18:44:53.083471+0000","last_peered":"2023-06-23T18:44:53.083471+0000","last_clean":"2023-06-23T18:44:53.083471+0000","last_became_active":"2023-06-23T18:44:45.193665+0000","last_became_peered":"2023-06-23T18:44:45.193665+0000","last_unstale":"2023-06-23T18:44:53.083471+0000","last_undegraded":"2023-06-23T18:44:53.083471+0000","last_fullsized":"2023-06-23T18:44:53.083471+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:42:59.835944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.832747+0000","last_change":"2023-06-23T18:44:50.248035+0000","last_active":"2023-06-23T18:44:52.832747+0000","last_peered":"2023-06-23T18:44:52.832747+0000","last_clean":"2023-06-23T18:44:52.832747+0000","last_became_active":"2023-06-23T18:44:50.247776+0000","last_became_peered":"2023-06-23T18:44:50.247776+0000","last_unstale":"2023-06-23T18:44:52.832747+0000","last_undegraded":"2023-06-23T18:44:52.832747+0000","last_fullsized":"2023-06-23T18:44:52.832747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:27:53.233025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.497839+0000","last_change":"2023-06-23T18:44:50.665741+0000","last_active":"2023-06-23T18:44:52.497839+0000","last_peered":"2023-06-23T18:44:52.497839+0000","last_clean":"2023-06-23T18:44:52.497839+0000","last_became_active":"2023-06-23T18:44:50.665276+0000","last_became_peered":"2023-06-23T18:44:50.665276+0000","last_unstale":"2023-06-23T18:44:52.497839+0000","last_undegraded":"2023-06-23T18:44:52.497839+0000","last_fullsized":"2023-06-23T18:44:52.497839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:24:00.797602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650429+0000","last_change":"2023-06-23T18:44:45.192024+0000","last_active":"2023-06-23T18:44:51.650429+0000","last_peered":"2023-06-23T18:44:51.650429+0000","last_clean":"2023-06-23T18:44:51.650429+0000","last_became_active":"2023-06-23T18:44:45.191752+0000","last_became_peered":"2023-06-23T18:44:45.191752+0000","last_unstale":"2023-06-23T18:44:51.650429+0000","last_undegraded":"2023-06-23T18:44:51.650429+0000","last_fullsized":"2023-06-23T18:44:51.650429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:01:03.224415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.006092+0000","last_change":"2023-06-23T18:44:45.193018+0000","last_active":"2023-06-23T18:44:52.006092+0000","last_peered":"2023-06-23T18:44:52.006092+0000","last_clean":"2023-06-23T18:44:52.006092+0000","last_became_active":"2023-06-23T18:44:45.192689+0000","last_became_peered":"2023-06-23T18:44:45.192689+0000","last_unstale":"2023-06-23T18:44:52.006092+0000","last_undegraded":"2023-06-23T18:44:52.006092+0000","last_fullsized":"2023-06-23T18:44:52.006092+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:30:31.807933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404052+0000","last_change":"2023-06-23T18:44:50.244324+0000","last_active":"2023-06-23T18:44:52.404052+0000","last_peered":"2023-06-23T18:44:52.404052+0000","last_clean":"2023-06-23T18:44:52.404052+0000","last_became_active":"2023-06-23T18:44:50.242219+0000","last_became_peered":"2023-06-23T18:44:50.242219+0000","last_unstale":"2023-06-23T18:44:52.404052+0000","last_undegraded":"2023-06-23T18:44:52.404052+0000","last_fullsized":"2023-06-23T18:44:52.404052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:57:45.432002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404339+0000","last_change":"2023-06-23T18:44:50.660290+0000","last_active":"2023-06-23T18:44:52.404339+0000","last_peered":"2023-06-23T18:44:52.404339+0000","last_clean":"2023-06-23T18:44:52.404339+0000","last_became_active":"2023-06-23T18:44:50.660095+0000","last_became_peered":"2023-06-23T18:44:50.660095+0000","last_unstale":"2023-06-23T18:44:52.404339+0000","last_undegraded":"2023-06-23T18:44:52.404339+0000","last_fullsized":"2023-06-23T18:44:52.404339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:23:07.364903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.005876+0000","last_change":"2023-06-23T18:44:45.577146+0000","last_active":"2023-06-23T18:44:52.005876+0000","last_peered":"2023-06-23T18:44:52.005876+0000","last_clean":"2023-06-23T18:44:52.005876+0000","last_became_active":"2023-06-23T18:44:45.576835+0000","last_became_peered":"2023-06-23T18:44:45.576835+0000","last_unstale":"2023-06-23T18:44:52.005876+0000","last_undegraded":"2023-06-23T18:44:52.005876+0000","last_fullsized":"2023-06-23T18:44:52.005876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:39:41.231072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650345+0000","last_change":"2023-06-23T18:44:50.242675+0000","last_active":"2023-06-23T18:44:51.650345+0000","last_peered":"2023-06-23T18:44:51.650345+0000","last_clean":"2023-06-23T18:44:51.650345+0000","last_became_active":"2023-06-23T18:44:50.242356+0000","last_became_peered":"2023-06-23T18:44:50.242356+0000","last_unstale":"2023-06-23T18:44:51.650345+0000","last_undegraded":"2023-06-23T18:44:51.650345+0000","last_fullsized":"2023-06-23T18:44:51.650345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:30:47.540693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650895+0000","last_change":"2023-06-23T18:44:50.661341+0000","last_active":"2023-06-23T18:44:51.650895+0000","last_peered":"2023-06-23T18:44:51.650895+0000","last_clean":"2023-06-23T18:44:51.650895+0000","last_became_active":"2023-06-23T18:44:50.661088+0000","last_became_peered":"2023-06-23T18:44:50.661088+0000","last_unstale":"2023-06-23T18:44:51.650895+0000","last_undegraded":"2023-06-23T18:44:51.650895+0000","last_fullsized":"2023-06-23T18:44:51.650895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:06:39.243693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.005910+0000","last_change":"2023-06-23T18:44:45.577304+0000","last_active":"2023-06-23T18:44:52.005910+0000","last_peered":"2023-06-23T18:44:52.005910+0000","last_clean":"2023-06-23T18:44:52.005910+0000","last_became_active":"2023-06-23T18:44:45.576846+0000","last_became_peered":"2023-06-23T18:44:45.576846+0000","last_unstale":"2023-06-23T18:44:52.005910+0000","last_undegraded":"2023-06-23T18:44:52.005910+0000","last_fullsized":"2023-06-23T18:44:52.005910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:27:48.193765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083316+0000","last_change":"2023-06-23T18:44:50.240634+0000","last_active":"2023-06-23T18:44:53.083316+0000","last_peered":"2023-06-23T18:44:53.083316+0000","last_clean":"2023-06-23T18:44:53.083316+0000","last_became_active":"2023-06-23T18:44:50.240328+0000","last_became_peered":"2023-06-23T18:44:50.240328+0000","last_unstale":"2023-06-23T18:44:53.083316+0000","last_undegraded":"2023-06-23T18:44:53.083316+0000","last_fullsized":"2023-06-23T18:44:53.083316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:39:46.270331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655442+0000","last_change":"2023-06-23T18:44:50.668726+0000","last_active":"2023-06-23T18:44:51.655442+0000","last_peered":"2023-06-23T18:44:51.655442+0000","last_clean":"2023-06-23T18:44:51.655442+0000","last_became_active":"2023-06-23T18:44:50.668435+0000","last_became_peered":"2023-06-23T18:44:50.668435+0000","last_unstale":"2023-06-23T18:44:51.655442+0000","last_undegraded":"2023-06-23T18:44:51.655442+0000","last_fullsized":"2023-06-23T18:44:51.655442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:33:32.909168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083490+0000","last_change":"2023-06-23T18:44:45.577154+0000","last_active":"2023-06-23T18:44:53.083490+0000","last_peered":"2023-06-23T18:44:53.083490+0000","last_clean":"2023-06-23T18:44:53.083490+0000","last_became_active":"2023-06-23T18:44:45.576819+0000","last_became_peered":"2023-06-23T18:44:45.576819+0000","last_unstale":"2023-06-23T18:44:53.083490+0000","last_undegraded":"2023-06-23T18:44:53.083490+0000","last_fullsized":"2023-06-23T18:44:53.083490+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:01:03.224415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498150+0000","last_change":"2023-06-23T18:44:50.248143+0000","last_active":"2023-06-23T18:44:52.498150+0000","last_peered":"2023-06-23T18:44:52.498150+0000","last_clean":"2023-06-23T18:44:52.498150+0000","last_became_active":"2023-06-23T18:44:50.247890+0000","last_became_peered":"2023-06-23T18:44:50.247890+0000","last_unstale":"2023-06-23T18:44:52.498150+0000","last_undegraded":"2023-06-23T18:44:52.498150+0000","last_fullsized":"2023-06-23T18:44:52.498150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:29:14.124932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650785+0000","last_change":"2023-06-23T18:44:50.661047+0000","last_active":"2023-06-23T18:44:51.650785+0000","last_peered":"2023-06-23T18:44:51.650785+0000","last_clean":"2023-06-23T18:44:51.650785+0000","last_became_active":"2023-06-23T18:44:50.660762+0000","last_became_peered":"2023-06-23T18:44:50.660762+0000","last_unstale":"2023-06-23T18:44:51.650785+0000","last_undegraded":"2023-06-23T18:44:51.650785+0000","last_fullsized":"2023-06-23T18:44:51.650785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:09:27.754720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655193+0000","last_change":"2023-06-23T18:44:45.577135+0000","last_active":"2023-06-23T18:44:51.655193+0000","last_peered":"2023-06-23T18:44:51.655193+0000","last_clean":"2023-06-23T18:44:51.655193+0000","last_became_active":"2023-06-23T18:44:45.576834+0000","last_became_peered":"2023-06-23T18:44:45.576834+0000","last_unstale":"2023-06-23T18:44:51.655193+0000","last_undegraded":"2023-06-23T18:44:51.655193+0000","last_fullsized":"2023-06-23T18:44:51.655193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:04:42.042988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650649+0000","last_change":"2023-06-23T18:44:50.244343+0000","last_active":"2023-06-23T18:44:51.650649+0000","last_peered":"2023-06-23T18:44:51.650649+0000","last_clean":"2023-06-23T18:44:51.650649+0000","last_became_active":"2023-06-23T18:44:50.244035+0000","last_became_peered":"2023-06-23T18:44:50.244035+0000","last_unstale":"2023-06-23T18:44:51.650649+0000","last_undegraded":"2023-06-23T18:44:51.650649+0000","last_fullsized":"2023-06-23T18:44:51.650649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:33:31.904138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404433+0000","last_change":"2023-06-23T18:44:50.658487+0000","last_active":"2023-06-23T18:44:52.404433+0000","last_peered":"2023-06-23T18:44:52.404433+0000","last_clean":"2023-06-23T18:44:52.404433+0000","last_became_active":"2023-06-23T18:44:50.656913+0000","last_became_peered":"2023-06-23T18:44:50.656913+0000","last_unstale":"2023-06-23T18:44:52.404433+0000","last_undegraded":"2023-06-23T18:44:52.404433+0000","last_fullsized":"2023-06-23T18:44:52.404433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:39:47.275362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655308+0000","last_change":"2023-06-23T18:44:45.192545+0000","last_active":"2023-06-23T18:44:51.655308+0000","last_peered":"2023-06-23T18:44:51.655308+0000","last_clean":"2023-06-23T18:44:51.655308+0000","last_became_active":"2023-06-23T18:44:45.192124+0000","last_became_peered":"2023-06-23T18:44:45.192124+0000","last_unstale":"2023-06-23T18:44:51.655308+0000","last_undegraded":"2023-06-23T18:44:51.655308+0000","last_fullsized":"2023-06-23T18:44:51.655308+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:57:40.392742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083879+0000","last_change":"2023-06-23T18:44:50.245977+0000","last_active":"2023-06-23T18:44:53.083879+0000","last_peered":"2023-06-23T18:44:53.083879+0000","last_clean":"2023-06-23T18:44:53.083879+0000","last_became_active":"2023-06-23T18:44:50.245656+0000","last_became_peered":"2023-06-23T18:44:50.245656+0000","last_unstale":"2023-06-23T18:44:53.083879+0000","last_undegraded":"2023-06-23T18:44:53.083879+0000","last_fullsized":"2023-06-23T18:44:53.083879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:39:46.270331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650648+0000","last_change":"2023-06-23T18:44:50.662985+0000","last_active":"2023-06-23T18:44:51.650648+0000","last_peered":"2023-06-23T18:44:51.650648+0000","last_clean":"2023-06-23T18:44:51.650648+0000","last_became_active":"2023-06-23T18:44:50.659614+0000","last_became_peered":"2023-06-23T18:44:50.659614+0000","last_unstale":"2023-06-23T18:44:51.650648+0000","last_undegraded":"2023-06-23T18:44:51.650648+0000","last_fullsized":"2023-06-23T18:44:51.650648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:26:23.851192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404590+0000","last_change":"2023-06-23T18:44:50.246331+0000","last_active":"2023-06-23T18:44:52.404590+0000","last_peered":"2023-06-23T18:44:52.404590+0000","last_clean":"2023-06-23T18:44:52.404590+0000","last_became_active":"2023-06-23T18:44:50.244789+0000","last_became_peered":"2023-06-23T18:44:50.244789+0000","last_unstale":"2023-06-23T18:44:52.404590+0000","last_undegraded":"2023-06-23T18:44:52.404590+0000","last_fullsized":"2023-06-23T18:44:52.404590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:24:19.734731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083457+0000","last_change":"2023-06-23T18:44:50.656054+0000","last_active":"2023-06-23T18:44:53.083457+0000","last_peered":"2023-06-23T18:44:53.083457+0000","last_clean":"2023-06-23T18:44:53.083457+0000","last_became_active":"2023-06-23T18:44:50.655781+0000","last_became_peered":"2023-06-23T18:44:50.655781+0000","last_unstale":"2023-06-23T18:44:53.083457+0000","last_undegraded":"2023-06-23T18:44:53.083457+0000","last_fullsized":"2023-06-23T18:44:53.083457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:31:28.989051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083546+0000","last_change":"2023-06-23T18:44:50.242527+0000","last_active":"2023-06-23T18:44:53.083546+0000","last_peered":"2023-06-23T18:44:53.083546+0000","last_clean":"2023-06-23T18:44:53.083546+0000","last_became_active":"2023-06-23T18:44:50.242265+0000","last_became_peered":"2023-06-23T18:44:50.242265+0000","last_unstale":"2023-06-23T18:44:53.083546+0000","last_undegraded":"2023-06-23T18:44:53.083546+0000","last_fullsized":"2023-06-23T18:44:53.083546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:33:31.904138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.497890+0000","last_change":"2023-06-23T18:44:50.673258+0000","last_active":"2023-06-23T18:44:52.497890+0000","last_peered":"2023-06-23T18:44:52.497890+0000","last_clean":"2023-06-23T18:44:52.497890+0000","last_became_active":"2023-06-23T18:44:50.672993+0000","last_became_peered":"2023-06-23T18:44:50.672993+0000","last_unstale":"2023-06-23T18:44:52.497890+0000","last_undegraded":"2023-06-23T18:44:52.497890+0000","last_fullsized":"2023-06-23T18:44:52.497890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:30:37.852223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.084007+0000","last_change":"2023-06-23T18:44:50.239578+0000","last_active":"2023-06-23T18:44:53.084007+0000","last_peered":"2023-06-23T18:44:53.084007+0000","last_clean":"2023-06-23T18:44:53.084007+0000","last_became_active":"2023-06-23T18:44:50.239290+0000","last_became_peered":"2023-06-23T18:44:50.239290+0000","last_unstale":"2023-06-23T18:44:53.084007+0000","last_undegraded":"2023-06-23T18:44:53.084007+0000","last_fullsized":"2023-06-23T18:44:53.084007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:23:59.792572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.498376+0000","last_change":"2023-06-23T18:44:50.672381+0000","last_active":"2023-06-23T18:44:52.498376+0000","last_peered":"2023-06-23T18:44:52.498376+0000","last_clean":"2023-06-23T18:44:52.498376+0000","last_became_active":"2023-06-23T18:44:50.672098+0000","last_became_peered":"2023-06-23T18:44:50.672098+0000","last_unstale":"2023-06-23T18:44:52.498376+0000","last_undegraded":"2023-06-23T18:44:52.498376+0000","last_fullsized":"2023-06-23T18:44:52.498376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:59:11.512811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083560+0000","last_change":"2023-06-23T18:44:50.240690+0000","last_active":"2023-06-23T18:44:53.083560+0000","last_peered":"2023-06-23T18:44:53.083560+0000","last_clean":"2023-06-23T18:44:53.083560+0000","last_became_active":"2023-06-23T18:44:50.240111+0000","last_became_peered":"2023-06-23T18:44:50.240111+0000","last_unstale":"2023-06-23T18:44:53.083560+0000","last_undegraded":"2023-06-23T18:44:53.083560+0000","last_fullsized":"2023-06-23T18:44:53.083560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:29:43.646940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083395+0000","last_change":"2023-06-23T18:44:50.667526+0000","last_active":"2023-06-23T18:44:53.083395+0000","last_peered":"2023-06-23T18:44:53.083395+0000","last_clean":"2023-06-23T18:44:53.083395+0000","last_became_active":"2023-06-23T18:44:50.667214+0000","last_became_peered":"2023-06-23T18:44:50.667214+0000","last_unstale":"2023-06-23T18:44:53.083395+0000","last_undegraded":"2023-06-23T18:44:53.083395+0000","last_fullsized":"2023-06-23T18:44:53.083395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:24:00.797602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.404617+0000","last_change":"2023-06-23T18:44:50.244989+0000","last_active":"2023-06-23T18:44:52.404617+0000","last_peered":"2023-06-23T18:44:52.404617+0000","last_clean":"2023-06-23T18:44:52.404617+0000","last_became_active":"2023-06-23T18:44:50.241979+0000","last_became_peered":"2023-06-23T18:44:50.241979+0000","last_unstale":"2023-06-23T18:44:52.404617+0000","last_undegraded":"2023-06-23T18:44:52.404617+0000","last_fullsized":"2023-06-23T18:44:52.404617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:49.212264+0000","last_clean_scrub_stamp":"2023-06-23T18:44:49.212264+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:30:36.847193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.497733+0000","last_change":"2023-06-23T18:44:50.670305+0000","last_active":"2023-06-23T18:44:52.497733+0000","last_peered":"2023-06-23T18:44:52.497733+0000","last_clean":"2023-06-23T18:44:52.497733+0000","last_became_active":"2023-06-23T18:44:50.668141+0000","last_became_peered":"2023-06-23T18:44:50.668141+0000","last_unstale":"2023-06-23T18:44:52.497733+0000","last_undegraded":"2023-06-23T18:44:52.497733+0000","last_fullsized":"2023-06-23T18:44:52.497733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:11:35.546421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.655061+0000","last_change":"2023-06-23T18:44:50.656461+0000","last_active":"2023-06-23T18:44:51.655061+0000","last_peered":"2023-06-23T18:44:51.655061+0000","last_clean":"2023-06-23T18:44:51.655061+0000","last_became_active":"2023-06-23T18:44:50.656193+0000","last_became_peered":"2023-06-23T18:44:50.656193+0000","last_unstale":"2023-06-23T18:44:51.655061+0000","last_undegraded":"2023-06-23T18:44:51.655061+0000","last_fullsized":"2023-06-23T18:44:51.655061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:46:59.173048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083323+0000","last_change":"2023-06-23T18:44:50.668275+0000","last_active":"2023-06-23T18:44:53.083323+0000","last_peered":"2023-06-23T18:44:53.083323+0000","last_clean":"2023-06-23T18:44:53.083323+0000","last_became_active":"2023-06-23T18:44:50.667755+0000","last_became_peered":"2023-06-23T18:44:50.667755+0000","last_unstale":"2023-06-23T18:44:53.083323+0000","last_undegraded":"2023-06-23T18:44:53.083323+0000","last_fullsized":"2023-06-23T18:44:53.083323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:27:54.238055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:52.497838+0000","last_change":"2023-06-23T18:44:50.671148+0000","last_active":"2023-06-23T18:44:52.497838+0000","last_peered":"2023-06-23T18:44:52.497838+0000","last_clean":"2023-06-23T18:44:52.497838+0000","last_became_active":"2023-06-23T18:44:50.667939+0000","last_became_peered":"2023-06-23T18:44:50.667939+0000","last_unstale":"2023-06-23T18:44:52.497838+0000","last_undegraded":"2023-06-23T18:44:52.497838+0000","last_fullsized":"2023-06-23T18:44:52.497838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:27:54.238055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:53.083932+0000","last_change":"2023-06-23T18:44:50.675550+0000","last_active":"2023-06-23T18:44:53.083932+0000","last_peered":"2023-06-23T18:44:53.083932+0000","last_clean":"2023-06-23T18:44:53.083932+0000","last_became_active":"2023-06-23T18:44:50.674409+0000","last_became_peered":"2023-06-23T18:44:50.674409+0000","last_unstale":"2023-06-23T18:44:53.083932+0000","last_undegraded":"2023-06-23T18:44:53.083932+0000","last_fullsized":"2023-06-23T18:44:53.083932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:48:26.644150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-06-23T18:44:51.650600+0000","last_change":"2023-06-23T18:44:50.672283+0000","last_active":"2023-06-23T18:44:51.650600+0000","last_peered":"2023-06-23T18:44:51.650600+0000","last_clean":"2023-06-23T18:44:51.650600+0000","last_became_active":"2023-06-23T18:44:50.672102+0000","last_became_peered":"2023-06-23T18:44:50.672102+0000","last_unstale":"2023-06-23T18:44:51.650600+0000","last_undegraded":"2023-06-23T18:44:51.650600+0000","last_fullsized":"2023-06-23T18:44:51.650600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:50.217295+0000","last_clean_scrub_stamp":"2023-06-23T18:44:50.217295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:57:46.437032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":839680,"data_stored":671247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":79099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":811008,"data_stored":669467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":79681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4179999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.488}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.577}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.516}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":78138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4810000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27168,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":221184,"data_stored":79189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":80719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27172,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":225280,"data_stored":79751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T18:44:59.985 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-06-23T18:44:59.986 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-06-23T18:44:59.986 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-06-23T18:44:59.987 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-06-23T18:45:00.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.139+0000 7f8c0b367700 1 Processor -- start 2023-06-23T18:45:00.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.139+0000 7f8c0b367700 1 -- start start 2023-06-23T18:45:00.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.140+0000 7f8c0b367700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8c0406a0d0 0x7f8c040bc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:00.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.140+0000 7f8c0b367700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c040b7aa0 con 0x7f8c041444a0 2023-06-23T18:45:00.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.140+0000 7f8c0b367700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c040b5f30 con 0x7f8c04144920 2023-06-23T18:45:00.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.140+0000 7f8c0b367700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c040b6210 con 0x7f8c0406a0d0 2023-06-23T18:45:00.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.140+0000 7f8c08902700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8c041444a0 0x7f8c040b54e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44884/0 (socket says 172.21.15.52:44884) 2023-06-23T18:45:00.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.140+0000 7f8c08902700 1 -- 172.21.15.52:0/1464251698 learned_addr learned my addr 172.21.15.52:0/1464251698 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:00.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.140+0000 7f8bfbfff700 1 -- 172.21.15.52:0/1464251698 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3315716978 0 0) 0x7f8c040b7aa0 con 0x7f8c041444a0 2023-06-23T18:45:00.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.140+0000 7f8bfbfff700 1 -- 172.21.15.52:0/1464251698 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bf00035b0 con 0x7f8c041444a0 2023-06-23T18:45:00.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.140+0000 7f8c09103700 1 --2- 172.21.15.52:0/1464251698 >> v2:172.21.15.89:3300/0 conn(0x7f8c0406a0d0 0x7f8c040bc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:00.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.140+0000 7f8bfbfff700 1 -- 172.21.15.52:0/1464251698 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1491240709 0 0) 0x7f8bf00035b0 con 0x7f8c041444a0 2023-06-23T18:45:00.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.140+0000 7f8bfbfff700 1 -- 172.21.15.52:0/1464251698 >> v2:172.21.15.89:3300/0 conn(0x7f8c0406a0d0 msgr2=0x7f8c040bc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:00.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.140+0000 7f8bfbfff700 1 --2- 172.21.15.52:0/1464251698 >> v2:172.21.15.89:3300/0 conn(0x7f8c0406a0d0 0x7f8c040bc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:00.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.140+0000 7f8bfbfff700 1 -- 172.21.15.52:0/1464251698 >> v1:172.21.15.89:6789/0 conn(0x7f8c04144920 legacy=0x7f8c04154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:00.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.140+0000 7f8bfbfff700 1 -- 172.21.15.52:0/1464251698 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c040b64f0 con 0x7f8c041444a0 2023-06-23T18:45:00.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.140+0000 7f8bfbfff700 1 -- 172.21.15.52:0/1464251698 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7f8bf4001670 con 0x7f8c041444a0 2023-06-23T18:45:00.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.140+0000 7f8bfbfff700 1 -- 172.21.15.52:0/1464251698 >> v1:172.21.15.52:6789/0 conn(0x7f8c041444a0 legacy=0x7f8c040b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:00.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.140+0000 7f8bfbfff700 1 --2- 172.21.15.52:0/1464251698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bf0003a00 0x7f8bf0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:00.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.140+0000 7f8bfbfff700 1 --2- 172.21.15.52:0/1464251698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8bf00043f0 0x7f8bf00048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:00.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.140+0000 7f8bfbfff700 1 --2- 172.21.15.52:0/1464251698 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bf00050b0 0x7f8bf000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:00.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.141+0000 7f8bfbfff700 1 -- 172.21.15.52:0/1464251698 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040b6210 con 0x7f8bf0003a00 2023-06-23T18:45:00.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.141+0000 7f8bfbfff700 1 -- 172.21.15.52:0/1464251698 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf000c000 con 0x7f8bf00050b0 2023-06-23T18:45:00.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.141+0000 7f8bfbfff700 1 -- 172.21.15.52:0/1464251698 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf000c1c0 con 0x7f8bf00043f0 2023-06-23T18:45:00.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.141+0000 7f8c09103700 1 --2- 172.21.15.52:0/1464251698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bf0003a00 0x7f8bf0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:00.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.141+0000 7f8c09904700 1 --2- 172.21.15.52:0/1464251698 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bf00050b0 0x7f8bf000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:00.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.141+0000 7f8c08902700 1 --2- 172.21.15.52:0/1464251698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8bf00043f0 0x7f8bf00048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:00.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.141+0000 7f8c09103700 1 -- 172.21.15.52:0/1464251698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8bf00043f0 msgr2=0x7f8bf00048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:00.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.141+0000 7f8c09103700 1 --2- 172.21.15.52:0/1464251698 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8bf00043f0 0x7f8bf00048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:00.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.141+0000 7f8c09103700 1 -- 172.21.15.52:0/1464251698 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bf00050b0 msgr2=0x7f8bf000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:00.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.141+0000 7f8c09103700 1 --2- 172.21.15.52:0/1464251698 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bf00050b0 0x7f8bf000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:00.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.141+0000 7f8c09904700 1 -- 172.21.15.52:0/1464251698 reap_dead start 2023-06-23T18:45:00.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.141+0000 7f8c09103700 1 -- 172.21.15.52:0/1464251698 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf00035b0 con 0x7f8bf0003a00 2023-06-23T18:45:00.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.141+0000 7f8c09103700 1 --2- 172.21.15.52:0/1464251698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bf0003a00 0x7f8bf0003dd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8c00009b60 tx=0x7f8bf0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3134e5c04d6631 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:00.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.141+0000 7f8bfbfff700 1 -- 172.21.15.52:0/1464251698 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0000e6c0 con 0x7f8bf0003a00 2023-06-23T18:45:00.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.141+0000 7f8bfbfff700 1 -- 172.21.15.52:0/1464251698 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0000e820 con 0x7f8bf0003a00 2023-06-23T18:45:00.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.141+0000 7f8bfbfff700 1 -- 172.21.15.52:0/1464251698 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0000eb90 con 0x7f8bf0003a00 2023-06-23T18:45:00.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.142+0000 7f8c0b367700 1 -- 172.21.15.52:0/1464251698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bf0003a00 msgr2=0x7f8bf0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:00.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.142+0000 7f8c0b367700 1 --2- 172.21.15.52:0/1464251698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bf0003a00 0x7f8bf0003dd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8c00009b60 tx=0x7f8bf0005880 comp rx=0 tx=0).stop 2023-06-23T18:45:00.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.142+0000 7f8c0b367700 1 -- 172.21.15.52:0/1464251698 shutdown_connections 2023-06-23T18:45:00.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.142+0000 7f8c0b367700 1 --2- 172.21.15.52:0/1464251698 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bf0003a00 0x7f8bf0003dd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:00.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.142+0000 7f8c0b367700 1 -- 172.21.15.52:0/1464251698 >> 172.21.15.52:0/1464251698 conn(0x7f8c0406bb90 msgr2=0x7f8c0406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:00.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.142+0000 7f8c0b367700 1 -- 172.21.15.52:0/1464251698 shutdown_connections 2023-06-23T18:45:00.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.142+0000 7f8c0b367700 1 -- 172.21.15.52:0/1464251698 wait complete. 2023-06-23T18:45:00.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.143+0000 7f8c0b367700 1 Processor -- start 2023-06-23T18:45:00.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.143+0000 7f8c0b367700 1 -- start start 2023-06-23T18:45:00.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.144+0000 7f8c0b367700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8bf0003a00 0x7f8c04145740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:00.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.144+0000 7f8c0b367700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c041465a0 0x7f8c041471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:00.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.144+0000 7f8c0b367700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c04147730 0x7f8c04141e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:00.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.144+0000 7f8c0b367700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c04145c80 con 0x7f8c04147730 2023-06-23T18:45:00.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.144+0000 7f8c0b367700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c04147b80 con 0x7f8c041465a0 2023-06-23T18:45:00.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.144+0000 7f8c0b367700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c041d7900 con 0x7f8bf0003a00 2023-06-23T18:45:00.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.144+0000 7f8c09904700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c04147730 0x7f8c04141e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:00.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.144+0000 7f8c09904700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c04147730 0x7f8c04141e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52278/0 (socket says 172.21.15.52:52278) 2023-06-23T18:45:00.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.144+0000 7f8c09904700 1 -- 172.21.15.52:0/3287161493 learned_addr learned my addr 172.21.15.52:0/3287161493 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:00.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.144+0000 7f8c09103700 1 --2- 172.21.15.52:0/3287161493 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8bf0003a00 0x7f8c04145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:00.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.144+0000 7f8c08902700 1 --2- 172.21.15.52:0/3287161493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c041465a0 0x7f8c041471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:00.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.144+0000 7f8c09904700 1 -- 172.21.15.52:0/3287161493 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8bf0003a00 msgr2=0x7f8c04145740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:00.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.144+0000 7f8c09904700 1 --2- 172.21.15.52:0/3287161493 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8bf0003a00 0x7f8c04145740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:00.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.144+0000 7f8c09904700 1 -- 172.21.15.52:0/3287161493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c041465a0 msgr2=0x7f8c041471f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:00.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.144+0000 7f8c09904700 1 --2- 172.21.15.52:0/3287161493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c041465a0 0x7f8c041471f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:00.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.144+0000 7f8c09904700 1 -- 172.21.15.52:0/3287161493 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c04146dd0 con 0x7f8c04147730 2023-06-23T18:45:00.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.144+0000 7f8c09103700 1 --2- 172.21.15.52:0/3287161493 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8bf0003a00 0x7f8c04145740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:00.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.144+0000 7f8c09904700 1 --2- 172.21.15.52:0/3287161493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c04147730 0x7f8c04141e50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8c04072010 tx=0x7f8bfc00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:00.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.144+0000 7f8bf9ffb700 1 -- 172.21.15.52:0/3287161493 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc003c10 con 0x7f8c04147730 2023-06-23T18:45:00.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.144+0000 7f8bf9ffb700 1 -- 172.21.15.52:0/3287161493 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc003d70 con 0x7f8c04147730 2023-06-23T18:45:00.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.144+0000 7f8c0b367700 1 -- 172.21.15.52:0/3287161493 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c04144f70 con 0x7f8c04147730 2023-06-23T18:45:00.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.144+0000 7f8bf9ffb700 1 -- 172.21.15.52:0/3287161493 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc00dbd0 con 0x7f8c04147730 2023-06-23T18:45:00.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.145+0000 7f8c0b367700 1 -- 172.21.15.52:0/3287161493 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c041d7100 con 0x7f8c04147730 2023-06-23T18:45:00.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.145+0000 7f8c0b367700 1 -- 172.21.15.52:0/3287161493 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c0404e1d0 con 0x7f8c04147730 2023-06-23T18:45:00.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.146+0000 7f8bf9ffb700 1 -- 172.21.15.52:0/3287161493 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8bfc00dd30 con 0x7f8c04147730 2023-06-23T18:45:00.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.146+0000 7f8bf9ffb700 1 --2- 172.21.15.52:0/3287161493 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f8be806ace0 0x7f8be806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:00.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.146+0000 7f8bf9ffb700 1 -- 172.21.15.52:0/3287161493 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8bfc089830 con 0x7f8c04147730 2023-06-23T18:45:00.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.146+0000 7f8c09103700 1 --2- 172.21.15.52:0/3287161493 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f8be806ace0 0x7f8be806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:00.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.147+0000 7f8c09103700 1 --2- 172.21.15.52:0/3287161493 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f8be806ace0 0x7f8be806d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8c000090b0 tx=0x7f8c00008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:00.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.151+0000 7f8bf9ffb700 1 -- 172.21.15.52:0/3287161493 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8bfc0548f0 con 0x7f8c04147730 2023-06-23T18:45:00.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.394+0000 7f8c0b367700 1 -- 172.21.15.52:0/3287161493 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8c040b6870 con 0x7f8c04147730 2023-06-23T18:45:00.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.395+0000 7f8bf9ffb700 1 -- 172.21.15.52:0/3287161493 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8bfc057f10 con 0x7f8c04147730 2023-06-23T18:45:00.400 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:00.400 INFO:teuthology.orchestra.run.smithi052.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-06-23T18:45:00.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.397+0000 7f8c0b367700 1 -- 172.21.15.52:0/3287161493 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f8be806ace0 msgr2=0x7f8be806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:00.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.397+0000 7f8c0b367700 1 --2- 172.21.15.52:0/3287161493 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f8be806ace0 0x7f8be806d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8c000090b0 tx=0x7f8c00008030 comp rx=0 tx=0).stop 2023-06-23T18:45:00.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.397+0000 7f8c0b367700 1 -- 172.21.15.52:0/3287161493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c04147730 msgr2=0x7f8c04141e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:00.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.397+0000 7f8c0b367700 1 --2- 172.21.15.52:0/3287161493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c04147730 0x7f8c04141e50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8c04072010 tx=0x7f8bfc00d430 comp rx=0 tx=0).stop 2023-06-23T18:45:00.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.397+0000 7f8c0b367700 1 -- 172.21.15.52:0/3287161493 shutdown_connections 2023-06-23T18:45:00.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.397+0000 7f8c0b367700 1 --2- 172.21.15.52:0/3287161493 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f8be806ace0 0x7f8be806d190 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:00.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.397+0000 7f8c0b367700 1 --2- 172.21.15.52:0/3287161493 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8c04147730 0x7f8c04141e50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:00.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.397+0000 7f8c0b367700 1 --2- 172.21.15.52:0/3287161493 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8bf0003a00 0x7f8c04145740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:00.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.397+0000 7f8c0b367700 1 --2- 172.21.15.52:0/3287161493 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c041465a0 0x7f8c041471f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:00.403 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.397+0000 7f8c0b367700 1 -- 172.21.15.52:0/3287161493 >> 172.21.15.52:0/3287161493 conn(0x7f8c0406bb90 msgr2=0x7f8c041482d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:00.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.397+0000 7f8c0b367700 1 -- 172.21.15.52:0/3287161493 shutdown_connections 2023-06-23T18:45:00.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.397+0000 7f8c0b367700 1 -- 172.21.15.52:0/3287161493 wait complete. 2023-06-23T18:45:00.414 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-06-23T18:45:00.414 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:45:00.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.534+0000 7fc681b65700 1 Processor -- start 2023-06-23T18:45:00.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.534+0000 7fc681b65700 1 -- start start 2023-06-23T18:45:00.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.535+0000 7fc681b65700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc67c06a0d0 0x7fc67c0bc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:00.541 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.535+0000 7fc681b65700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc67c1444a0 0x7fc67c0b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:00.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.535+0000 7fc681b65700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc67c0b7aa0 con 0x7fc67c0b5a20 2023-06-23T18:45:00.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.535+0000 7fc681b65700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc67c0b5f30 con 0x7fc67c1444a0 2023-06-23T18:45:00.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.535+0000 7fc681b65700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c0b6210 con 0x7fc67c06a0d0 2023-06-23T18:45:00.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.535+0000 7fc67affd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc67c1444a0 0x7fc67c0b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:00.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.535+0000 7fc67affd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc67c1444a0 0x7fc67c0b54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52286/0 (socket says 172.21.15.52:52286) 2023-06-23T18:45:00.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.535+0000 7fc67affd700 1 -- 172.21.15.52:0/964762639 learned_addr learned my addr 172.21.15.52:0/964762639 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:00.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.535+0000 7fc67b7fe700 1 --2- 172.21.15.52:0/964762639 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc67c06a0d0 0x7fc67c0bc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:00.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.535+0000 7fc67affd700 1 -- 172.21.15.52:0/964762639 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc67c06a0d0 msgr2=0x7fc67c0bc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:00.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.535+0000 7fc67affd700 1 --2- 172.21.15.52:0/964762639 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc67c06a0d0 0x7fc67c0bc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:00.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.535+0000 7fc67affd700 1 -- 172.21.15.52:0/964762639 >> v1:172.21.15.89:6789/0 conn(0x7fc67c0b5a20 legacy=0x7fc67c0bb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:00.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.535+0000 7fc67affd700 1 -- 172.21.15.52:0/964762639 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67c0b64f0 con 0x7fc67c1444a0 2023-06-23T18:45:00.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.535+0000 7fc67affd700 1 --2- 172.21.15.52:0/964762639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc67c1444a0 0x7fc67c0b54e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc6640098f0 tx=0x7fc664009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3c18cc20123b64 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:00.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.535+0000 7fc67a7fc700 1 -- 172.21.15.52:0/964762639 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc664004230 con 0x7fc67c1444a0 2023-06-23T18:45:00.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.535+0000 7fc67a7fc700 1 -- 172.21.15.52:0/964762639 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc664004390 con 0x7fc67c1444a0 2023-06-23T18:45:00.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.535+0000 7fc67a7fc700 1 -- 172.21.15.52:0/964762639 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6640036a0 con 0x7fc67c1444a0 2023-06-23T18:45:00.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.536+0000 7fc681b65700 1 -- 172.21.15.52:0/964762639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc67c1444a0 msgr2=0x7fc67c0b54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:00.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.536+0000 7fc681b65700 1 --2- 172.21.15.52:0/964762639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc67c1444a0 0x7fc67c0b54e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc6640098f0 tx=0x7fc664009c00 comp rx=0 tx=0).stop 2023-06-23T18:45:00.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.536+0000 7fc681b65700 1 -- 172.21.15.52:0/964762639 shutdown_connections 2023-06-23T18:45:00.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.536+0000 7fc681b65700 1 --2- 172.21.15.52:0/964762639 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc67c06a0d0 0x7fc67c0bc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:00.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.536+0000 7fc681b65700 1 --2- 172.21.15.52:0/964762639 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc67c1444a0 0x7fc67c0b54e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:00.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.536+0000 7fc681b65700 1 -- 172.21.15.52:0/964762639 >> 172.21.15.52:0/964762639 conn(0x7fc67c06bb90 msgr2=0x7fc67c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:00.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.536+0000 7fc681b65700 1 -- 172.21.15.52:0/964762639 shutdown_connections 2023-06-23T18:45:00.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.536+0000 7fc681b65700 1 -- 172.21.15.52:0/964762639 wait complete. 2023-06-23T18:45:00.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.537+0000 7fc681b65700 1 Processor -- start 2023-06-23T18:45:00.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.537+0000 7fc681b65700 1 -- start start 2023-06-23T18:45:00.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.538+0000 7fc681b65700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc67c06a0d0 0x7fc67c0bf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:00.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.538+0000 7fc681b65700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc67c0b5a20 0x7fc67c145100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:00.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.538+0000 7fc681b65700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc67c1444a0 0x7fc67c1d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:00.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.538+0000 7fc681b65700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c0bf900 con 0x7fc67c1444a0 2023-06-23T18:45:00.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.538+0000 7fc681b65700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c1d1890 con 0x7fc67c0b5a20 2023-06-23T18:45:00.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.538+0000 7fc681b65700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c1d1b30 con 0x7fc67c06a0d0 2023-06-23T18:45:00.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.538+0000 7fc67bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc67c1444a0 0x7fc67c1d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:00.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.538+0000 7fc67bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc67c1444a0 0x7fc67c1d1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52296/0 (socket says 172.21.15.52:52296) 2023-06-23T18:45:00.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.538+0000 7fc67bfff700 1 -- 172.21.15.52:0/846298128 learned_addr learned my addr 172.21.15.52:0/846298128 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:00.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.538+0000 7fc67b7fe700 1 --2- 172.21.15.52:0/846298128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc67c06a0d0 0x7fc67c0bf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:00.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.538+0000 7fc67affd700 1 --2- 172.21.15.52:0/846298128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc67c0b5a20 0x7fc67c145100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:00.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.538+0000 7fc67bfff700 1 -- 172.21.15.52:0/846298128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc67c06a0d0 msgr2=0x7fc67c0bf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:00.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.538+0000 7fc67bfff700 1 --2- 172.21.15.52:0/846298128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc67c06a0d0 0x7fc67c0bf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:00.550 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.538+0000 7fc67bfff700 1 -- 172.21.15.52:0/846298128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc67c0b5a20 msgr2=0x7fc67c145100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:00.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.538+0000 7fc67bfff700 1 --2- 172.21.15.52:0/846298128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc67c0b5a20 0x7fc67c145100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:00.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.538+0000 7fc67bfff700 1 -- 172.21.15.52:0/846298128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc664009550 con 0x7fc67c1444a0 2023-06-23T18:45:00.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.538+0000 7fc67affd700 1 --2- 172.21.15.52:0/846298128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc67c0b5a20 0x7fc67c145100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:00.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.538+0000 7fc67bfff700 1 --2- 172.21.15.52:0/846298128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc67c1444a0 0x7fc67c1d1fc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc67400cbd0 tx=0x7fc67400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:00.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.539+0000 7fc673fff700 1 -- 172.21.15.52:0/846298128 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67400aac0 con 0x7fc67c1444a0 2023-06-23T18:45:00.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.539+0000 7fc673fff700 1 -- 172.21.15.52:0/846298128 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67400ac20 con 0x7fc67c1444a0 2023-06-23T18:45:00.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.539+0000 7fc681b65700 1 -- 172.21.15.52:0/846298128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc67c145640 con 0x7fc67c1444a0 2023-06-23T18:45:00.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.539+0000 7fc673fff700 1 -- 172.21.15.52:0/846298128 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc674012420 con 0x7fc67c1444a0 2023-06-23T18:45:00.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.539+0000 7fc681b65700 1 -- 172.21.15.52:0/846298128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc67c1488b0 con 0x7fc67c1444a0 2023-06-23T18:45:00.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.539+0000 7fc681b65700 1 -- 172.21.15.52:0/846298128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc67c1d1cc0 con 0x7fc67c1444a0 2023-06-23T18:45:00.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.540+0000 7fc673fff700 1 -- 172.21.15.52:0/846298128 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc674012580 con 0x7fc67c1444a0 2023-06-23T18:45:00.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.540+0000 7fc673fff700 1 --2- 172.21.15.52:0/846298128 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc65c06ace0 0x7fc65c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:00.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.541+0000 7fc673fff700 1 -- 172.21.15.52:0/846298128 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc674089b10 con 0x7fc67c1444a0 2023-06-23T18:45:00.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.541+0000 7fc67b7fe700 1 --2- 172.21.15.52:0/846298128 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc65c06ace0 0x7fc65c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:00.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.541+0000 7fc67b7fe700 1 --2- 172.21.15.52:0/846298128 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc65c06ace0 0x7fc65c06d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc66c00ab60 tx=0x7fc66c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:00.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.545+0000 7fc673fff700 1 -- 172.21.15.52:0/846298128 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc674054c50 con 0x7fc67c1444a0 2023-06-23T18:45:00.746 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.742+0000 7fc681b65700 1 -- 172.21.15.52:0/846298128 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc67c04e1d0 con 0x7fc67c1444a0 2023-06-23T18:45:00.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.743+0000 7fc673fff700 1 -- 172.21.15.52:0/846298128 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7fc674016020 con 0x7fc67c1444a0 2023-06-23T18:45:00.748 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:00.748 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","created":"2023-06-23T18:44:31.918434+0000","modified":"2023-06-23T18:44:51.644330+0000","last_up_change":"2023-06-23T18:44:42.169624+0000","last_in_change":"2023-06-23T18:44:34.510501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-23T18:44:43.346578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-23T18:44:43.829719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:44:48.517897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:44:49.621134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c371fb28-1b15-4e43-8d5a-43e402920ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6812","nonce":1066999520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6815","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6818","nonce":1066999520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6829","nonce":1066999520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6823","nonce":1066999520}]},"public_addr":"172.21.15.52:6812/1066999520","cluster_addr":"172.21.15.52:6818/1066999520","heartbeat_back_addr":"172.21.15.52:6829/1066999520","heartbeat_front_addr":"172.21.15.52:6823/1066999520","state":["exists","up"]},{"osd":1,"uuid":"4a142f04-33eb-47ec-9cc5-b08b44d82658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6813","nonce":2360219751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6819","nonce":2360219751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6830","nonce":2360219751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6825","nonce":2360219751}]},"public_addr":"172.21.15.52:6813/2360219751","cluster_addr":"172.21.15.52:6819/2360219751","heartbeat_back_addr":"172.21.15.52:6830/2360219751","heartbeat_front_addr":"172.21.15.52:6825/2360219751","state":["exists","up"]},{"osd":2,"uuid":"d7bb089d-4c55-4370-ba59-7fe88c39512a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6801","nonce":835073005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6803","nonce":835073005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6807","nonce":835073005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6805","nonce":835073005}]},"public_addr":"172.21.15.52:6801/835073005","cluster_addr":"172.21.15.52:6803/835073005","heartbeat_back_addr":"172.21.15.52:6807/835073005","heartbeat_front_addr":"172.21.15.52:6805/835073005","state":["exists","up"]},{"osd":3,"uuid":"4bcdcdc3-6a8f-468e-877e-57f76079ac3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6811","nonce":2852700864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6817","nonce":2852700864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6831","nonce":2852700864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6824","nonce":2852700864}]},"public_addr":"172.21.15.52:6811/2852700864","cluster_addr":"172.21.15.52:6817/2852700864","heartbeat_back_addr":"172.21.15.52:6831/2852700864","heartbeat_front_addr":"172.21.15.52:6824/2852700864","state":["exists","up"]},{"osd":4,"uuid":"cac63000-ae94-4b08-93e6-a99119640b63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6809","nonce":2538664679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6811","nonce":2538664679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6815","nonce":2538664679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6813","nonce":2538664679}]},"public_addr":"172.21.15.89:6809/2538664679","cluster_addr":"172.21.15.89:6811/2538664679","heartbeat_back_addr":"172.21.15.89:6815/2538664679","heartbeat_front_addr":"172.21.15.89:6813/2538664679","state":["exists","up"]},{"osd":5,"uuid":"45c53102-18a6-4fd7-9c25-8ea5e1ef6851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6801","nonce":1683710352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6803","nonce":1683710352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6807","nonce":1683710352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6805","nonce":1683710352}]},"public_addr":"172.21.15.89:6801/1683710352","cluster_addr":"172.21.15.89:6803/1683710352","heartbeat_back_addr":"172.21.15.89:6807/1683710352","heartbeat_front_addr":"172.21.15.89:6805/1683710352","state":["exists","up"]},{"osd":6,"uuid":"abee09d1-8eba-484f-a25c-871c1fe2e843","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6817","nonce":3890899288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6819","nonce":3890899288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6823","nonce":3890899288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6821","nonce":3890899288}]},"public_addr":"172.21.15.89:6817/3890899288","cluster_addr":"172.21.15.89:6819/3890899288","heartbeat_back_addr":"172.21.15.89:6823/3890899288","heartbeat_front_addr":"172.21.15.89:6821/3890899288","state":["exists","up"]},{"osd":7,"uuid":"5acf9e2e-00dd-4f9b-a7d9-3d820f695de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6825","nonce":2989085420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6827","nonce":2989085420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6831","nonce":2989085420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6829","nonce":2989085420}]},"public_addr":"172.21.15.89:6825/2989085420","cluster_addr":"172.21.15.89:6827/2989085420","heartbeat_back_addr":"172.21.15.89:6831/2989085420","heartbeat_front_addr":"172.21.15.89:6829/2989085420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.663866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.710904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.619347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.660102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.686933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.724635+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.669111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.678740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:45:00.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.745+0000 7fc681b65700 1 -- 172.21.15.52:0/846298128 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc65c06ace0 msgr2=0x7fc65c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:00.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.745+0000 7fc681b65700 1 --2- 172.21.15.52:0/846298128 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc65c06ace0 0x7fc65c06d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc66c00ab60 tx=0x7fc66c008040 comp rx=0 tx=0).stop 2023-06-23T18:45:00.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.745+0000 7fc681b65700 1 -- 172.21.15.52:0/846298128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc67c1444a0 msgr2=0x7fc67c1d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:00.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.745+0000 7fc681b65700 1 --2- 172.21.15.52:0/846298128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc67c1444a0 0x7fc67c1d1fc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc67400cbd0 tx=0x7fc67400cee0 comp rx=0 tx=0).stop 2023-06-23T18:45:00.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.745+0000 7fc681b65700 1 -- 172.21.15.52:0/846298128 shutdown_connections 2023-06-23T18:45:00.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.745+0000 7fc681b65700 1 --2- 172.21.15.52:0/846298128 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc65c06ace0 0x7fc65c06d190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:00.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.745+0000 7fc681b65700 1 --2- 172.21.15.52:0/846298128 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc67c1444a0 0x7fc67c1d1fc0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:00.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.745+0000 7fc681b65700 1 --2- 172.21.15.52:0/846298128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc67c06a0d0 0x7fc67c0bf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:00.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.745+0000 7fc681b65700 1 --2- 172.21.15.52:0/846298128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc67c0b5a20 0x7fc67c145100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:00.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.745+0000 7fc681b65700 1 -- 172.21.15.52:0/846298128 >> 172.21.15.52:0/846298128 conn(0x7fc67c06bb90 msgr2=0x7fc67c0bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:00.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.745+0000 7fc681b65700 1 -- 172.21.15.52:0/846298128 shutdown_connections 2023-06-23T18:45:00.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.745+0000 7fc681b65700 1 -- 172.21.15.52:0/846298128 wait complete. 2023-06-23T18:45:00.762 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-23T18:44:43.346578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-23T18:44:43.829719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T18:44:48.517897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T18:44:49.621134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-23T18:45:00.763 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T18:45:00.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.886+0000 7f9ac9946700 1 Processor -- start 2023-06-23T18:45:00.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.887+0000 7f9ac9946700 1 -- start start 2023-06-23T18:45:00.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.888+0000 7f9ac9946700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9ac414a600 0x7f9ac40bb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:00.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.888+0000 7f9ac9946700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac40be040 con 0x7f9ac40b6870 2023-06-23T18:45:00.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.888+0000 7f9ac9946700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac414aae0 con 0x7f9ac40b59b0 2023-06-23T18:45:00.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.888+0000 7f9ac9946700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac414adc0 con 0x7f9ac414a600 2023-06-23T18:45:00.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.888+0000 7f9ac27fc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9ac414a600 0x7f9ac40bb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:00.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.888+0000 7f9ac2ffd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9ac40b6870 0x7f9ac4144480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44886/0 (socket says 172.21.15.52:44886) 2023-06-23T18:45:00.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.888+0000 7f9ac2ffd700 1 -- 172.21.15.52:0/1477764547 learned_addr learned my addr 172.21.15.52:0/1477764547 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:00.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.888+0000 7f9ac27fc700 1 -- 172.21.15.52:0/1477764547 >> v1:172.21.15.89:6789/0 conn(0x7f9ac40b59b0 legacy=0x7f9ac4154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:00.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.888+0000 7f9ac27fc700 1 -- 172.21.15.52:0/1477764547 >> v1:172.21.15.52:6789/0 conn(0x7f9ac40b6870 legacy=0x7f9ac4144480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:00.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.888+0000 7f9ac27fc700 1 -- 172.21.15.52:0/1477764547 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac414b0a0 con 0x7f9ac414a600 2023-06-23T18:45:00.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.888+0000 7f9ac27fc700 1 --2- 172.21.15.52:0/1477764547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac414a600 0x7f9ac40bb1f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9aac009840 tx=0x7f9aac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10766a325a92dca3 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:00.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.888+0000 7f9ac1ffb700 1 -- 172.21.15.52:0/1477764547 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac011830 con 0x7f9ac414a600 2023-06-23T18:45:00.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.888+0000 7f9ac1ffb700 1 -- 172.21.15.52:0/1477764547 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aac011990 con 0x7f9ac414a600 2023-06-23T18:45:00.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.888+0000 7f9ac1ffb700 1 -- 172.21.15.52:0/1477764547 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac011d20 con 0x7f9ac414a600 2023-06-23T18:45:00.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.889+0000 7f9ac9946700 1 -- 172.21.15.52:0/1477764547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac414a600 msgr2=0x7f9ac40bb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:00.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.889+0000 7f9ac9946700 1 --2- 172.21.15.52:0/1477764547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac414a600 0x7f9ac40bb1f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9aac009840 tx=0x7f9aac009b50 comp rx=0 tx=0).stop 2023-06-23T18:45:00.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.889+0000 7f9ac9946700 1 -- 172.21.15.52:0/1477764547 shutdown_connections 2023-06-23T18:45:00.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.889+0000 7f9ac9946700 1 --2- 172.21.15.52:0/1477764547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac414a600 0x7f9ac40bb1f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:00.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.889+0000 7f9ac9946700 1 -- 172.21.15.52:0/1477764547 >> 172.21.15.52:0/1477764547 conn(0x7f9ac40bd140 msgr2=0x7f9ac40bd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:00.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.889+0000 7f9ac9946700 1 -- 172.21.15.52:0/1477764547 shutdown_connections 2023-06-23T18:45:00.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.889+0000 7f9ac9946700 1 -- 172.21.15.52:0/1477764547 wait complete. 2023-06-23T18:45:00.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.890+0000 7f9ac9946700 1 Processor -- start 2023-06-23T18:45:00.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.890+0000 7f9ac9946700 1 -- start start 2023-06-23T18:45:00.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.891+0000 7f9ac9946700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac40b59b0 0x7f9ac413d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:00.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.891+0000 7f9ac9946700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ac40b6870 0x7f9ac40bfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:00.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.891+0000 7f9ac9946700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ac414a600 0x7f9ac41d9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:00.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.891+0000 7f9ac9946700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac41e0b70 con 0x7f9ac40b59b0 2023-06-23T18:45:00.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.891+0000 7f9ac9946700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40c02e0 con 0x7f9ac414a600 2023-06-23T18:45:00.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.891+0000 7f9ac9946700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac41dfba0 con 0x7f9ac40b6870 2023-06-23T18:45:00.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.891+0000 7f9ac2ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac40b59b0 0x7f9ac413d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:00.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.891+0000 7f9ac2ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac40b59b0 0x7f9ac413d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52302/0 (socket says 172.21.15.52:52302) 2023-06-23T18:45:00.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.891+0000 7f9ac2ffd700 1 -- 172.21.15.52:0/2428160611 learned_addr learned my addr 172.21.15.52:0/2428160611 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.891+0000 7f9ac27fc700 1 --2- 172.21.15.52:0/2428160611 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ac40b6870 0x7f9ac40bfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.891+0000 7f9ac37fe700 1 --2- 172.21.15.52:0/2428160611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ac414a600 0x7f9ac41d9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.891+0000 7f9ac2ffd700 1 -- 172.21.15.52:0/2428160611 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ac40b6870 msgr2=0x7f9ac40bfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.891+0000 7f9ac2ffd700 1 --2- 172.21.15.52:0/2428160611 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ac40b6870 0x7f9ac40bfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.891+0000 7f9ac2ffd700 1 -- 172.21.15.52:0/2428160611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ac414a600 msgr2=0x7f9ac41d9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.891+0000 7f9ac2ffd700 1 --2- 172.21.15.52:0/2428160611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ac414a600 0x7f9ac41d9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:00.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.891+0000 7f9ac2ffd700 1 -- 172.21.15.52:0/2428160611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aac0094a0 con 0x7f9ac40b59b0 2023-06-23T18:45:00.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.891+0000 7f9ac27fc700 1 --2- 172.21.15.52:0/2428160611 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ac40b6870 0x7f9ac40bfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:00.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.891+0000 7f9ac37fe700 1 --2- 172.21.15.52:0/2428160611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ac414a600 0x7f9ac41d9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:00.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.891+0000 7f9ac2ffd700 1 --2- 172.21.15.52:0/2428160611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac40b59b0 0x7f9ac413d420 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9ab400c550 tx=0x7f9ab400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:00.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.892+0000 7f9abbfff700 1 -- 172.21.15.52:0/2428160611 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4005d70 con 0x7f9ac40b59b0 2023-06-23T18:45:00.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.892+0000 7f9abbfff700 1 -- 172.21.15.52:0/2428160611 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab40070d0 con 0x7f9ac40b59b0 2023-06-23T18:45:00.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.892+0000 7f9abbfff700 1 -- 172.21.15.52:0/2428160611 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4007440 con 0x7f9ac40b59b0 2023-06-23T18:45:00.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.892+0000 7f9ac9946700 1 -- 172.21.15.52:0/2428160611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac41dfdb0 con 0x7f9ac40b59b0 2023-06-23T18:45:00.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.892+0000 7f9ac9946700 1 -- 172.21.15.52:0/2428160611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac41e0370 con 0x7f9ac40b59b0 2023-06-23T18:45:00.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.893+0000 7f9ac9946700 1 -- 172.21.15.52:0/2428160611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac404e1d0 con 0x7f9ac40b59b0 2023-06-23T18:45:00.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.893+0000 7f9abbfff700 1 -- 172.21.15.52:0/2428160611 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9ab40075a0 con 0x7f9ac40b59b0 2023-06-23T18:45:00.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.893+0000 7f9abbfff700 1 --2- 172.21.15.52:0/2428160611 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9aa406ace0 0x7f9aa406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:00.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.893+0000 7f9abbfff700 1 -- 172.21.15.52:0/2428160611 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9ab4088820 con 0x7f9ac40b59b0 2023-06-23T18:45:00.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.894+0000 7f9ac27fc700 1 --2- 172.21.15.52:0/2428160611 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9aa406ace0 0x7f9aa406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:00.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.894+0000 7f9ac27fc700 1 --2- 172.21.15.52:0/2428160611 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9aa406ace0 0x7f9aa406d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0090b0 tx=0x7f9aac008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:00.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:00.898+0000 7f9abbfff700 1 -- 172.21.15.52:0/2428160611 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9ab4053a10 con 0x7f9ac40b59b0 2023-06-23T18:45:01.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.092+0000 7f9ac9946700 1 -- 172.21.15.52:0/2428160611 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9ac40b80e0 con 0x7f9ac40b59b0 2023-06-23T18:45:01.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.092+0000 7f9abbfff700 1 -- 172.21.15.52:0/2428160611 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9ab4057030 con 0x7f9ac40b59b0 2023-06-23T18:45:01.097 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-06-23T18:45:01.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.094+0000 7f9ac9946700 1 -- 172.21.15.52:0/2428160611 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9aa406ace0 msgr2=0x7f9aa406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:01.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.094+0000 7f9ac9946700 1 --2- 172.21.15.52:0/2428160611 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9aa406ace0 0x7f9aa406d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0090b0 tx=0x7f9aac008030 comp rx=0 tx=0).stop 2023-06-23T18:45:01.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.094+0000 7f9ac9946700 1 -- 172.21.15.52:0/2428160611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac40b59b0 msgr2=0x7f9ac413d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:01.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.094+0000 7f9ac9946700 1 --2- 172.21.15.52:0/2428160611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac40b59b0 0x7f9ac413d420 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9ab400c550 tx=0x7f9ab400c910 comp rx=0 tx=0).stop 2023-06-23T18:45:01.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.094+0000 7f9ac9946700 1 -- 172.21.15.52:0/2428160611 shutdown_connections 2023-06-23T18:45:01.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.094+0000 7f9ac9946700 1 --2- 172.21.15.52:0/2428160611 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9aa406ace0 0x7f9aa406d190 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.094+0000 7f9ac9946700 1 --2- 172.21.15.52:0/2428160611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ac414a600 0x7f9ac41d9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.094+0000 7f9ac9946700 1 --2- 172.21.15.52:0/2428160611 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ac40b59b0 0x7f9ac413d420 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.094+0000 7f9ac9946700 1 --2- 172.21.15.52:0/2428160611 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ac40b6870 0x7f9ac40bfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.094+0000 7f9ac9946700 1 -- 172.21.15.52:0/2428160611 >> 172.21.15.52:0/2428160611 conn(0x7f9ac40bd140 msgr2=0x7f9ac41412a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:01.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.094+0000 7f9ac9946700 1 -- 172.21.15.52:0/2428160611 shutdown_connections 2023-06-23T18:45:01.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.094+0000 7f9ac9946700 1 -- 172.21.15.52:0/2428160611 wait complete. 2023-06-23T18:45:01.111 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T18:45:01.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.234+0000 7ff8fb216700 1 Processor -- start 2023-06-23T18:45:01.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.234+0000 7ff8fb216700 1 -- start start 2023-06-23T18:45:01.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.235+0000 7ff8fb216700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff8f414a600 0x7ff8f40bb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:01.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.235+0000 7ff8fb216700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8f40b59b0 0x7ff8f40bb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:01.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.235+0000 7ff8fb216700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f40be040 con 0x7ff8f40b6870 2023-06-23T18:45:01.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.235+0000 7ff8fb216700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f414aae0 con 0x7ff8f414a600 2023-06-23T18:45:01.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.235+0000 7ff8fb216700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f414adc0 con 0x7ff8f40b59b0 2023-06-23T18:45:01.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.235+0000 7ff8f3fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff8f414a600 0x7ff8f40bb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:01.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.235+0000 7ff8f8fb2700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7ff8f40b6870 0x7ff8f4144480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44900/0 (socket says 172.21.15.52:44900) 2023-06-23T18:45:01.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.235+0000 7ff8f8fb2700 1 -- 172.21.15.52:0/1710119023 learned_addr learned my addr 172.21.15.52:0/1710119023 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:01.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.235+0000 7ff8f97b3700 1 --2- 172.21.15.52:0/1710119023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8f40b59b0 0x7ff8f40bb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:01.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.235+0000 7ff8f3fff700 1 -- 172.21.15.52:0/1710119023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8f40b59b0 msgr2=0x7ff8f40bb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:01.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.235+0000 7ff8f3fff700 1 --2- 172.21.15.52:0/1710119023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8f40b59b0 0x7ff8f40bb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.235+0000 7ff8f3fff700 1 -- 172.21.15.52:0/1710119023 >> v1:172.21.15.52:6789/0 conn(0x7ff8f40b6870 legacy=0x7ff8f4144480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:01.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.235+0000 7ff8f3fff700 1 -- 172.21.15.52:0/1710119023 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f414b0a0 con 0x7ff8f414a600 2023-06-23T18:45:01.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.235+0000 7ff8f37fe700 1 -- 172.21.15.52:0/1710119023 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3814525835 0 0) 0x7ff8f40be040 con 0x7ff8f40b6870 2023-06-23T18:45:01.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.235+0000 7ff8f3fff700 1 --2- 172.21.15.52:0/1710119023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8f414a600 0x7ff8f40bb1f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0009840 tx=0x7ff8e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93563f6d3965c0d4 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:01.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.235+0000 7ff8f37fe700 1 -- 172.21.15.52:0/1710119023 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0011830 con 0x7ff8f414a600 2023-06-23T18:45:01.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.236+0000 7ff8f37fe700 1 -- 172.21.15.52:0/1710119023 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e0011990 con 0x7ff8f414a600 2023-06-23T18:45:01.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.236+0000 7ff8f37fe700 1 -- 172.21.15.52:0/1710119023 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0011d20 con 0x7ff8f414a600 2023-06-23T18:45:01.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.236+0000 7ff8fb216700 1 -- 172.21.15.52:0/1710119023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8f414a600 msgr2=0x7ff8f40bb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:01.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.236+0000 7ff8fb216700 1 --2- 172.21.15.52:0/1710119023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8f414a600 0x7ff8f40bb1f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0009840 tx=0x7ff8e0009b50 comp rx=0 tx=0).stop 2023-06-23T18:45:01.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.236+0000 7ff8fb216700 1 -- 172.21.15.52:0/1710119023 shutdown_connections 2023-06-23T18:45:01.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.236+0000 7ff8fb216700 1 --2- 172.21.15.52:0/1710119023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8f40b59b0 0x7ff8f40bb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.236+0000 7ff8fb216700 1 --2- 172.21.15.52:0/1710119023 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8f414a600 0x7ff8f40bb1f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.236+0000 7ff8fb216700 1 -- 172.21.15.52:0/1710119023 >> 172.21.15.52:0/1710119023 conn(0x7ff8f40bd140 msgr2=0x7ff8f40bd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:01.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.236+0000 7ff8fb216700 1 -- 172.21.15.52:0/1710119023 shutdown_connections 2023-06-23T18:45:01.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.236+0000 7ff8fb216700 1 -- 172.21.15.52:0/1710119023 wait complete. 2023-06-23T18:45:01.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.238+0000 7ff8fb216700 1 Processor -- start 2023-06-23T18:45:01.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.238+0000 7ff8fb216700 1 -- start start 2023-06-23T18:45:01.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.239+0000 7ff8fb216700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8f40b59b0 0x7ff8f40ba0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:01.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.239+0000 7ff8fb216700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8f40b6870 0x7ff8f41496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:01.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.239+0000 7ff8fb216700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8f414a600 0x7ff8f41e3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:01.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.239+0000 7ff8fb216700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f4149c00 con 0x7ff8f414a600 2023-06-23T18:45:01.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.239+0000 7ff8fb216700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f4140a50 con 0x7ff8f40b6870 2023-06-23T18:45:01.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.239+0000 7ff8fb216700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f4145030 con 0x7ff8f40b59b0 2023-06-23T18:45:01.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.239+0000 7ff8f97b3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8f414a600 0x7ff8f41e3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:01.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.239+0000 7ff8f97b3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8f414a600 0x7ff8f41e3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52310/0 (socket says 172.21.15.52:52310) 2023-06-23T18:45:01.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.239+0000 7ff8f97b3700 1 -- 172.21.15.52:0/2359986763 learned_addr learned my addr 172.21.15.52:0/2359986763 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:01.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.239+0000 7ff8f8fb2700 1 --2- 172.21.15.52:0/2359986763 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8f40b59b0 0x7ff8f40ba0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:01.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.239+0000 7ff8f3fff700 1 --2- 172.21.15.52:0/2359986763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8f40b6870 0x7ff8f41496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:01.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.239+0000 7ff8f97b3700 1 -- 172.21.15.52:0/2359986763 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8f40b59b0 msgr2=0x7ff8f40ba0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:01.248 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.239+0000 7ff8f97b3700 1 --2- 172.21.15.52:0/2359986763 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8f40b59b0 0x7ff8f40ba0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.239+0000 7ff8f97b3700 1 -- 172.21.15.52:0/2359986763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8f40b6870 msgr2=0x7ff8f41496c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:01.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.239+0000 7ff8f97b3700 1 --2- 172.21.15.52:0/2359986763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8f40b6870 0x7ff8f41496c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.239+0000 7ff8f97b3700 1 -- 172.21.15.52:0/2359986763 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e00094a0 con 0x7ff8f414a600 2023-06-23T18:45:01.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.239+0000 7ff8f97b3700 1 --2- 172.21.15.52:0/2359986763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8f414a600 0x7ff8f41e3480 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec007e60 tx=0x7ff8ec00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:01.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.239+0000 7ff8f17fa700 1 -- 172.21.15.52:0/2359986763 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec00ed30 con 0x7ff8f414a600 2023-06-23T18:45:01.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.239+0000 7ff8f17fa700 1 -- 172.21.15.52:0/2359986763 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ec014420 con 0x7ff8f414a600 2023-06-23T18:45:01.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.239+0000 7ff8fb216700 1 -- 172.21.15.52:0/2359986763 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f4140120 con 0x7ff8f414a600 2023-06-23T18:45:01.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.239+0000 7ff8f17fa700 1 -- 172.21.15.52:0/2359986763 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec0147d0 con 0x7ff8f414a600 2023-06-23T18:45:01.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.240+0000 7ff8fb216700 1 -- 172.21.15.52:0/2359986763 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f41406e0 con 0x7ff8f414a600 2023-06-23T18:45:01.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.240+0000 7ff8fb216700 1 -- 172.21.15.52:0/2359986763 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f4140870 con 0x7ff8f414a600 2023-06-23T18:45:01.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.241+0000 7ff8f17fa700 1 -- 172.21.15.52:0/2359986763 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff8ec014930 con 0x7ff8f414a600 2023-06-23T18:45:01.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.241+0000 7ff8f17fa700 1 --2- 172.21.15.52:0/2359986763 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff8d806ace0 0x7ff8d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:01.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.241+0000 7ff8f17fa700 1 -- 172.21.15.52:0/2359986763 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff8ec089b10 con 0x7ff8f414a600 2023-06-23T18:45:01.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.241+0000 7ff8f8fb2700 1 --2- 172.21.15.52:0/2359986763 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff8d806ace0 0x7ff8d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:01.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.242+0000 7ff8f8fb2700 1 --2- 172.21.15.52:0/2359986763 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff8d806ace0 0x7ff8d806d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8007fd0 tx=0x7ff8e8007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:01.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.246+0000 7ff8f17fa700 1 -- 172.21.15.52:0/2359986763 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff8ec054c60 con 0x7ff8f414a600 2023-06-23T18:45:01.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.439+0000 7ff8fb216700 1 -- 172.21.15.52:0/2359986763 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff8f404e1d0 con 0x7ff8f414a600 2023-06-23T18:45:01.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.439+0000 7ff8f17fa700 1 -- 172.21.15.52:0/2359986763 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff8ec058280 con 0x7ff8f414a600 2023-06-23T18:45:01.444 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-06-23T18:45:01.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.441+0000 7ff8fb216700 1 -- 172.21.15.52:0/2359986763 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff8d806ace0 msgr2=0x7ff8d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:01.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.441+0000 7ff8fb216700 1 --2- 172.21.15.52:0/2359986763 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff8d806ace0 0x7ff8d806d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8007fd0 tx=0x7ff8e8007de0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.441+0000 7ff8fb216700 1 -- 172.21.15.52:0/2359986763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8f414a600 msgr2=0x7ff8f41e3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:01.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.441+0000 7ff8fb216700 1 --2- 172.21.15.52:0/2359986763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8f414a600 0x7ff8f41e3480 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec007e60 tx=0x7ff8ec00e3c0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.441+0000 7ff8fb216700 1 -- 172.21.15.52:0/2359986763 shutdown_connections 2023-06-23T18:45:01.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.441+0000 7ff8fb216700 1 --2- 172.21.15.52:0/2359986763 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff8d806ace0 0x7ff8d806d190 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.441+0000 7ff8fb216700 1 --2- 172.21.15.52:0/2359986763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff8f414a600 0x7ff8f41e3480 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.441+0000 7ff8fb216700 1 --2- 172.21.15.52:0/2359986763 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8f40b59b0 0x7ff8f40ba0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.441+0000 7ff8fb216700 1 --2- 172.21.15.52:0/2359986763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8f40b6870 0x7ff8f41496c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.441+0000 7ff8fb216700 1 -- 172.21.15.52:0/2359986763 >> 172.21.15.52:0/2359986763 conn(0x7ff8f40bd140 msgr2=0x7ff8f4141de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:01.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.441+0000 7ff8fb216700 1 -- 172.21.15.52:0/2359986763 shutdown_connections 2023-06-23T18:45:01.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.441+0000 7ff8fb216700 1 -- 172.21.15.52:0/2359986763 wait complete. 2023-06-23T18:45:01.458 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T18:45:01.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.582+0000 7f07550fe700 1 Processor -- start 2023-06-23T18:45:01.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.582+0000 7f07550fe700 1 -- start start 2023-06-23T18:45:01.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.583+0000 7f07550fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07500b6c50 0x7f07500b8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:01.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.583+0000 7f07550fe700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07500b7da0 con 0x7f07500b8a20 2023-06-23T18:45:01.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.583+0000 7f07550fe700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07500b9390 con 0x7f075006b0e0 2023-06-23T18:45:01.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.583+0000 7f07550fe700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07500b9c30 con 0x7f07500b6c50 2023-06-23T18:45:01.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.583+0000 7f074f59e700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f07500b8a20 0x7f0750141f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44908/0 (socket says 172.21.15.52:44908) 2023-06-23T18:45:01.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.583+0000 7f074f59e700 1 -- 172.21.15.52:0/1280734727 learned_addr learned my addr 172.21.15.52:0/1280734727 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:01.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.583+0000 7f074ed9d700 1 --2- 172.21.15.52:0/1280734727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07500b6c50 0x7f07500b8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:01.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.583+0000 7f074dd9b700 1 -- 172.21.15.52:0/1280734727 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2793069313 0 0) 0x7f07500b7da0 con 0x7f07500b8a20 2023-06-23T18:45:01.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.583+0000 7f074dd9b700 1 -- 172.21.15.52:0/1280734727 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07380035b0 con 0x7f07500b8a20 2023-06-23T18:45:01.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.584+0000 7f074dd9b700 1 -- 172.21.15.52:0/1280734727 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 265831763 0 0) 0x7f07380035b0 con 0x7f07500b8a20 2023-06-23T18:45:01.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.584+0000 7f074dd9b700 1 -- 172.21.15.52:0/1280734727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07500b6c50 msgr2=0x7f07500b8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:01.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.584+0000 7f074dd9b700 1 --2- 172.21.15.52:0/1280734727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07500b6c50 0x7f07500b8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.584+0000 7f074dd9b700 1 -- 172.21.15.52:0/1280734727 >> v1:172.21.15.89:6789/0 conn(0x7f075006b0e0 legacy=0x7f075006c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:01.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.584+0000 7f074dd9b700 1 -- 172.21.15.52:0/1280734727 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07500b9670 con 0x7f07500b8a20 2023-06-23T18:45:01.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.584+0000 7f074dd9b700 1 -- 172.21.15.52:0/1280734727 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7f07480019f0 con 0x7f07500b8a20 2023-06-23T18:45:01.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.584+0000 7f074dd9b700 1 -- 172.21.15.52:0/1280734727 >> v1:172.21.15.52:6789/0 conn(0x7f07500b8a20 legacy=0x7f0750141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:01.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.584+0000 7f074dd9b700 1 --2- 172.21.15.52:0/1280734727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0738003a30 0x7f0738003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:01.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.584+0000 7f074dd9b700 1 --2- 172.21.15.52:0/1280734727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0738004850 0x7f0738004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:01.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.584+0000 7f074dd9b700 1 --2- 172.21.15.52:0/1280734727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07500b6c50 0x7f0738005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:01.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.584+0000 7f074dd9b700 1 -- 172.21.15.52:0/1280734727 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07500b9c30 con 0x7f0738003a30 2023-06-23T18:45:01.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.584+0000 7f074dd9b700 1 -- 172.21.15.52:0/1280734727 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073800bb40 con 0x7f0738004850 2023-06-23T18:45:01.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.584+0000 7f074dd9b700 1 -- 172.21.15.52:0/1280734727 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073800bd00 con 0x7f07500b6c50 2023-06-23T18:45:01.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.584+0000 7f074ed9d700 1 --2- 172.21.15.52:0/1280734727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0738003a30 0x7f0738003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:01.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.584+0000 7f074e59c700 1 --2- 172.21.15.52:0/1280734727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0738004850 0x7f0738004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:01.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.584+0000 7f074f59e700 1 --2- 172.21.15.52:0/1280734727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07500b6c50 0x7f0738005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:01.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.584+0000 7f074ed9d700 1 -- 172.21.15.52:0/1280734727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07500b6c50 msgr2=0x7f0738005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:01.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.584+0000 7f074ed9d700 1 --2- 172.21.15.52:0/1280734727 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07500b6c50 0x7f0738005240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.584+0000 7f074ed9d700 1 -- 172.21.15.52:0/1280734727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0738004850 msgr2=0x7f0738004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:01.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.584+0000 7f074ed9d700 1 --2- 172.21.15.52:0/1280734727 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0738004850 0x7f0738004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.584+0000 7f074ed9d700 1 -- 172.21.15.52:0/1280734727 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07380035b0 con 0x7f0738003a30 2023-06-23T18:45:01.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.584+0000 7f074ed9d700 1 --2- 172.21.15.52:0/1280734727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0738003a30 0x7f0738003e00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0744009b60 tx=0x7f0738005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e08551951f5fc83 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:01.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.584+0000 7f074dd9b700 1 -- 172.21.15.52:0/1280734727 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074400e6c0 con 0x7f0738003a30 2023-06-23T18:45:01.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.584+0000 7f074dd9b700 1 -- 172.21.15.52:0/1280734727 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074400e820 con 0x7f0738003a30 2023-06-23T18:45:01.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.584+0000 7f074dd9b700 1 -- 172.21.15.52:0/1280734727 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074400eb90 con 0x7f0738003a30 2023-06-23T18:45:01.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.585+0000 7f07550fe700 1 -- 172.21.15.52:0/1280734727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0738003a30 msgr2=0x7f0738003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:01.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.585+0000 7f07550fe700 1 --2- 172.21.15.52:0/1280734727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0738003a30 0x7f0738003e00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0744009b60 tx=0x7f0738005880 comp rx=0 tx=0).stop 2023-06-23T18:45:01.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.585+0000 7f074f59e700 1 -- 172.21.15.52:0/1280734727 reap_dead start 2023-06-23T18:45:01.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.585+0000 7f07550fe700 1 -- 172.21.15.52:0/1280734727 shutdown_connections 2023-06-23T18:45:01.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.585+0000 7f07550fe700 1 -- 172.21.15.52:0/1280734727 >> 172.21.15.52:0/1280734727 conn(0x7f07500bd420 msgr2=0x7f07500bd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:01.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.585+0000 7f07550fe700 1 -- 172.21.15.52:0/1280734727 shutdown_connections 2023-06-23T18:45:01.595 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.585+0000 7f07550fe700 1 -- 172.21.15.52:0/1280734727 wait complete. 2023-06-23T18:45:01.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.587+0000 7f07550fe700 1 Processor -- start 2023-06-23T18:45:01.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.587+0000 7f07550fe700 1 -- start start 2023-06-23T18:45:01.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.587+0000 7f07550fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0738003a30 0x7f075013d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:01.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.588+0000 7f07550fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f075013e1f0 0x7f07501dd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:01.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.588+0000 7f07550fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0750142a40 0x7f0750147850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:01.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.588+0000 7f07550fe700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07501436a0 con 0x7f0750142a40 2023-06-23T18:45:01.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.588+0000 7f07550fe700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075013cb10 con 0x7f075013e1f0 2023-06-23T18:45:01.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.588+0000 7f07550fe700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0750144370 con 0x7f0738003a30 2023-06-23T18:45:01.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.588+0000 7f074f59e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0750142a40 0x7f0750147850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:01.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.588+0000 7f074f59e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0750142a40 0x7f0750147850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52322/0 (socket says 172.21.15.52:52322) 2023-06-23T18:45:01.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.588+0000 7f074f59e700 1 -- 172.21.15.52:0/3645960257 learned_addr learned my addr 172.21.15.52:0/3645960257 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:01.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.588+0000 7f074e59c700 1 --2- 172.21.15.52:0/3645960257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f075013e1f0 0x7f07501dd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:01.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.588+0000 7f074ed9d700 1 --2- 172.21.15.52:0/3645960257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0738003a30 0x7f075013d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:01.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.588+0000 7f074f59e700 1 -- 172.21.15.52:0/3645960257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0738003a30 msgr2=0x7f075013d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:01.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.588+0000 7f074f59e700 1 --2- 172.21.15.52:0/3645960257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0738003a30 0x7f075013d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.588+0000 7f074f59e700 1 -- 172.21.15.52:0/3645960257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f075013e1f0 msgr2=0x7f07501dd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:01.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.588+0000 7f074f59e700 1 --2- 172.21.15.52:0/3645960257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f075013e1f0 0x7f07501dd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.588+0000 7f074f59e700 1 -- 172.21.15.52:0/3645960257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07501489e0 con 0x7f0750142a40 2023-06-23T18:45:01.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.588+0000 7f074e59c700 1 --2- 172.21.15.52:0/3645960257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f075013e1f0 0x7f07501dd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:45:01.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.588+0000 7f074f59e700 1 --2- 172.21.15.52:0/3645960257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0750142a40 0x7f0750147850 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0748001a40 tx=0x7f074800e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:01.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.588+0000 7f07377fe700 1 -- 172.21.15.52:0/3645960257 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0748017070 con 0x7f0750142a40 2023-06-23T18:45:01.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.588+0000 7f07377fe700 1 -- 172.21.15.52:0/3645960257 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074800ebf0 con 0x7f0750142a40 2023-06-23T18:45:01.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.588+0000 7f07550fe700 1 -- 172.21.15.52:0/3645960257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0750148cc0 con 0x7f0750142a40 2023-06-23T18:45:01.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.588+0000 7f07377fe700 1 -- 172.21.15.52:0/3645960257 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074800eda0 con 0x7f0750142a40 2023-06-23T18:45:01.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.588+0000 7f07550fe700 1 -- 172.21.15.52:0/3645960257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0750148600 con 0x7f0750142a40 2023-06-23T18:45:01.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.590+0000 7f07550fe700 1 -- 172.21.15.52:0/3645960257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f075004e1d0 con 0x7f0750142a40 2023-06-23T18:45:01.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.590+0000 7f07377fe700 1 -- 172.21.15.52:0/3645960257 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0748013420 con 0x7f0750142a40 2023-06-23T18:45:01.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.590+0000 7f07377fe700 1 --2- 172.21.15.52:0/3645960257 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f073c06ace0 0x7f073c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:01.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.590+0000 7f07377fe700 1 -- 172.21.15.52:0/3645960257 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0748089150 con 0x7f0750142a40 2023-06-23T18:45:01.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.590+0000 7f074ed9d700 1 --2- 172.21.15.52:0/3645960257 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f073c06ace0 0x7f073c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:01.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.591+0000 7f074ed9d700 1 --2- 172.21.15.52:0/3645960257 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f073c06ace0 0x7f073c06d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f07440090b0 tx=0x7f074401f040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:01.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.595+0000 7f07377fe700 1 -- 172.21.15.52:0/3645960257 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0748054160 con 0x7f0750142a40 2023-06-23T18:45:01.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.791+0000 7f07550fe700 1 -- 172.21.15.52:0/3645960257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0750148790 con 0x7f0750142a40 2023-06-23T18:45:01.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.791+0000 7f07377fe700 1 -- 172.21.15.52:0/3645960257 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0748057780 con 0x7f0750142a40 2023-06-23T18:45:01.796 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2023-06-23T18:45:01.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.793+0000 7f07550fe700 1 -- 172.21.15.52:0/3645960257 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f073c06ace0 msgr2=0x7f073c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:01.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.793+0000 7f07550fe700 1 --2- 172.21.15.52:0/3645960257 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f073c06ace0 0x7f073c06d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f07440090b0 tx=0x7f074401f040 comp rx=0 tx=0).stop 2023-06-23T18:45:01.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.793+0000 7f07550fe700 1 -- 172.21.15.52:0/3645960257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0750142a40 msgr2=0x7f0750147850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:01.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.793+0000 7f07550fe700 1 --2- 172.21.15.52:0/3645960257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0750142a40 0x7f0750147850 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0748001a40 tx=0x7f074800e440 comp rx=0 tx=0).stop 2023-06-23T18:45:01.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.793+0000 7f07550fe700 1 -- 172.21.15.52:0/3645960257 shutdown_connections 2023-06-23T18:45:01.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.793+0000 7f07550fe700 1 --2- 172.21.15.52:0/3645960257 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f073c06ace0 0x7f073c06d190 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.793+0000 7f07550fe700 1 --2- 172.21.15.52:0/3645960257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0750142a40 0x7f0750147850 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.793+0000 7f07550fe700 1 --2- 172.21.15.52:0/3645960257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0738003a30 0x7f075013d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.793+0000 7f07550fe700 1 --2- 172.21.15.52:0/3645960257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f075013e1f0 0x7f07501dd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.793+0000 7f07550fe700 1 -- 172.21.15.52:0/3645960257 >> 172.21.15.52:0/3645960257 conn(0x7f07500bd420 msgr2=0x7f075013bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:01.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.793+0000 7f07550fe700 1 -- 172.21.15.52:0/3645960257 shutdown_connections 2023-06-23T18:45:01.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.793+0000 7f07550fe700 1 -- 172.21.15.52:0/3645960257 wait complete. 2023-06-23T18:45:01.810 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T18:45:01.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.933+0000 7f51b3fd8700 1 Processor -- start 2023-06-23T18:45:01.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.934+0000 7f51b3fd8700 1 -- start start 2023-06-23T18:45:01.939 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.935+0000 7f51b3fd8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f51ac0b8c80 0x7f51ac071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:01.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.935+0000 7f51b3fd8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ac0b8360 con 0x7f51ac141220 2023-06-23T18:45:01.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.935+0000 7f51b3fd8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ac0b7da0 con 0x7f51ac1479f0 2023-06-23T18:45:01.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.935+0000 7f51b3fd8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ac0b4bb0 con 0x7f51ac0b8c80 2023-06-23T18:45:01.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.935+0000 7f51b1573700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f51ac141220 0x7f51ac1472e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44918/0 (socket says 172.21.15.52:44918) 2023-06-23T18:45:01.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.935+0000 7f51b1573700 1 -- 172.21.15.52:0/2907033124 learned_addr learned my addr 172.21.15.52:0/2907033124 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:01.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.935+0000 7f51b1d74700 1 --2- 172.21.15.52:0/2907033124 >> v2:172.21.15.89:3300/0 conn(0x7f51ac0b8c80 0x7f51ac071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:01.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.935+0000 7f51b0d72700 1 -- 172.21.15.52:0/2907033124 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4165858294 0 0) 0x7f51ac0b8360 con 0x7f51ac141220 2023-06-23T18:45:01.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.935+0000 7f51b0d72700 1 -- 172.21.15.52:0/2907033124 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51980035b0 con 0x7f51ac141220 2023-06-23T18:45:01.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.935+0000 7f51b0d72700 1 -- 172.21.15.52:0/2907033124 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 51138617 0 0) 0x7f51980035b0 con 0x7f51ac141220 2023-06-23T18:45:01.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.935+0000 7f51b0d72700 1 -- 172.21.15.52:0/2907033124 >> v2:172.21.15.89:3300/0 conn(0x7f51ac0b8c80 msgr2=0x7f51ac071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:01.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.935+0000 7f51b0d72700 1 --2- 172.21.15.52:0/2907033124 >> v2:172.21.15.89:3300/0 conn(0x7f51ac0b8c80 0x7f51ac071240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.935+0000 7f51b0d72700 1 -- 172.21.15.52:0/2907033124 >> v1:172.21.15.89:6789/0 conn(0x7f51ac1479f0 legacy=0x7f51ac151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:01.944 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.935+0000 7f51b0d72700 1 -- 172.21.15.52:0/2907033124 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac0b8080 con 0x7f51ac141220 2023-06-23T18:45:01.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.935+0000 7f51b0d72700 1 -- 172.21.15.52:0/2907033124 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7f519c001670 con 0x7f51ac141220 2023-06-23T18:45:01.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.935+0000 7f51b0d72700 1 -- 172.21.15.52:0/2907033124 >> v1:172.21.15.52:6789/0 conn(0x7f51ac141220 legacy=0x7f51ac1472e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:01.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.935+0000 7f51b0d72700 1 --2- 172.21.15.52:0/2907033124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5198003a00 0x7f5198003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:01.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.935+0000 7f51b0d72700 1 --2- 172.21.15.52:0/2907033124 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5198004850 0x7f5198004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:01.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.935+0000 7f51b0d72700 1 --2- 172.21.15.52:0/2907033124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5198005320 0x7f519800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:01.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.935+0000 7f51b0d72700 1 -- 172.21.15.52:0/2907033124 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519800c220 con 0x7f5198005320 2023-06-23T18:45:01.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.935+0000 7f51b0d72700 1 -- 172.21.15.52:0/2907033124 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519800c390 con 0x7f5198003a00 2023-06-23T18:45:01.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.935+0000 7f51b0d72700 1 -- 172.21.15.52:0/2907033124 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519800c550 con 0x7f5198004850 2023-06-23T18:45:01.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.935+0000 7f51b1d74700 1 --2- 172.21.15.52:0/2907033124 >> v2:172.21.15.89:3300/0 conn(0x7f51ac0b8c80 0x7f51ac071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:45:01.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.935+0000 7f51b2575700 1 --2- 172.21.15.52:0/2907033124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5198005320 0x7f519800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:01.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.936+0000 7f51b1573700 1 --2- 172.21.15.52:0/2907033124 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5198004850 0x7f5198004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:01.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.936+0000 7f51b1d74700 1 --2- 172.21.15.52:0/2907033124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5198003a00 0x7f5198003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:01.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.936+0000 7f51b2575700 1 -- 172.21.15.52:0/2907033124 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5198004850 msgr2=0x7f5198004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:01.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.936+0000 7f51b2575700 1 --2- 172.21.15.52:0/2907033124 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5198004850 0x7f5198004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.936+0000 7f51b2575700 1 -- 172.21.15.52:0/2907033124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5198003a00 msgr2=0x7f5198003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.936+0000 7f51b2575700 1 --2- 172.21.15.52:0/2907033124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5198003a00 0x7f5198003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.936+0000 7f51b2575700 1 -- 172.21.15.52:0/2907033124 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51980035b0 con 0x7f5198005320 2023-06-23T18:45:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.936+0000 7f51b1573700 1 --2- 172.21.15.52:0/2907033124 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5198004850 0x7f5198004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.936+0000 7f51b2575700 1 -- 172.21.15.52:0/2907033124 reap_dead start 2023-06-23T18:45:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.936+0000 7f51b2575700 1 --2- 172.21.15.52:0/2907033124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5198005320 0x7f519800ba10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f51a400c210 tx=0x7f5198005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db62639cc371ae5 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:01.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.936+0000 7f51b0d72700 1 -- 172.21.15.52:0/2907033124 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a4001df0 con 0x7f5198005320 2023-06-23T18:45:01.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.936+0000 7f51b0d72700 1 -- 172.21.15.52:0/2907033124 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a400cd70 con 0x7f5198005320 2023-06-23T18:45:01.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.936+0000 7f51b0d72700 1 -- 172.21.15.52:0/2907033124 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a4003c40 con 0x7f5198005320 2023-06-23T18:45:01.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.936+0000 7f51b3fd8700 1 -- 172.21.15.52:0/2907033124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5198005320 msgr2=0x7f519800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:01.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.936+0000 7f51b3fd8700 1 --2- 172.21.15.52:0/2907033124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5198005320 0x7f519800ba10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f51a400c210 tx=0x7f5198005880 comp rx=0 tx=0).stop 2023-06-23T18:45:01.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.937+0000 7f51b3fd8700 1 -- 172.21.15.52:0/2907033124 shutdown_connections 2023-06-23T18:45:01.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.937+0000 7f51b3fd8700 1 --2- 172.21.15.52:0/2907033124 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5198005320 0x7f519800ba10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.937+0000 7f51b3fd8700 1 -- 172.21.15.52:0/2907033124 >> 172.21.15.52:0/2907033124 conn(0x7f51ac0bd420 msgr2=0x7f51ac0bd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:01.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.937+0000 7f51b3fd8700 1 -- 172.21.15.52:0/2907033124 shutdown_connections 2023-06-23T18:45:01.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.937+0000 7f51b3fd8700 1 -- 172.21.15.52:0/2907033124 wait complete. 2023-06-23T18:45:01.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.938+0000 7f51b3fd8700 1 Processor -- start 2023-06-23T18:45:01.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.938+0000 7f51b3fd8700 1 -- start start 2023-06-23T18:45:01.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.938+0000 7f51b3fd8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5198005320 0x7f51ac136910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:01.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.938+0000 7f51b3fd8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51ac0bc530 0x7f51ac0bc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.938+0000 7f51b3fd8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51ac0bce70 0x7f51ac1cf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.938+0000 7f51b3fd8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac136e50 con 0x7f5198005320 2023-06-23T18:45:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.938+0000 7f51b3fd8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac0bb650 con 0x7f51ac0bc530 2023-06-23T18:45:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.938+0000 7f51b3fd8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac0bbae0 con 0x7f51ac0bce70 2023-06-23T18:45:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.938+0000 7f51b1d74700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5198005320 0x7f51ac136910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.938+0000 7f51b1d74700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5198005320 0x7f51ac136910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52338/0 (socket says 172.21.15.52:52338) 2023-06-23T18:45:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.938+0000 7f51b1d74700 1 -- 172.21.15.52:0/1531541257 learned_addr learned my addr 172.21.15.52:0/1531541257 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.938+0000 7f51b2575700 1 --2- 172.21.15.52:0/1531541257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51ac0bce70 0x7f51ac1cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.939+0000 7f51b1573700 1 --2- 172.21.15.52:0/1531541257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51ac0bc530 0x7f51ac0bc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.939+0000 7f51b1d74700 1 -- 172.21.15.52:0/1531541257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51ac0bce70 msgr2=0x7f51ac1cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.939+0000 7f51b1d74700 1 --2- 172.21.15.52:0/1531541257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51ac0bce70 0x7f51ac1cf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.939+0000 7f51b1d74700 1 -- 172.21.15.52:0/1531541257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51ac0bc530 msgr2=0x7f51ac0bc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.939+0000 7f51b1d74700 1 --2- 172.21.15.52:0/1531541257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51ac0bc530 0x7f51ac0bc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.939+0000 7f51b1d74700 1 -- 172.21.15.52:0/1531541257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac0bbcc0 con 0x7f5198005320 2023-06-23T18:45:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.939+0000 7f51b1d74700 1 --2- 172.21.15.52:0/1531541257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5198005320 0x7f51ac136910 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f51a8010a30 tx=0x7f51a8010d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:01.951 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.939+0000 7f51a27fc700 1 -- 172.21.15.52:0/1531541257 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8010ed0 con 0x7f5198005320 2023-06-23T18:45:01.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.939+0000 7f51a27fc700 1 -- 172.21.15.52:0/1531541257 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a800e870 con 0x7f5198005320 2023-06-23T18:45:01.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.939+0000 7f51a27fc700 1 -- 172.21.15.52:0/1531541257 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a800ebe0 con 0x7f5198005320 2023-06-23T18:45:01.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.939+0000 7f51b3fd8700 1 -- 172.21.15.52:0/1531541257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ac0bb320 con 0x7f5198005320 2023-06-23T18:45:01.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.939+0000 7f51b3fd8700 1 -- 172.21.15.52:0/1531541257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ac13d610 con 0x7f5198005320 2023-06-23T18:45:01.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.940+0000 7f51b3fd8700 1 -- 172.21.15.52:0/1531541257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ac04e1d0 con 0x7f5198005320 2023-06-23T18:45:01.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.941+0000 7f51a27fc700 1 -- 172.21.15.52:0/1531541257 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f51a800ed40 con 0x7f5198005320 2023-06-23T18:45:01.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.941+0000 7f51a27fc700 1 --2- 172.21.15.52:0/1531541257 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f519006ace0 0x7f519006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:01.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.941+0000 7f51a27fc700 1 -- 172.21.15.52:0/1531541257 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f51a8089c60 con 0x7f5198005320 2023-06-23T18:45:01.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.941+0000 7f51b1573700 1 --2- 172.21.15.52:0/1531541257 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f519006ace0 0x7f519006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:01.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.942+0000 7f51b1573700 1 --2- 172.21.15.52:0/1531541257 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f519006ace0 0x7f519006d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f51ac1d7ed0 tx=0x7f519c007040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:01.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:01.946+0000 7f51a27fc700 1 -- 172.21.15.52:0/1531541257 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f51a8054c80 con 0x7f5198005320 2023-06-23T18:45:02.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.141+0000 7f51b3fd8700 1 -- 172.21.15.52:0/1531541257 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f51ac070bd0 con 0x7f5198005320 2023-06-23T18:45:02.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.142+0000 7f51a27fc700 1 -- 172.21.15.52:0/1531541257 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f51a80240a0 con 0x7f5198005320 2023-06-23T18:45:02.147 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-06-23T18:45:02.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.144+0000 7f51b3fd8700 1 -- 172.21.15.52:0/1531541257 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f519006ace0 msgr2=0x7f519006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:02.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.144+0000 7f51b3fd8700 1 --2- 172.21.15.52:0/1531541257 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f519006ace0 0x7f519006d190 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f51ac1d7ed0 tx=0x7f519c007040 comp rx=0 tx=0).stop 2023-06-23T18:45:02.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.144+0000 7f51b3fd8700 1 -- 172.21.15.52:0/1531541257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5198005320 msgr2=0x7f51ac136910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:02.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.144+0000 7f51b3fd8700 1 --2- 172.21.15.52:0/1531541257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5198005320 0x7f51ac136910 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f51a8010a30 tx=0x7f51a8010d40 comp rx=0 tx=0).stop 2023-06-23T18:45:02.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.144+0000 7f51b3fd8700 1 -- 172.21.15.52:0/1531541257 shutdown_connections 2023-06-23T18:45:02.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.144+0000 7f51b3fd8700 1 --2- 172.21.15.52:0/1531541257 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f519006ace0 0x7f519006d190 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:02.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.144+0000 7f51b3fd8700 1 --2- 172.21.15.52:0/1531541257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51ac0bce70 0x7f51ac1cf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:02.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.144+0000 7f51b3fd8700 1 --2- 172.21.15.52:0/1531541257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5198005320 0x7f51ac136910 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:02.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.144+0000 7f51b3fd8700 1 --2- 172.21.15.52:0/1531541257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51ac0bc530 0x7f51ac0bc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:02.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.144+0000 7f51b3fd8700 1 -- 172.21.15.52:0/1531541257 >> 172.21.15.52:0/1531541257 conn(0x7f51ac0bd420 msgr2=0x7f51ac06a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:02.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.144+0000 7f51b3fd8700 1 -- 172.21.15.52:0/1531541257 shutdown_connections 2023-06-23T18:45:02.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.144+0000 7f51b3fd8700 1 -- 172.21.15.52:0/1531541257 wait complete. 2023-06-23T18:45:02.161 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T18:45:02.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.281+0000 7efe49d9f700 1 Processor -- start 2023-06-23T18:45:02.286 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.281+0000 7efe49d9f700 1 -- start start 2023-06-23T18:45:02.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.281+0000 7efe49d9f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efe4406a0d0 0x7efe440bc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:02.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.281+0000 7efe49d9f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efe441444a0 0x7efe440b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:02.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.281+0000 7efe49d9f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe440b7aa0 con 0x7efe440b5a20 2023-06-23T18:45:02.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.281+0000 7efe49d9f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe440b5f30 con 0x7efe441444a0 2023-06-23T18:45:02.287 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.281+0000 7efe49d9f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe440b6210 con 0x7efe4406a0d0 2023-06-23T18:45:02.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.282+0000 7efe42ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7efe441444a0 0x7efe440b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:02.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.282+0000 7efe43fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7efe440b5a20 0x7efe440bb020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44928/0 (socket says 172.21.15.52:44928) 2023-06-23T18:45:02.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.282+0000 7efe43fff700 1 -- 172.21.15.52:0/2568668544 learned_addr learned my addr 172.21.15.52:0/2568668544 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:02.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.282+0000 7efe437fe700 1 --2- 172.21.15.52:0/2568668544 >> v2:172.21.15.89:3300/0 conn(0x7efe4406a0d0 0x7efe440bc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:02.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.282+0000 7efe42ffd700 1 -- 172.21.15.52:0/2568668544 >> v2:172.21.15.89:3300/0 conn(0x7efe4406a0d0 msgr2=0x7efe440bc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:02.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.282+0000 7efe42ffd700 1 --2- 172.21.15.52:0/2568668544 >> v2:172.21.15.89:3300/0 conn(0x7efe4406a0d0 0x7efe440bc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:02.288 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.282+0000 7efe42ffd700 1 -- 172.21.15.52:0/2568668544 >> v1:172.21.15.52:6789/0 conn(0x7efe440b5a20 legacy=0x7efe440bb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:02.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.282+0000 7efe42ffd700 1 -- 172.21.15.52:0/2568668544 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe440b64f0 con 0x7efe441444a0 2023-06-23T18:45:02.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.282+0000 7efe427fc700 1 -- 172.21.15.52:0/2568668544 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703096196 0 0) 0x7efe440b7aa0 con 0x7efe440b5a20 2023-06-23T18:45:02.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.282+0000 7efe42ffd700 1 --2- 172.21.15.52:0/2568668544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe441444a0 0x7efe440b54e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efe4408a170 tx=0x7efe38009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80395b796a65ab0b server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:02.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.282+0000 7efe427fc700 1 -- 172.21.15.52:0/2568668544 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe38011830 con 0x7efe441444a0 2023-06-23T18:45:02.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.282+0000 7efe427fc700 1 -- 172.21.15.52:0/2568668544 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe38011990 con 0x7efe441444a0 2023-06-23T18:45:02.289 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.282+0000 7efe427fc700 1 -- 172.21.15.52:0/2568668544 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe38011d20 con 0x7efe441444a0 2023-06-23T18:45:02.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.283+0000 7efe49d9f700 1 -- 172.21.15.52:0/2568668544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe441444a0 msgr2=0x7efe440b54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:02.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.283+0000 7efe49d9f700 1 --2- 172.21.15.52:0/2568668544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe441444a0 0x7efe440b54e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efe4408a170 tx=0x7efe38009b20 comp rx=0 tx=0).stop 2023-06-23T18:45:02.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.283+0000 7efe49d9f700 1 -- 172.21.15.52:0/2568668544 shutdown_connections 2023-06-23T18:45:02.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.283+0000 7efe49d9f700 1 --2- 172.21.15.52:0/2568668544 >> v2:172.21.15.89:3300/0 conn(0x7efe4406a0d0 0x7efe440bc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:02.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.283+0000 7efe49d9f700 1 --2- 172.21.15.52:0/2568668544 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe441444a0 0x7efe440b54e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:02.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.283+0000 7efe49d9f700 1 -- 172.21.15.52:0/2568668544 >> 172.21.15.52:0/2568668544 conn(0x7efe4406bb90 msgr2=0x7efe4406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:02.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.283+0000 7efe49d9f700 1 -- 172.21.15.52:0/2568668544 shutdown_connections 2023-06-23T18:45:02.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.283+0000 7efe49d9f700 1 -- 172.21.15.52:0/2568668544 wait complete. 2023-06-23T18:45:02.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.284+0000 7efe49d9f700 1 Processor -- start 2023-06-23T18:45:02.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.284+0000 7efe49d9f700 1 -- start start 2023-06-23T18:45:02.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.285+0000 7efe49d9f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe4406a0d0 0x7efe440b8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:02.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.285+0000 7efe49d9f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe440b5a20 0x7efe441d1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:02.293 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.285+0000 7efe49d9f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe441444a0 0x7efe441d2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:02.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.285+0000 7efe49d9f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe440b9120 con 0x7efe4406a0d0 2023-06-23T18:45:02.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.285+0000 7efe49d9f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe441d1610 con 0x7efe440b5a20 2023-06-23T18:45:02.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.285+0000 7efe49d9f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe441d18b0 con 0x7efe441444a0 2023-06-23T18:45:02.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.285+0000 7efe437fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe4406a0d0 0x7efe440b8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:02.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.285+0000 7efe437fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe4406a0d0 0x7efe440b8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52346/0 (socket says 172.21.15.52:52346) 2023-06-23T18:45:02.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.285+0000 7efe437fe700 1 -- 172.21.15.52:0/1003491306 learned_addr learned my addr 172.21.15.52:0/1003491306 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:02.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.285+0000 7efe42ffd700 1 --2- 172.21.15.52:0/1003491306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe440b5a20 0x7efe441d1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:02.294 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.285+0000 7efe43fff700 1 --2- 172.21.15.52:0/1003491306 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe441444a0 0x7efe441d2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:02.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.285+0000 7efe437fe700 1 -- 172.21.15.52:0/1003491306 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe441444a0 msgr2=0x7efe441d2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:02.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.285+0000 7efe437fe700 1 --2- 172.21.15.52:0/1003491306 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe441444a0 0x7efe441d2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:02.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.285+0000 7efe437fe700 1 -- 172.21.15.52:0/1003491306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe440b5a20 msgr2=0x7efe441d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:02.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.285+0000 7efe437fe700 1 --2- 172.21.15.52:0/1003491306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe440b5a20 0x7efe441d1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:02.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.285+0000 7efe437fe700 1 -- 172.21.15.52:0/1003491306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe380094a0 con 0x7efe4406a0d0 2023-06-23T18:45:02.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.285+0000 7efe437fe700 1 --2- 172.21.15.52:0/1003491306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe4406a0d0 0x7efe440b8be0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efe3400e9e0 tx=0x7efe3400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:02.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.285+0000 7efe2bfff700 1 -- 172.21.15.52:0/1003491306 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe34009710 con 0x7efe4406a0d0 2023-06-23T18:45:02.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.285+0000 7efe2bfff700 1 -- 172.21.15.52:0/1003491306 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3400ee80 con 0x7efe4406a0d0 2023-06-23T18:45:02.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.285+0000 7efe49d9f700 1 -- 172.21.15.52:0/1003491306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe441432d0 con 0x7efe4406a0d0 2023-06-23T18:45:02.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.285+0000 7efe2bfff700 1 -- 172.21.15.52:0/1003491306 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3400ca50 con 0x7efe4406a0d0 2023-06-23T18:45:02.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.286+0000 7efe49d9f700 1 -- 172.21.15.52:0/1003491306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe44140e60 con 0x7efe4406a0d0 2023-06-23T18:45:02.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.286+0000 7efe49d9f700 1 -- 172.21.15.52:0/1003491306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe4404e1d0 con 0x7efe4406a0d0 2023-06-23T18:45:02.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.287+0000 7efe2bfff700 1 -- 172.21.15.52:0/1003491306 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efe3400cbb0 con 0x7efe4406a0d0 2023-06-23T18:45:02.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.287+0000 7efe2bfff700 1 --2- 172.21.15.52:0/1003491306 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7efe3006ace0 0x7efe3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:02.296 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.287+0000 7efe2bfff700 1 -- 172.21.15.52:0/1003491306 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efe34089430 con 0x7efe4406a0d0 2023-06-23T18:45:02.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.287+0000 7efe42ffd700 1 --2- 172.21.15.52:0/1003491306 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7efe3006ace0 0x7efe3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:02.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.288+0000 7efe42ffd700 1 --2- 172.21.15.52:0/1003491306 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7efe3006ace0 0x7efe3006d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efe380090b0 tx=0x7efe38008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:02.297 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.292+0000 7efe2bfff700 1 -- 172.21.15.52:0/1003491306 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efe34057f60 con 0x7efe4406a0d0 2023-06-23T18:45:02.534 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.530+0000 7efe49d9f700 1 -- 172.21.15.52:0/1003491306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe44148a80 con 0x7efe4406a0d0 2023-06-23T18:45:02.535 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.530+0000 7efe2bfff700 1 -- 172.21.15.52:0/1003491306 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3906 (secure 0 0 0) 0x7efe34057af0 con 0x7efe4406a0d0 2023-06-23T18:45:02.535 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:02.535 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/299877491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":299877491},{"type":"v1","addr":"172.21.15.89:6835","nonce":299877491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/2826461143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2826461143},{"type":"v1","addr":"172.21.15.52:6833","nonce":2826461143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T18:44:50.642376+0000","modified":"2023-06-23T18:44:53.679243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/4214822260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4214822260},{"type":"v1","addr":"172.21.15.52:6835","nonce":4214822260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-23T18:45:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.532+0000 7efe49d9f700 1 -- 172.21.15.52:0/1003491306 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7efe3006ace0 msgr2=0x7efe3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.532+0000 7efe49d9f700 1 --2- 172.21.15.52:0/1003491306 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7efe3006ace0 0x7efe3006d190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efe380090b0 tx=0x7efe38008030 comp rx=0 tx=0).stop 2023-06-23T18:45:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.532+0000 7efe49d9f700 1 -- 172.21.15.52:0/1003491306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe4406a0d0 msgr2=0x7efe440b8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:02.537 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.532+0000 7efe49d9f700 1 --2- 172.21.15.52:0/1003491306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe4406a0d0 0x7efe440b8be0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efe3400e9e0 tx=0x7efe3400ecf0 comp rx=0 tx=0).stop 2023-06-23T18:45:02.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.532+0000 7efe49d9f700 1 -- 172.21.15.52:0/1003491306 shutdown_connections 2023-06-23T18:45:02.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.532+0000 7efe49d9f700 1 --2- 172.21.15.52:0/1003491306 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7efe3006ace0 0x7efe3006d190 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:02.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.532+0000 7efe49d9f700 1 --2- 172.21.15.52:0/1003491306 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe441444a0 0x7efe441d2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:02.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.532+0000 7efe49d9f700 1 --2- 172.21.15.52:0/1003491306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efe4406a0d0 0x7efe440b8be0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:02.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.532+0000 7efe49d9f700 1 --2- 172.21.15.52:0/1003491306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe440b5a20 0x7efe441d1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:02.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.532+0000 7efe49d9f700 1 -- 172.21.15.52:0/1003491306 >> 172.21.15.52:0/1003491306 conn(0x7efe4406bb90 msgr2=0x7efe440bf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:02.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.532+0000 7efe49d9f700 1 -- 172.21.15.52:0/1003491306 shutdown_connections 2023-06-23T18:45:02.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.532+0000 7efe49d9f700 1 -- 172.21.15.52:0/1003491306 wait complete. 2023-06-23T18:45:02.539 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2023-06-23T18:45:02.549 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:45:02.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.668+0000 7f4a25534700 1 Processor -- start 2023-06-23T18:45:02.673 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.668+0000 7f4a25534700 1 -- start start 2023-06-23T18:45:02.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.669+0000 7f4a25534700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a2006a0d0 0x7f4a200bc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:02.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.669+0000 7f4a25534700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4a200b6930 0x7f4a20147b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:02.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.669+0000 7f4a25534700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a200b64a0 con 0x7f4a200b7540 2023-06-23T18:45:02.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.669+0000 7f4a25534700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a200b7d90 con 0x7f4a200b6930 2023-06-23T18:45:02.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.669+0000 7f4a25534700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200b55a0 con 0x7f4a2006a0d0 2023-06-23T18:45:02.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.669+0000 7f4a1f7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4a200b6930 0x7f4a20147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:02.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.669+0000 7f4a1f7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4a200b6930 0x7f4a20147b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52358/0 (socket says 172.21.15.52:52358) 2023-06-23T18:45:02.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.669+0000 7f4a1f7fe700 1 -- 172.21.15.52:0/1126249152 learned_addr learned my addr 172.21.15.52:0/1126249152 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:02.676 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.669+0000 7f4a1effd700 1 --2- 172.21.15.52:0/1126249152 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a2006a0d0 0x7f4a200bc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:02.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.670+0000 7f4a1f7fe700 1 -- 172.21.15.52:0/1126249152 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a2006a0d0 msgr2=0x7f4a200bc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:02.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.670+0000 7f4a1f7fe700 1 --2- 172.21.15.52:0/1126249152 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a2006a0d0 0x7f4a200bc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:02.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.670+0000 7f4a1f7fe700 1 -- 172.21.15.52:0/1126249152 >> v1:172.21.15.89:6789/0 conn(0x7f4a200b7540 legacy=0x7f4a2014de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:02.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.670+0000 7f4a1f7fe700 1 -- 172.21.15.52:0/1126249152 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a200b5880 con 0x7f4a200b6930 2023-06-23T18:45:02.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.670+0000 7f4a1f7fe700 1 --2- 172.21.15.52:0/1126249152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a200b6930 0x7f4a20147b50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009e50 tx=0x7f4a1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97eaaa4ffefe927f server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:02.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.670+0000 7f4a1dffb700 1 -- 172.21.15.52:0/1126249152 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1800e070 con 0x7f4a200b6930 2023-06-23T18:45:02.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.670+0000 7f4a1dffb700 1 -- 172.21.15.52:0/1126249152 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1800b9c0 con 0x7f4a200b6930 2023-06-23T18:45:02.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.670+0000 7f4a1dffb700 1 -- 172.21.15.52:0/1126249152 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1800bd70 con 0x7f4a200b6930 2023-06-23T18:45:02.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.670+0000 7f4a25534700 1 -- 172.21.15.52:0/1126249152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a200b6930 msgr2=0x7f4a20147b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:02.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.670+0000 7f4a25534700 1 --2- 172.21.15.52:0/1126249152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a200b6930 0x7f4a20147b50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009e50 tx=0x7f4a1800b330 comp rx=0 tx=0).stop 2023-06-23T18:45:02.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.670+0000 7f4a25534700 1 -- 172.21.15.52:0/1126249152 shutdown_connections 2023-06-23T18:45:02.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.670+0000 7f4a25534700 1 --2- 172.21.15.52:0/1126249152 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a200b6930 0x7f4a20147b50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:02.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.670+0000 7f4a25534700 1 --2- 172.21.15.52:0/1126249152 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a2006a0d0 0x7f4a200bc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:02.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.670+0000 7f4a25534700 1 -- 172.21.15.52:0/1126249152 >> 172.21.15.52:0/1126249152 conn(0x7f4a2006bb20 msgr2=0x7f4a2006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:02.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.671+0000 7f4a25534700 1 -- 172.21.15.52:0/1126249152 shutdown_connections 2023-06-23T18:45:02.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.671+0000 7f4a25534700 1 -- 172.21.15.52:0/1126249152 wait complete. 2023-06-23T18:45:02.680 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.672+0000 7f4a25534700 1 Processor -- start 2023-06-23T18:45:02.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.672+0000 7f4a25534700 1 -- start start 2023-06-23T18:45:02.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.672+0000 7f4a25534700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a2006a0d0 0x7f4a201d72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:02.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.672+0000 7f4a25534700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a200b6930 0x7f4a2014ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:02.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.672+0000 7f4a25534700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a200b7540 0x7f4a201e3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:02.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.672+0000 7f4a25534700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a201d77e0 con 0x7f4a200b7540 2023-06-23T18:45:02.681 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.672+0000 7f4a25534700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200ba0a0 con 0x7f4a2006a0d0 2023-06-23T18:45:02.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.672+0000 7f4a25534700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200ba2f0 con 0x7f4a200b6930 2023-06-23T18:45:02.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.672+0000 7f4a1f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a200b7540 0x7f4a201e3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:02.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.673+0000 7f4a1f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a200b7540 0x7f4a201e3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52366/0 (socket says 172.21.15.52:52366) 2023-06-23T18:45:02.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.673+0000 7f4a1f7fe700 1 -- 172.21.15.52:0/2474405475 learned_addr learned my addr 172.21.15.52:0/2474405475 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:02.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.673+0000 7f4a1e7fc700 1 --2- 172.21.15.52:0/2474405475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a200b6930 0x7f4a2014ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:02.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.673+0000 7f4a1effd700 1 --2- 172.21.15.52:0/2474405475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a2006a0d0 0x7f4a201d72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:02.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.673+0000 7f4a1f7fe700 1 -- 172.21.15.52:0/2474405475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a200b6930 msgr2=0x7f4a2014ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:02.682 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.673+0000 7f4a1f7fe700 1 --2- 172.21.15.52:0/2474405475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a200b6930 0x7f4a2014ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:02.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.673+0000 7f4a1f7fe700 1 -- 172.21.15.52:0/2474405475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a2006a0d0 msgr2=0x7f4a201d72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:02.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.673+0000 7f4a1f7fe700 1 --2- 172.21.15.52:0/2474405475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a2006a0d0 0x7f4a201d72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:02.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.673+0000 7f4a1f7fe700 1 -- 172.21.15.52:0/2474405475 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a18009b30 con 0x7f4a200b7540 2023-06-23T18:45:02.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.673+0000 7f4a1f7fe700 1 --2- 172.21.15.52:0/2474405475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a200b7540 0x7f4a201e3cb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800b730 tx=0x7f4a18004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:02.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.673+0000 7f4a177fe700 1 -- 172.21.15.52:0/2474405475 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18004830 con 0x7f4a200b7540 2023-06-23T18:45:02.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.673+0000 7f4a177fe700 1 -- 172.21.15.52:0/2474405475 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a180099b0 con 0x7f4a200b7540 2023-06-23T18:45:02.683 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.673+0000 7f4a25534700 1 -- 172.21.15.52:0/2474405475 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a200b5ce0 con 0x7f4a200b7540 2023-06-23T18:45:02.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.673+0000 7f4a177fe700 1 -- 172.21.15.52:0/2474405475 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1801c680 con 0x7f4a200b7540 2023-06-23T18:45:02.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.673+0000 7f4a25534700 1 -- 172.21.15.52:0/2474405475 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a200b93f0 con 0x7f4a200b7540 2023-06-23T18:45:02.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.674+0000 7f4a25534700 1 -- 172.21.15.52:0/2474405475 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a200a6800 con 0x7f4a200b7540 2023-06-23T18:45:02.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.674+0000 7f4a177fe700 1 -- 172.21.15.52:0/2474405475 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4a1801c7e0 con 0x7f4a200b7540 2023-06-23T18:45:02.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.675+0000 7f4a177fe700 1 --2- 172.21.15.52:0/2474405475 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f4a0006ace0 0x7f4a0006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:02.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.675+0000 7f4a177fe700 1 -- 172.21.15.52:0/2474405475 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4a1808afe0 con 0x7f4a200b7540 2023-06-23T18:45:02.684 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.675+0000 7f4a1effd700 1 --2- 172.21.15.52:0/2474405475 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f4a0006ace0 0x7f4a0006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:02.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.675+0000 7f4a1effd700 1 --2- 172.21.15.52:0/2474405475 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f4a0006ace0 0x7f4a0006d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4a10006b20 tx=0x7f4a10008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:02.685 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.679+0000 7f4a177fe700 1 -- 172.21.15.52:0/2474405475 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4a18056120 con 0x7f4a200b7540 2023-06-23T18:45:02.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.877+0000 7f4a25534700 1 -- 172.21.15.52:0/2474405475 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a2004e1d0 con 0x7f4a200b7540 2023-06-23T18:45:02.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.878+0000 7f4a177fe700 1 -- 172.21.15.52:0/2474405475 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7f4a18059740 con 0x7f4a200b7540 2023-06-23T18:45:02.883 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:02.884 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","created":"2023-06-23T18:44:31.918434+0000","modified":"2023-06-23T18:44:51.644330+0000","last_up_change":"2023-06-23T18:44:42.169624+0000","last_in_change":"2023-06-23T18:44:34.510501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-23T18:44:43.346578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-23T18:44:43.829719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:44:48.517897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:44:49.621134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c371fb28-1b15-4e43-8d5a-43e402920ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6812","nonce":1066999520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6815","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6818","nonce":1066999520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6829","nonce":1066999520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6823","nonce":1066999520}]},"public_addr":"172.21.15.52:6812/1066999520","cluster_addr":"172.21.15.52:6818/1066999520","heartbeat_back_addr":"172.21.15.52:6829/1066999520","heartbeat_front_addr":"172.21.15.52:6823/1066999520","state":["exists","up"]},{"osd":1,"uuid":"4a142f04-33eb-47ec-9cc5-b08b44d82658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6813","nonce":2360219751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6819","nonce":2360219751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6830","nonce":2360219751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6825","nonce":2360219751}]},"public_addr":"172.21.15.52:6813/2360219751","cluster_addr":"172.21.15.52:6819/2360219751","heartbeat_back_addr":"172.21.15.52:6830/2360219751","heartbeat_front_addr":"172.21.15.52:6825/2360219751","state":["exists","up"]},{"osd":2,"uuid":"d7bb089d-4c55-4370-ba59-7fe88c39512a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6801","nonce":835073005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6803","nonce":835073005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6807","nonce":835073005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6805","nonce":835073005}]},"public_addr":"172.21.15.52:6801/835073005","cluster_addr":"172.21.15.52:6803/835073005","heartbeat_back_addr":"172.21.15.52:6807/835073005","heartbeat_front_addr":"172.21.15.52:6805/835073005","state":["exists","up"]},{"osd":3,"uuid":"4bcdcdc3-6a8f-468e-877e-57f76079ac3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6811","nonce":2852700864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6817","nonce":2852700864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6831","nonce":2852700864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6824","nonce":2852700864}]},"public_addr":"172.21.15.52:6811/2852700864","cluster_addr":"172.21.15.52:6817/2852700864","heartbeat_back_addr":"172.21.15.52:6831/2852700864","heartbeat_front_addr":"172.21.15.52:6824/2852700864","state":["exists","up"]},{"osd":4,"uuid":"cac63000-ae94-4b08-93e6-a99119640b63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6809","nonce":2538664679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6811","nonce":2538664679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6815","nonce":2538664679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6813","nonce":2538664679}]},"public_addr":"172.21.15.89:6809/2538664679","cluster_addr":"172.21.15.89:6811/2538664679","heartbeat_back_addr":"172.21.15.89:6815/2538664679","heartbeat_front_addr":"172.21.15.89:6813/2538664679","state":["exists","up"]},{"osd":5,"uuid":"45c53102-18a6-4fd7-9c25-8ea5e1ef6851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6801","nonce":1683710352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6803","nonce":1683710352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6807","nonce":1683710352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6805","nonce":1683710352}]},"public_addr":"172.21.15.89:6801/1683710352","cluster_addr":"172.21.15.89:6803/1683710352","heartbeat_back_addr":"172.21.15.89:6807/1683710352","heartbeat_front_addr":"172.21.15.89:6805/1683710352","state":["exists","up"]},{"osd":6,"uuid":"abee09d1-8eba-484f-a25c-871c1fe2e843","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6817","nonce":3890899288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6819","nonce":3890899288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6823","nonce":3890899288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6821","nonce":3890899288}]},"public_addr":"172.21.15.89:6817/3890899288","cluster_addr":"172.21.15.89:6819/3890899288","heartbeat_back_addr":"172.21.15.89:6823/3890899288","heartbeat_front_addr":"172.21.15.89:6821/3890899288","state":["exists","up"]},{"osd":7,"uuid":"5acf9e2e-00dd-4f9b-a7d9-3d820f695de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6825","nonce":2989085420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6827","nonce":2989085420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6831","nonce":2989085420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6829","nonce":2989085420}]},"public_addr":"172.21.15.89:6825/2989085420","cluster_addr":"172.21.15.89:6827/2989085420","heartbeat_back_addr":"172.21.15.89:6831/2989085420","heartbeat_front_addr":"172.21.15.89:6829/2989085420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.663866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.710904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.619347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.660102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.686933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.724635+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.669111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.678740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:45:02.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.880+0000 7f4a25534700 1 -- 172.21.15.52:0/2474405475 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f4a0006ace0 msgr2=0x7f4a0006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:02.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.880+0000 7f4a25534700 1 --2- 172.21.15.52:0/2474405475 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f4a0006ace0 0x7f4a0006d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4a10006b20 tx=0x7f4a10008040 comp rx=0 tx=0).stop 2023-06-23T18:45:02.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.880+0000 7f4a25534700 1 -- 172.21.15.52:0/2474405475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a200b7540 msgr2=0x7f4a201e3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:02.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.880+0000 7f4a25534700 1 --2- 172.21.15.52:0/2474405475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a200b7540 0x7f4a201e3cb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800b730 tx=0x7f4a18004ad0 comp rx=0 tx=0).stop 2023-06-23T18:45:02.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.880+0000 7f4a25534700 1 -- 172.21.15.52:0/2474405475 shutdown_connections 2023-06-23T18:45:02.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.880+0000 7f4a25534700 1 --2- 172.21.15.52:0/2474405475 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f4a0006ace0 0x7f4a0006d190 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:02.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.880+0000 7f4a25534700 1 --2- 172.21.15.52:0/2474405475 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4a200b7540 0x7f4a201e3cb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:02.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.880+0000 7f4a25534700 1 --2- 172.21.15.52:0/2474405475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a2006a0d0 0x7f4a201d72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:02.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.880+0000 7f4a25534700 1 --2- 172.21.15.52:0/2474405475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a200b6930 0x7f4a2014ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:02.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.880+0000 7f4a25534700 1 -- 172.21.15.52:0/2474405475 >> 172.21.15.52:0/2474405475 conn(0x7f4a2006bb20 msgr2=0x7f4a20145400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:02.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.880+0000 7f4a25534700 1 -- 172.21.15.52:0/2474405475 shutdown_connections 2023-06-23T18:45:02.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:02.880+0000 7f4a25534700 1 -- 172.21.15.52:0/2474405475 wait complete. 2023-06-23T18:45:02.897 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-23T18:44:43.346578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-23T18:44:43.829719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T18:44:48.517897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T18:44:49.621134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-23T18:45:02.898 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T18:45:03.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.022+0000 7f8939e89700 1 Processor -- start 2023-06-23T18:45:03.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.022+0000 7f8939e89700 1 -- start start 2023-06-23T18:45:03.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.023+0000 7f8939e89700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f89340b9170 0x7f893406cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:03.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.023+0000 7f8939e89700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f893414a680 con 0x7f89340be470 2023-06-23T18:45:03.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.023+0000 7f8939e89700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f893406cff0 con 0x7f89340be840 2023-06-23T18:45:03.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.023+0000 7f8939e89700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f893406b6c0 con 0x7f89340b9170 2023-06-23T18:45:03.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.023+0000 7f89337fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f89340be470 0x7f893414b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44936/0 (socket says 172.21.15.52:44936) 2023-06-23T18:45:03.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.023+0000 7f89337fe700 1 -- 172.21.15.52:0/1782093514 learned_addr learned my addr 172.21.15.52:0/1782093514 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:03.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.023+0000 7f8932ffd700 1 --2- 172.21.15.52:0/1782093514 >> v2:172.21.15.89:3300/0 conn(0x7f89340b9170 0x7f893406cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:03.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.023+0000 7f89327fc700 1 -- 172.21.15.52:0/1782093514 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1476182224 0 0) 0x7f893414a680 con 0x7f89340be470 2023-06-23T18:45:03.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.023+0000 7f89327fc700 1 -- 172.21.15.52:0/1782093514 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f891c0035b0 con 0x7f89340be470 2023-06-23T18:45:03.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.023+0000 7f89327fc700 1 -- 172.21.15.52:0/1782093514 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 472629898 0 0) 0x7f891c0035b0 con 0x7f89340be470 2023-06-23T18:45:03.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.023+0000 7f89327fc700 1 -- 172.21.15.52:0/1782093514 >> v2:172.21.15.89:3300/0 conn(0x7f89340b9170 msgr2=0x7f893406cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:03.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.023+0000 7f89327fc700 1 --2- 172.21.15.52:0/1782093514 >> v2:172.21.15.89:3300/0 conn(0x7f89340b9170 0x7f893406cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.023+0000 7f89327fc700 1 -- 172.21.15.52:0/1782093514 >> v1:172.21.15.89:6789/0 conn(0x7f89340be840 legacy=0x7f8934154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:03.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.023+0000 7f89327fc700 1 -- 172.21.15.52:0/1782093514 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893406b3e0 con 0x7f89340be470 2023-06-23T18:45:03.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.023+0000 7f89327fc700 1 -- 172.21.15.52:0/1782093514 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7f8928001670 con 0x7f89340be470 2023-06-23T18:45:03.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.023+0000 7f89327fc700 1 -- 172.21.15.52:0/1782093514 >> v1:172.21.15.52:6789/0 conn(0x7f89340be470 legacy=0x7f893414b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:03.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.023+0000 7f89327fc700 1 --2- 172.21.15.52:0/1782093514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f891c003a00 0x7f891c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:03.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.023+0000 7f89327fc700 1 --2- 172.21.15.52:0/1782093514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f891c004850 0x7f891c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:03.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.023+0000 7f89327fc700 1 --2- 172.21.15.52:0/1782093514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f891c005200 0x7f891c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:03.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.024+0000 7f89327fc700 1 -- 172.21.15.52:0/1782093514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893406b6c0 con 0x7f891c003a00 2023-06-23T18:45:03.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.024+0000 7f89327fc700 1 -- 172.21.15.52:0/1782093514 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891c00c080 con 0x7f891c005200 2023-06-23T18:45:03.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.024+0000 7f89327fc700 1 -- 172.21.15.52:0/1782093514 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891c00c240 con 0x7f891c004850 2023-06-23T18:45:03.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.024+0000 7f89337fe700 1 --2- 172.21.15.52:0/1782093514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f891c003a00 0x7f891c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:03.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.024+0000 7f8933fff700 1 --2- 172.21.15.52:0/1782093514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f891c005200 0x7f891c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:03.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.024+0000 7f8932ffd700 1 --2- 172.21.15.52:0/1782093514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f891c004850 0x7f891c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:03.033 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.024+0000 7f89337fe700 1 -- 172.21.15.52:0/1782093514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f891c004850 msgr2=0x7f891c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:03.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.024+0000 7f89337fe700 1 --2- 172.21.15.52:0/1782093514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f891c004850 0x7f891c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.024+0000 7f89337fe700 1 -- 172.21.15.52:0/1782093514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f891c005200 msgr2=0x7f891c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:03.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.024+0000 7f89337fe700 1 --2- 172.21.15.52:0/1782093514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f891c005200 0x7f891c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.024+0000 7f89337fe700 1 -- 172.21.15.52:0/1782093514 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891c0035b0 con 0x7f891c003a00 2023-06-23T18:45:03.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.024+0000 7f8933fff700 1 -- 172.21.15.52:0/1782093514 reap_dead start 2023-06-23T18:45:03.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.024+0000 7f89337fe700 1 --2- 172.21.15.52:0/1782093514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f891c003a00 0x7f891c003e10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f892800c240 tx=0x7f891c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dad3259b4d7094c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:03.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.024+0000 7f89327fc700 1 -- 172.21.15.52:0/1782093514 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8928007c10 con 0x7f891c003a00 2023-06-23T18:45:03.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.024+0000 7f89327fc700 1 -- 172.21.15.52:0/1782093514 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892800cde0 con 0x7f891c003a00 2023-06-23T18:45:03.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.024+0000 7f89327fc700 1 -- 172.21.15.52:0/1782093514 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8928005ba0 con 0x7f891c003a00 2023-06-23T18:45:03.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.025+0000 7f8939e89700 1 -- 172.21.15.52:0/1782093514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f891c003a00 msgr2=0x7f891c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:03.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.025+0000 7f8939e89700 1 --2- 172.21.15.52:0/1782093514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f891c003a00 0x7f891c003e10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f892800c240 tx=0x7f891c005880 comp rx=0 tx=0).stop 2023-06-23T18:45:03.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.025+0000 7f8939e89700 1 -- 172.21.15.52:0/1782093514 shutdown_connections 2023-06-23T18:45:03.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.025+0000 7f8939e89700 1 --2- 172.21.15.52:0/1782093514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f891c003a00 0x7f891c003e10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.025+0000 7f8939e89700 1 -- 172.21.15.52:0/1782093514 >> 172.21.15.52:0/1782093514 conn(0x7f8934071410 msgr2=0x7f8934071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:03.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.025+0000 7f8939e89700 1 -- 172.21.15.52:0/1782093514 shutdown_connections 2023-06-23T18:45:03.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.025+0000 7f8939e89700 1 -- 172.21.15.52:0/1782093514 wait complete. 2023-06-23T18:45:03.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.026+0000 7f8939e89700 1 Processor -- start 2023-06-23T18:45:03.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.026+0000 7f8939e89700 1 -- start start 2023-06-23T18:45:03.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.027+0000 7f8939e89700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f891c003a00 0x7f8934148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:03.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.027+0000 7f8939e89700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f893413b2b0 0x7f89340b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:03.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.027+0000 7f8939e89700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89341dfa70 0x7f89341e2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:03.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.027+0000 7f8939e89700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89341d78e0 con 0x7f893413b2b0 2023-06-23T18:45:03.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.027+0000 7f8939e89700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89341e0440 con 0x7f89341dfa70 2023-06-23T18:45:03.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.027+0000 7f8939e89700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89341d6cd0 con 0x7f891c003a00 2023-06-23T18:45:03.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.027+0000 7f8932ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f893413b2b0 0x7f89340b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:03.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.027+0000 7f8932ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f893413b2b0 0x7f89340b6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52386/0 (socket says 172.21.15.52:52386) 2023-06-23T18:45:03.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.027+0000 7f8932ffd700 1 -- 172.21.15.52:0/1156230339 learned_addr learned my addr 172.21.15.52:0/1156230339 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:03.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.027+0000 7f8933fff700 1 --2- 172.21.15.52:0/1156230339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89341dfa70 0x7f89341e2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:03.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.027+0000 7f89337fe700 1 --2- 172.21.15.52:0/1156230339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f891c003a00 0x7f8934148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:03.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.027+0000 7f8932ffd700 1 -- 172.21.15.52:0/1156230339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f891c003a00 msgr2=0x7f8934148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:03.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.027+0000 7f8932ffd700 1 --2- 172.21.15.52:0/1156230339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f891c003a00 0x7f8934148d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.027+0000 7f8932ffd700 1 -- 172.21.15.52:0/1156230339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89341dfa70 msgr2=0x7f89341e2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:03.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.027+0000 7f8932ffd700 1 --2- 172.21.15.52:0/1156230339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89341dfa70 0x7f89341e2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.027+0000 7f8932ffd700 1 -- 172.21.15.52:0/1156230339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89341d6fb0 con 0x7f893413b2b0 2023-06-23T18:45:03.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.027+0000 7f8932ffd700 1 --2- 172.21.15.52:0/1156230339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f893413b2b0 0x7f89340b6f40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8924011aa0 tx=0x7f8924011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:03.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.027+0000 7f891bfff700 1 -- 172.21.15.52:0/1156230339 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892400f940 con 0x7f893413b2b0 2023-06-23T18:45:03.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.027+0000 7f891bfff700 1 -- 172.21.15.52:0/1156230339 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892400faa0 con 0x7f893413b2b0 2023-06-23T18:45:03.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.027+0000 7f8939e89700 1 -- 172.21.15.52:0/1156230339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89341d7290 con 0x7f893413b2b0 2023-06-23T18:45:03.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.027+0000 7f891bfff700 1 -- 172.21.15.52:0/1156230339 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892400fe50 con 0x7f893413b2b0 2023-06-23T18:45:03.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.028+0000 7f8939e89700 1 -- 172.21.15.52:0/1156230339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8934142da0 con 0x7f893413b2b0 2023-06-23T18:45:03.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.029+0000 7f8939e89700 1 -- 172.21.15.52:0/1156230339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893404e1d0 con 0x7f893413b2b0 2023-06-23T18:45:03.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.029+0000 7f891bfff700 1 -- 172.21.15.52:0/1156230339 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8924014440 con 0x7f893413b2b0 2023-06-23T18:45:03.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.029+0000 7f891bfff700 1 --2- 172.21.15.52:0/1156230339 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f892006ace0 0x7f892006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:03.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.029+0000 7f891bfff700 1 -- 172.21.15.52:0/1156230339 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8924089a70 con 0x7f893413b2b0 2023-06-23T18:45:03.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.029+0000 7f89337fe700 1 --2- 172.21.15.52:0/1156230339 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f892006ace0 0x7f892006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:03.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.030+0000 7f89337fe700 1 --2- 172.21.15.52:0/1156230339 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f892006ace0 0x7f892006d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8928000c00 tx=0x7f8928007000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:03.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.034+0000 7f891bfff700 1 -- 172.21.15.52:0/1156230339 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8924054b20 con 0x7f893413b2b0 2023-06-23T18:45:03.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.228+0000 7f8939e89700 1 -- 172.21.15.52:0/1156230339 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8934148610 con 0x7f893413b2b0 2023-06-23T18:45:03.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.229+0000 7f891bfff700 1 -- 172.21.15.52:0/1156230339 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f89240220a0 con 0x7f893413b2b0 2023-06-23T18:45:03.234 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-06-23T18:45:03.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.230+0000 7f8939e89700 1 -- 172.21.15.52:0/1156230339 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f892006ace0 msgr2=0x7f892006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:03.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.230+0000 7f8939e89700 1 --2- 172.21.15.52:0/1156230339 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f892006ace0 0x7f892006d190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8928000c00 tx=0x7f8928007000 comp rx=0 tx=0).stop 2023-06-23T18:45:03.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.230+0000 7f8939e89700 1 -- 172.21.15.52:0/1156230339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f893413b2b0 msgr2=0x7f89340b6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:03.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.230+0000 7f8939e89700 1 --2- 172.21.15.52:0/1156230339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f893413b2b0 0x7f89340b6f40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8924011aa0 tx=0x7f8924011db0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.230+0000 7f8939e89700 1 -- 172.21.15.52:0/1156230339 shutdown_connections 2023-06-23T18:45:03.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.230+0000 7f8939e89700 1 --2- 172.21.15.52:0/1156230339 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f892006ace0 0x7f892006d190 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.230+0000 7f8939e89700 1 --2- 172.21.15.52:0/1156230339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89341dfa70 0x7f89341e2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.230+0000 7f8939e89700 1 --2- 172.21.15.52:0/1156230339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f891c003a00 0x7f8934148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.230+0000 7f8939e89700 1 --2- 172.21.15.52:0/1156230339 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f893413b2b0 0x7f89340b6f40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.230+0000 7f8939e89700 1 -- 172.21.15.52:0/1156230339 >> 172.21.15.52:0/1156230339 conn(0x7f8934071410 msgr2=0x7f89340b95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:03.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.231+0000 7f8939e89700 1 -- 172.21.15.52:0/1156230339 shutdown_connections 2023-06-23T18:45:03.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.231+0000 7f8939e89700 1 -- 172.21.15.52:0/1156230339 wait complete. 2023-06-23T18:45:03.247 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T18:45:03.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.371+0000 7fa55128e700 1 Processor -- start 2023-06-23T18:45:03.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.371+0000 7fa55128e700 1 -- start start 2023-06-23T18:45:03.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.372+0000 7fa55128e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa54c14a600 0x7fa54c0bb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:03.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.372+0000 7fa55128e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa54c0be040 con 0x7fa54c0b6870 2023-06-23T18:45:03.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.372+0000 7fa55128e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa54c14aae0 con 0x7fa54c0b59b0 2023-06-23T18:45:03.378 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.372+0000 7fa55128e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c14adc0 con 0x7fa54c14a600 2023-06-23T18:45:03.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.372+0000 7fa54affd700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa54c0b6870 0x7fa54c144480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44938/0 (socket says 172.21.15.52:44938) 2023-06-23T18:45:03.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.372+0000 7fa54affd700 1 -- 172.21.15.52:0/1773353520 learned_addr learned my addr 172.21.15.52:0/1773353520 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:03.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.372+0000 7fa54a7fc700 1 --2- 172.21.15.52:0/1773353520 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa54c14a600 0x7fa54c0bb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:03.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.372+0000 7fa549ffb700 1 -- 172.21.15.52:0/1773353520 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824529873 0 0) 0x7fa54c0be040 con 0x7fa54c0b6870 2023-06-23T18:45:03.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.372+0000 7fa549ffb700 1 -- 172.21.15.52:0/1773353520 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5340035b0 con 0x7fa54c0b6870 2023-06-23T18:45:03.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.372+0000 7fa549ffb700 1 -- 172.21.15.52:0/1773353520 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 907689021 0 0) 0x7fa54c14aae0 con 0x7fa54c0b59b0 2023-06-23T18:45:03.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.372+0000 7fa549ffb700 1 -- 172.21.15.52:0/1773353520 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa54c0be040 con 0x7fa54c0b59b0 2023-06-23T18:45:03.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.372+0000 7fa54a7fc700 1 -- 172.21.15.52:0/1773353520 >> v1:172.21.15.89:6789/0 conn(0x7fa54c0b59b0 legacy=0x7fa54c154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:03.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.373+0000 7fa54a7fc700 1 -- 172.21.15.52:0/1773353520 >> v1:172.21.15.52:6789/0 conn(0x7fa54c0b6870 legacy=0x7fa54c144480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:03.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.373+0000 7fa549ffb700 1 -- 172.21.15.52:0/1773353520 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 750943053 0 0) 0x7fa5340035b0 con 0x7fa54c0b6870 2023-06-23T18:45:03.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.373+0000 7fa54a7fc700 1 -- 172.21.15.52:0/1773353520 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c14b0a0 con 0x7fa54c14a600 2023-06-23T18:45:03.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.373+0000 7fa54a7fc700 1 --2- 172.21.15.52:0/1773353520 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa54c14a600 0x7fa54c0bb1f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa53c009870 tx=0x7fa53c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7df642db6d9ed38 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:03.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.373+0000 7fa549ffb700 1 -- 172.21.15.52:0/1773353520 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa540001670 con 0x7fa54c14a600 2023-06-23T18:45:03.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.373+0000 7fa549ffb700 1 -- 172.21.15.52:0/1773353520 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53c004030 con 0x7fa54c14a600 2023-06-23T18:45:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.373+0000 7fa549ffb700 1 -- 172.21.15.52:0/1773353520 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c0043a0 con 0x7fa54c14a600 2023-06-23T18:45:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.373+0000 7fa55128e700 1 -- 172.21.15.52:0/1773353520 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa54c14a600 msgr2=0x7fa54c0bb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.373+0000 7fa55128e700 1 --2- 172.21.15.52:0/1773353520 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa54c14a600 0x7fa54c0bb1f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa53c009870 tx=0x7fa53c009b80 comp rx=0 tx=0).stop 2023-06-23T18:45:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.373+0000 7fa55128e700 1 -- 172.21.15.52:0/1773353520 shutdown_connections 2023-06-23T18:45:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.373+0000 7fa55128e700 1 --2- 172.21.15.52:0/1773353520 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa54c14a600 0x7fa54c0bb1f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.373+0000 7fa55128e700 1 -- 172.21.15.52:0/1773353520 >> 172.21.15.52:0/1773353520 conn(0x7fa54c0bd140 msgr2=0x7fa54c0bd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.374+0000 7fa55128e700 1 -- 172.21.15.52:0/1773353520 shutdown_connections 2023-06-23T18:45:03.381 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.374+0000 7fa55128e700 1 -- 172.21.15.52:0/1773353520 wait complete. 2023-06-23T18:45:03.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.375+0000 7fa55128e700 1 Processor -- start 2023-06-23T18:45:03.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.375+0000 7fa55128e700 1 -- start start 2023-06-23T18:45:03.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.376+0000 7fa55128e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa54c0b59b0 0x7fa54c140240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:03.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.376+0000 7fa55128e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa54c0b6870 0x7fa54c0bc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:03.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.376+0000 7fa55128e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa54c14a600 0x7fa54c1e3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:03.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.376+0000 7fa55128e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c0bcb90 con 0x7fa54c14a600 2023-06-23T18:45:03.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.376+0000 7fa55128e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c13eba0 con 0x7fa54c0b6870 2023-06-23T18:45:03.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.376+0000 7fa55128e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c13f720 con 0x7fa54c0b59b0 2023-06-23T18:45:03.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.376+0000 7fa54b7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa54c14a600 0x7fa54c1e3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:03.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.376+0000 7fa54b7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa54c14a600 0x7fa54c1e3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52394/0 (socket says 172.21.15.52:52394) 2023-06-23T18:45:03.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.376+0000 7fa54b7fe700 1 -- 172.21.15.52:0/2816777792 learned_addr learned my addr 172.21.15.52:0/2816777792 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:03.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.376+0000 7fa54a7fc700 1 --2- 172.21.15.52:0/2816777792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa54c0b6870 0x7fa54c0bc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:03.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.376+0000 7fa54affd700 1 --2- 172.21.15.52:0/2816777792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa54c0b59b0 0x7fa54c140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:03.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.376+0000 7fa54b7fe700 1 -- 172.21.15.52:0/2816777792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa54c0b59b0 msgr2=0x7fa54c140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:03.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.376+0000 7fa54b7fe700 1 --2- 172.21.15.52:0/2816777792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa54c0b59b0 0x7fa54c140240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.376+0000 7fa54b7fe700 1 -- 172.21.15.52:0/2816777792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa54c0b6870 msgr2=0x7fa54c0bc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:03.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.376+0000 7fa54b7fe700 1 --2- 172.21.15.52:0/2816777792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa54c0b6870 0x7fa54c0bc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.376+0000 7fa54b7fe700 1 -- 172.21.15.52:0/2816777792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c0094a0 con 0x7fa54c14a600 2023-06-23T18:45:03.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.377+0000 7fa54b7fe700 1 --2- 172.21.15.52:0/2816777792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa54c14a600 0x7fa54c1e3430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa54400cc50 tx=0x7fa54400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:03.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.377+0000 7fa5337fe700 1 -- 172.21.15.52:0/2816777792 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54400ad40 con 0x7fa54c14a600 2023-06-23T18:45:03.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.377+0000 7fa5337fe700 1 -- 172.21.15.52:0/2816777792 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54400ce50 con 0x7fa54c14a600 2023-06-23T18:45:03.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.377+0000 7fa55128e700 1 -- 172.21.15.52:0/2816777792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa54c140920 con 0x7fa54c14a600 2023-06-23T18:45:03.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.377+0000 7fa5337fe700 1 -- 172.21.15.52:0/2816777792 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54400aea0 con 0x7fa54c14a600 2023-06-23T18:45:03.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.377+0000 7fa55128e700 1 -- 172.21.15.52:0/2816777792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa54c13f0d0 con 0x7fa54c14a600 2023-06-23T18:45:03.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.378+0000 7fa55128e700 1 -- 172.21.15.52:0/2816777792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa54c04e1d0 con 0x7fa54c14a600 2023-06-23T18:45:03.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.378+0000 7fa5337fe700 1 -- 172.21.15.52:0/2816777792 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa544003c40 con 0x7fa54c14a600 2023-06-23T18:45:03.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.378+0000 7fa5337fe700 1 --2- 172.21.15.52:0/2816777792 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa53806ace0 0x7fa53806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:03.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.379+0000 7fa5337fe700 1 -- 172.21.15.52:0/2816777792 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa544089530 con 0x7fa54c14a600 2023-06-23T18:45:03.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.379+0000 7fa54affd700 1 --2- 172.21.15.52:0/2816777792 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa53806ace0 0x7fa53806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:03.387 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.379+0000 7fa54affd700 1 --2- 172.21.15.52:0/2816777792 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa53806ace0 0x7fa53806d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa540005990 tx=0x7fa540001b80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:03.388 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.383+0000 7fa5337fe700 1 -- 172.21.15.52:0/2816777792 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa544054670 con 0x7fa54c14a600 2023-06-23T18:45:03.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.577+0000 7fa55128e700 1 -- 172.21.15.52:0/2816777792 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa54c0b80e0 con 0x7fa54c14a600 2023-06-23T18:45:03.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.578+0000 7fa5337fe700 1 -- 172.21.15.52:0/2816777792 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa544057c90 con 0x7fa54c14a600 2023-06-23T18:45:03.583 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-06-23T18:45:03.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.580+0000 7fa55128e700 1 -- 172.21.15.52:0/2816777792 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa53806ace0 msgr2=0x7fa53806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:03.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.580+0000 7fa55128e700 1 --2- 172.21.15.52:0/2816777792 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa53806ace0 0x7fa53806d190 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa540005990 tx=0x7fa540001b80 comp rx=0 tx=0).stop 2023-06-23T18:45:03.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.580+0000 7fa55128e700 1 -- 172.21.15.52:0/2816777792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa54c14a600 msgr2=0x7fa54c1e3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:03.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.580+0000 7fa55128e700 1 --2- 172.21.15.52:0/2816777792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa54c14a600 0x7fa54c1e3430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa54400cc50 tx=0x7fa54400a340 comp rx=0 tx=0).stop 2023-06-23T18:45:03.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.580+0000 7fa55128e700 1 -- 172.21.15.52:0/2816777792 shutdown_connections 2023-06-23T18:45:03.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.580+0000 7fa55128e700 1 --2- 172.21.15.52:0/2816777792 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa53806ace0 0x7fa53806d190 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.580+0000 7fa55128e700 1 --2- 172.21.15.52:0/2816777792 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa54c14a600 0x7fa54c1e3430 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.580+0000 7fa55128e700 1 --2- 172.21.15.52:0/2816777792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa54c0b59b0 0x7fa54c140240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.580+0000 7fa55128e700 1 --2- 172.21.15.52:0/2816777792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa54c0b6870 0x7fa54c0bc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.580+0000 7fa55128e700 1 -- 172.21.15.52:0/2816777792 >> 172.21.15.52:0/2816777792 conn(0x7fa54c0bd140 msgr2=0x7fa54c1d6960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:03.586 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.580+0000 7fa55128e700 1 -- 172.21.15.52:0/2816777792 shutdown_connections 2023-06-23T18:45:03.587 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.580+0000 7fa55128e700 1 -- 172.21.15.52:0/2816777792 wait complete. 2023-06-23T18:45:03.597 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T18:45:03.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.720+0000 7fcd523e8700 1 Processor -- start 2023-06-23T18:45:03.725 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.720+0000 7fcd523e8700 1 -- start start 2023-06-23T18:45:03.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.721+0000 7fcd523e8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd4c14b170 0x7fcd4c0ba4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:03.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.721+0000 7fcd523e8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcd4c152f40 0x7fcd4c155320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:03.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.721+0000 7fcd523e8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd4c0b8880 con 0x7fcd4c0a5bf0 2023-06-23T18:45:03.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.721+0000 7fcd523e8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd4c069ef0 con 0x7fcd4c152f40 2023-06-23T18:45:03.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.721+0000 7fcd523e8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c06a1d0 con 0x7fcd4c14b170 2023-06-23T18:45:03.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.721+0000 7fcd4b7fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcd4c0a5bf0 0x7fcd4c0b8170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44942/0 (socket says 172.21.15.52:44942) 2023-06-23T18:45:03.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.721+0000 7fcd4b7fe700 1 -- 172.21.15.52:0/1125840106 learned_addr learned my addr 172.21.15.52:0/1125840106 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:03.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.721+0000 7fcd4bfff700 1 --2- 172.21.15.52:0/1125840106 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd4c14b170 0x7fcd4c0ba4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:03.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.721+0000 7fcd50985700 1 --2- 172.21.15.52:0/1125840106 >> v2:172.21.15.89:3300/0 conn(0x7fcd4c152f40 0x7fcd4c155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:03.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.721+0000 7fcd4affd700 1 -- 172.21.15.52:0/1125840106 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2259902437 0 0) 0x7fcd4c0b8880 con 0x7fcd4c0a5bf0 2023-06-23T18:45:03.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.721+0000 7fcd4affd700 1 -- 172.21.15.52:0/1125840106 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd340035b0 con 0x7fcd4c0a5bf0 2023-06-23T18:45:03.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.722+0000 7fcd50985700 1 -- 172.21.15.52:0/1125840106 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd4c14b170 msgr2=0x7fcd4c0ba4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:03.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.722+0000 7fcd50985700 1 --2- 172.21.15.52:0/1125840106 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd4c14b170 0x7fcd4c0ba4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.722+0000 7fcd50985700 1 -- 172.21.15.52:0/1125840106 >> v1:172.21.15.52:6789/0 conn(0x7fcd4c0a5bf0 legacy=0x7fcd4c0b8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:03.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.722+0000 7fcd50985700 1 -- 172.21.15.52:0/1125840106 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4c06a4b0 con 0x7fcd4c152f40 2023-06-23T18:45:03.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.722+0000 7fcd4bfff700 1 --2- 172.21.15.52:0/1125840106 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd4c14b170 0x7fcd4c0ba4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:45:03.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.722+0000 7fcd50985700 1 --2- 172.21.15.52:0/1125840106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd4c152f40 0x7fcd4c155320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcd44009d90 tx=0x7fcd4400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebbead8037ea6af3 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:03.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.722+0000 7fcd4affd700 1 -- 172.21.15.52:0/1125840106 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4400e070 con 0x7fcd4c152f40 2023-06-23T18:45:03.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.722+0000 7fcd4affd700 1 -- 172.21.15.52:0/1125840106 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4400bb20 con 0x7fcd4c152f40 2023-06-23T18:45:03.729 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.722+0000 7fcd4affd700 1 -- 172.21.15.52:0/1125840106 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd44012430 con 0x7fcd4c152f40 2023-06-23T18:45:03.731 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.722+0000 7fcd523e8700 1 -- 172.21.15.52:0/1125840106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd4c152f40 msgr2=0x7fcd4c155320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:03.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.722+0000 7fcd523e8700 1 --2- 172.21.15.52:0/1125840106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd4c152f40 0x7fcd4c155320 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcd44009d90 tx=0x7fcd4400b330 comp rx=0 tx=0).stop 2023-06-23T18:45:03.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.722+0000 7fcd523e8700 1 -- 172.21.15.52:0/1125840106 shutdown_connections 2023-06-23T18:45:03.732 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.722+0000 7fcd523e8700 1 --2- 172.21.15.52:0/1125840106 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd4c152f40 0x7fcd4c155320 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.722+0000 7fcd523e8700 1 --2- 172.21.15.52:0/1125840106 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd4c14b170 0x7fcd4c0ba4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.722+0000 7fcd523e8700 1 -- 172.21.15.52:0/1125840106 >> 172.21.15.52:0/1125840106 conn(0x7fcd4c0c06f0 msgr2=0x7fcd4c0c0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:03.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.722+0000 7fcd523e8700 1 -- 172.21.15.52:0/1125840106 shutdown_connections 2023-06-23T18:45:03.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.722+0000 7fcd523e8700 1 -- 172.21.15.52:0/1125840106 wait complete. 2023-06-23T18:45:03.733 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.724+0000 7fcd523e8700 1 Processor -- start 2023-06-23T18:45:03.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.724+0000 7fcd523e8700 1 -- start start 2023-06-23T18:45:03.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.724+0000 7fcd523e8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd4c0a5bf0 0x7fcd4c14c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:03.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.724+0000 7fcd523e8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd4c14b170 0x7fcd4c14d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:03.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.724+0000 7fcd523e8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd4c152f40 0x7fcd4c1df5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:03.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.724+0000 7fcd523e8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c14cd20 con 0x7fcd4c0a5bf0 2023-06-23T18:45:03.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.724+0000 7fcd523e8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c149310 con 0x7fcd4c152f40 2023-06-23T18:45:03.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.724+0000 7fcd523e8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c1526a0 con 0x7fcd4c14b170 2023-06-23T18:45:03.734 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.724+0000 7fcd4bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd4c0a5bf0 0x7fcd4c14c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:03.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.724+0000 7fcd4bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd4c0a5bf0 0x7fcd4c14c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52410/0 (socket says 172.21.15.52:52410) 2023-06-23T18:45:03.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.724+0000 7fcd4bfff700 1 -- 172.21.15.52:0/3174339767 learned_addr learned my addr 172.21.15.52:0/3174339767 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:03.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.725+0000 7fcd4b7fe700 1 --2- 172.21.15.52:0/3174339767 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd4c14b170 0x7fcd4c14d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:03.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.725+0000 7fcd50985700 1 --2- 172.21.15.52:0/3174339767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd4c152f40 0x7fcd4c1df5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:03.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.725+0000 7fcd4bfff700 1 -- 172.21.15.52:0/3174339767 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd4c14b170 msgr2=0x7fcd4c14d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:03.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.725+0000 7fcd4bfff700 1 --2- 172.21.15.52:0/3174339767 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd4c14b170 0x7fcd4c14d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.735 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.725+0000 7fcd4bfff700 1 -- 172.21.15.52:0/3174339767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd4c152f40 msgr2=0x7fcd4c1df5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:03.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.725+0000 7fcd4bfff700 1 --2- 172.21.15.52:0/3174339767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd4c152f40 0x7fcd4c1df5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.725+0000 7fcd4bfff700 1 -- 172.21.15.52:0/3174339767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c0094a0 con 0x7fcd4c0a5bf0 2023-06-23T18:45:03.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.725+0000 7fcd4bfff700 1 --2- 172.21.15.52:0/3174339767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd4c0a5bf0 0x7fcd4c14c7e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c00ec10 tx=0x7fcd3c009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:03.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.725+0000 7fcd48ff9700 1 -- 172.21.15.52:0/3174339767 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c00c940 con 0x7fcd4c0a5bf0 2023-06-23T18:45:03.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.725+0000 7fcd48ff9700 1 -- 172.21.15.52:0/3174339767 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3c00caa0 con 0x7fcd4c0a5bf0 2023-06-23T18:45:03.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.725+0000 7fcd523e8700 1 -- 172.21.15.52:0/3174339767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd44009a70 con 0x7fcd4c0a5bf0 2023-06-23T18:45:03.736 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.725+0000 7fcd48ff9700 1 -- 172.21.15.52:0/3174339767 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c00ce10 con 0x7fcd4c0a5bf0 2023-06-23T18:45:03.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.725+0000 7fcd523e8700 1 -- 172.21.15.52:0/3174339767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd4c148b10 con 0x7fcd4c0a5bf0 2023-06-23T18:45:03.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.726+0000 7fcd523e8700 1 -- 172.21.15.52:0/3174339767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd4c04e1d0 con 0x7fcd4c0a5bf0 2023-06-23T18:45:03.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.726+0000 7fcd48ff9700 1 -- 172.21.15.52:0/3174339767 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcd3c013470 con 0x7fcd4c0a5bf0 2023-06-23T18:45:03.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.727+0000 7fcd48ff9700 1 --2- 172.21.15.52:0/3174339767 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcd3806ad10 0x7fcd3806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:03.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.727+0000 7fcd48ff9700 1 -- 172.21.15.52:0/3174339767 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcd3c089570 con 0x7fcd4c0a5bf0 2023-06-23T18:45:03.737 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.727+0000 7fcd4b7fe700 1 --2- 172.21.15.52:0/3174339767 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcd3806ad10 0x7fcd3806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:03.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.727+0000 7fcd4b7fe700 1 --2- 172.21.15.52:0/3174339767 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcd3806ad10 0x7fcd3806d1c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c1dd190 tx=0x7fcd40009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:03.738 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.731+0000 7fcd48ff9700 1 -- 172.21.15.52:0/3174339767 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcd3c0546b0 con 0x7fcd4c0a5bf0 2023-06-23T18:45:03.929 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.924+0000 7fcd523e8700 1 -- 172.21.15.52:0/3174339767 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd4c0c1310 con 0x7fcd4c0a5bf0 2023-06-23T18:45:03.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.925+0000 7fcd48ff9700 1 -- 172.21.15.52:0/3174339767 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcd3c057cd0 con 0x7fcd4c0a5bf0 2023-06-23T18:45:03.930 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2023-06-23T18:45:03.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.927+0000 7fcd523e8700 1 -- 172.21.15.52:0/3174339767 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcd3806ad10 msgr2=0x7fcd3806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:03.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.927+0000 7fcd523e8700 1 --2- 172.21.15.52:0/3174339767 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcd3806ad10 0x7fcd3806d1c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c1dd190 tx=0x7fcd40009040 comp rx=0 tx=0).stop 2023-06-23T18:45:03.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.927+0000 7fcd523e8700 1 -- 172.21.15.52:0/3174339767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd4c0a5bf0 msgr2=0x7fcd4c14c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:03.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.927+0000 7fcd523e8700 1 --2- 172.21.15.52:0/3174339767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd4c0a5bf0 0x7fcd4c14c7e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c00ec10 tx=0x7fcd3c009ec0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.927+0000 7fcd523e8700 1 -- 172.21.15.52:0/3174339767 shutdown_connections 2023-06-23T18:45:03.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.927+0000 7fcd523e8700 1 --2- 172.21.15.52:0/3174339767 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcd3806ad10 0x7fcd3806d1c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.927+0000 7fcd523e8700 1 --2- 172.21.15.52:0/3174339767 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd4c152f40 0x7fcd4c1df5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.927+0000 7fcd523e8700 1 --2- 172.21.15.52:0/3174339767 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcd4c0a5bf0 0x7fcd4c14c7e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.927+0000 7fcd523e8700 1 --2- 172.21.15.52:0/3174339767 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd4c14b170 0x7fcd4c14d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:03.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.927+0000 7fcd523e8700 1 -- 172.21.15.52:0/3174339767 >> 172.21.15.52:0/3174339767 conn(0x7fcd4c0c06f0 msgr2=0x7fcd4c0beef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:03.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.927+0000 7fcd523e8700 1 -- 172.21.15.52:0/3174339767 shutdown_connections 2023-06-23T18:45:03.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:03.927+0000 7fcd523e8700 1 -- 172.21.15.52:0/3174339767 wait complete. 2023-06-23T18:45:03.944 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T18:45:04.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.068+0000 7f3a8ad63700 1 Processor -- start 2023-06-23T18:45:04.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.068+0000 7f3a8ad63700 1 -- start start 2023-06-23T18:45:04.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.069+0000 7f3a8ad63700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3a8414b170 0x7f3a840ba4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:04.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.069+0000 7f3a8ad63700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a84152f40 0x7f3a84155320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:04.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.069+0000 7f3a8ad63700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a840b8880 con 0x7f3a840a5bf0 2023-06-23T18:45:04.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.069+0000 7f3a8ad63700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a84069ef0 con 0x7f3a8414b170 2023-06-23T18:45:04.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.069+0000 7f3a8ad63700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8406a1d0 con 0x7f3a84152f40 2023-06-23T18:45:04.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.069+0000 7f3a88aff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3a8414b170 0x7f3a840ba4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:04.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.069+0000 7f3a88aff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3a8414b170 0x7f3a840ba4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52420/0 (socket says 172.21.15.52:52420) 2023-06-23T18:45:04.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.069+0000 7f3a88aff700 1 -- 172.21.15.52:0/660878044 learned_addr learned my addr 172.21.15.52:0/660878044 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:04.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.069+0000 7f3a89300700 1 --2- 172.21.15.52:0/660878044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a84152f40 0x7f3a84155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:04.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.069+0000 7f3a88aff700 1 -- 172.21.15.52:0/660878044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a84152f40 msgr2=0x7f3a84155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:04.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.069+0000 7f3a88aff700 1 --2- 172.21.15.52:0/660878044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a84152f40 0x7f3a84155320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:04.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.069+0000 7f3a88aff700 1 -- 172.21.15.52:0/660878044 >> v1:172.21.15.89:6789/0 conn(0x7f3a840a5bf0 legacy=0x7f3a840b8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:04.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.069+0000 7f3a88aff700 1 -- 172.21.15.52:0/660878044 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8406a4b0 con 0x7f3a8414b170 2023-06-23T18:45:04.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.069+0000 7f3a88aff700 1 --2- 172.21.15.52:0/660878044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a8414b170 0x7f3a840ba4b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3a780098f0 tx=0x7f3a78009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f6f9132ad8f80d4 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:04.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.070+0000 7f3a837fe700 1 -- 172.21.15.52:0/660878044 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78004230 con 0x7f3a8414b170 2023-06-23T18:45:04.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.070+0000 7f3a837fe700 1 -- 172.21.15.52:0/660878044 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a78004390 con 0x7f3a8414b170 2023-06-23T18:45:04.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.070+0000 7f3a837fe700 1 -- 172.21.15.52:0/660878044 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a780036a0 con 0x7f3a8414b170 2023-06-23T18:45:04.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.070+0000 7f3a8ad63700 1 -- 172.21.15.52:0/660878044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a8414b170 msgr2=0x7f3a840ba4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:04.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.070+0000 7f3a8ad63700 1 --2- 172.21.15.52:0/660878044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a8414b170 0x7f3a840ba4b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3a780098f0 tx=0x7f3a78009c00 comp rx=0 tx=0).stop 2023-06-23T18:45:04.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.070+0000 7f3a8ad63700 1 -- 172.21.15.52:0/660878044 shutdown_connections 2023-06-23T18:45:04.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.070+0000 7f3a8ad63700 1 --2- 172.21.15.52:0/660878044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a84152f40 0x7f3a84155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:04.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.070+0000 7f3a8ad63700 1 --2- 172.21.15.52:0/660878044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a8414b170 0x7f3a840ba4b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:04.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.070+0000 7f3a8ad63700 1 -- 172.21.15.52:0/660878044 >> 172.21.15.52:0/660878044 conn(0x7f3a840c06f0 msgr2=0x7f3a840c0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:04.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.070+0000 7f3a8ad63700 1 -- 172.21.15.52:0/660878044 shutdown_connections 2023-06-23T18:45:04.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.070+0000 7f3a8ad63700 1 -- 172.21.15.52:0/660878044 wait complete. 2023-06-23T18:45:04.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.071+0000 7f3a8ad63700 1 Processor -- start 2023-06-23T18:45:04.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.071+0000 7f3a8ad63700 1 -- start start 2023-06-23T18:45:04.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.072+0000 7f3a8ad63700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a840a5bf0 0x7f3a840b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:04.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.072+0000 7f3a8ad63700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a8414b170 0x7f3a840b6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:04.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.072+0000 7f3a8ad63700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a84152f40 0x7f3a841e32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:04.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.072+0000 7f3a8ad63700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a840aeb20 con 0x7f3a840a5bf0 2023-06-23T18:45:04.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.072+0000 7f3a8ad63700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a840b7650 con 0x7f3a84152f40 2023-06-23T18:45:04.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.072+0000 7f3a8ad63700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8414ad50 con 0x7f3a8414b170 2023-06-23T18:45:04.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.072+0000 7f3a88aff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a840a5bf0 0x7f3a840b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:04.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.072+0000 7f3a88aff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a840a5bf0 0x7f3a840b7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52430/0 (socket says 172.21.15.52:52430) 2023-06-23T18:45:04.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.072+0000 7f3a88aff700 1 -- 172.21.15.52:0/3266663503 learned_addr learned my addr 172.21.15.52:0/3266663503 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:04.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.072+0000 7f3a83fff700 1 --2- 172.21.15.52:0/3266663503 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a8414b170 0x7f3a840b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:04.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.072+0000 7f3a89300700 1 --2- 172.21.15.52:0/3266663503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a84152f40 0x7f3a841e32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:04.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.072+0000 7f3a88aff700 1 -- 172.21.15.52:0/3266663503 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a8414b170 msgr2=0x7f3a840b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:04.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.072+0000 7f3a88aff700 1 --2- 172.21.15.52:0/3266663503 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a8414b170 0x7f3a840b6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:04.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.072+0000 7f3a88aff700 1 -- 172.21.15.52:0/3266663503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a84152f40 msgr2=0x7f3a841e32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:04.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.072+0000 7f3a88aff700 1 --2- 172.21.15.52:0/3266663503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a84152f40 0x7f3a841e32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:04.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.072+0000 7f3a88aff700 1 -- 172.21.15.52:0/3266663503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a78009550 con 0x7f3a840a5bf0 2023-06-23T18:45:04.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.073+0000 7f3a88aff700 1 --2- 172.21.15.52:0/3266663503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a840a5bf0 0x7f3a840b7110 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3a8408a6b0 tx=0x7f3a78004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:04.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.073+0000 7f3a817fa700 1 -- 172.21.15.52:0/3266663503 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78003e70 con 0x7f3a840a5bf0 2023-06-23T18:45:04.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.073+0000 7f3a817fa700 1 -- 172.21.15.52:0/3266663503 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7801f070 con 0x7f3a840a5bf0 2023-06-23T18:45:04.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.073+0000 7f3a8ad63700 1 -- 172.21.15.52:0/3266663503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a8414a8c0 con 0x7f3a840a5bf0 2023-06-23T18:45:04.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.073+0000 7f3a817fa700 1 -- 172.21.15.52:0/3266663503 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7800b8c0 con 0x7f3a840a5bf0 2023-06-23T18:45:04.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.073+0000 7f3a8ad63700 1 -- 172.21.15.52:0/3266663503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a84148460 con 0x7f3a840a5bf0 2023-06-23T18:45:04.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.074+0000 7f3a8ad63700 1 -- 172.21.15.52:0/3266663503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a8414a190 con 0x7f3a840a5bf0 2023-06-23T18:45:04.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.074+0000 7f3a817fa700 1 -- 172.21.15.52:0/3266663503 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3a78021030 con 0x7f3a840a5bf0 2023-06-23T18:45:04.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.075+0000 7f3a817fa700 1 --2- 172.21.15.52:0/3266663503 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3a6806ace0 0x7f3a6806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:04.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.075+0000 7f3a817fa700 1 -- 172.21.15.52:0/3266663503 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3a7808ab20 con 0x7f3a840a5bf0 2023-06-23T18:45:04.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.075+0000 7f3a83fff700 1 --2- 172.21.15.52:0/3266663503 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3a6806ace0 0x7f3a6806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:04.084 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.075+0000 7f3a83fff700 1 --2- 172.21.15.52:0/3266663503 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3a6806ace0 0x7f3a6806d190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3a840a5120 tx=0x7f3a70009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:04.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.079+0000 7f3a817fa700 1 -- 172.21.15.52:0/3266663503 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3a78055d80 con 0x7f3a840a5bf0 2023-06-23T18:45:04.280 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.275+0000 7f3a8ad63700 1 -- 172.21.15.52:0/3266663503 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3a8414a190 con 0x7f3a840a5bf0 2023-06-23T18:45:04.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.276+0000 7f3a817fa700 1 -- 172.21.15.52:0/3266663503 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3a780593a0 con 0x7f3a840a5bf0 2023-06-23T18:45:04.281 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-06-23T18:45:04.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.278+0000 7f3a8ad63700 1 -- 172.21.15.52:0/3266663503 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3a6806ace0 msgr2=0x7f3a6806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:04.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.278+0000 7f3a8ad63700 1 --2- 172.21.15.52:0/3266663503 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3a6806ace0 0x7f3a6806d190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3a840a5120 tx=0x7f3a70009040 comp rx=0 tx=0).stop 2023-06-23T18:45:04.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.278+0000 7f3a8ad63700 1 -- 172.21.15.52:0/3266663503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a840a5bf0 msgr2=0x7f3a840b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:04.283 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.278+0000 7f3a8ad63700 1 --2- 172.21.15.52:0/3266663503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a840a5bf0 0x7f3a840b7110 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3a8408a6b0 tx=0x7f3a78004750 comp rx=0 tx=0).stop 2023-06-23T18:45:04.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.278+0000 7f3a8ad63700 1 -- 172.21.15.52:0/3266663503 shutdown_connections 2023-06-23T18:45:04.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.278+0000 7f3a8ad63700 1 --2- 172.21.15.52:0/3266663503 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3a6806ace0 0x7f3a6806d190 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:04.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.278+0000 7f3a8ad63700 1 --2- 172.21.15.52:0/3266663503 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3a84152f40 0x7f3a841e32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:04.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.278+0000 7f3a8ad63700 1 --2- 172.21.15.52:0/3266663503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3a840a5bf0 0x7f3a840b7110 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:04.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.278+0000 7f3a8ad63700 1 --2- 172.21.15.52:0/3266663503 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3a8414b170 0x7f3a840b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:04.284 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.278+0000 7f3a8ad63700 1 -- 172.21.15.52:0/3266663503 >> 172.21.15.52:0/3266663503 conn(0x7f3a840c06f0 msgr2=0x7f3a840beab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:04.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.278+0000 7f3a8ad63700 1 -- 172.21.15.52:0/3266663503 shutdown_connections 2023-06-23T18:45:04.285 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.278+0000 7f3a8ad63700 1 -- 172.21.15.52:0/3266663503 wait complete. 2023-06-23T18:45:04.295 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T18:45:04.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.416+0000 7fc56ef51700 1 Processor -- start 2023-06-23T18:45:04.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.416+0000 7fc56ef51700 1 -- start start 2023-06-23T18:45:04.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.417+0000 7fc56ef51700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc5681426a0 0x7fc568071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:04.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.417+0000 7fc56ef51700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc5680b8c70 0x7fc568148480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:04.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.417+0000 7fc56ef51700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5680b53b0 con 0x7fc5681489c0 2023-06-23T18:45:04.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.417+0000 7fc56ef51700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5680b4750 con 0x7fc5681426a0 2023-06-23T18:45:04.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.417+0000 7fc56ef51700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc568142a70 con 0x7fc5680b8c70 2023-06-23T18:45:04.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.417+0000 7fc56cced700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc5681426a0 0x7fc568071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:04.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.417+0000 7fc56d4ee700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc5681489c0 0x7fc56814b880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44948/0 (socket says 172.21.15.52:44948) 2023-06-23T18:45:04.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.417+0000 7fc56d4ee700 1 -- 172.21.15.52:0/3092301458 learned_addr learned my addr 172.21.15.52:0/3092301458 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:04.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.417+0000 7fc55ffff700 1 --2- 172.21.15.52:0/3092301458 >> v2:172.21.15.89:3300/0 conn(0x7fc5680b8c70 0x7fc568148480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:04.423 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.417+0000 7fc56cced700 1 -- 172.21.15.52:0/3092301458 >> v2:172.21.15.89:3300/0 conn(0x7fc5680b8c70 msgr2=0x7fc568148480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:04.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.417+0000 7fc56cced700 1 --2- 172.21.15.52:0/3092301458 >> v2:172.21.15.89:3300/0 conn(0x7fc5680b8c70 0x7fc568148480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:04.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.417+0000 7fc56cced700 1 -- 172.21.15.52:0/3092301458 >> v1:172.21.15.52:6789/0 conn(0x7fc5681489c0 legacy=0x7fc56814b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:04.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.417+0000 7fc56cced700 1 -- 172.21.15.52:0/3092301458 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5680b9c30 con 0x7fc5681426a0 2023-06-23T18:45:04.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.417+0000 7fc55ffff700 1 --2- 172.21.15.52:0/3092301458 >> v2:172.21.15.89:3300/0 conn(0x7fc5680b8c70 0x7fc568148480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:04.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.417+0000 7fc55f7fe700 1 -- 172.21.15.52:0/3092301458 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608517340 0 0) 0x7fc5680b53b0 con 0x7fc5681489c0 2023-06-23T18:45:04.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.417+0000 7fc56cced700 1 --2- 172.21.15.52:0/3092301458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5681426a0 0x7fc568071be0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc56806ef40 tx=0x7fc564009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594feb7136968585 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:04.424 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.418+0000 7fc55f7fe700 1 -- 172.21.15.52:0/3092301458 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc564011830 con 0x7fc5681426a0 2023-06-23T18:45:04.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.418+0000 7fc55f7fe700 1 -- 172.21.15.52:0/3092301458 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc564011990 con 0x7fc5681426a0 2023-06-23T18:45:04.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.418+0000 7fc55f7fe700 1 -- 172.21.15.52:0/3092301458 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc564011d20 con 0x7fc5681426a0 2023-06-23T18:45:04.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.418+0000 7fc56ef51700 1 -- 172.21.15.52:0/3092301458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5681426a0 msgr2=0x7fc568071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:04.425 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.418+0000 7fc56ef51700 1 --2- 172.21.15.52:0/3092301458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5681426a0 0x7fc568071be0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc56806ef40 tx=0x7fc564009b20 comp rx=0 tx=0).stop 2023-06-23T18:45:04.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.418+0000 7fc56ef51700 1 -- 172.21.15.52:0/3092301458 shutdown_connections 2023-06-23T18:45:04.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.418+0000 7fc56ef51700 1 --2- 172.21.15.52:0/3092301458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5681426a0 0x7fc568071be0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:04.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.418+0000 7fc56ef51700 1 --2- 172.21.15.52:0/3092301458 >> v2:172.21.15.89:3300/0 conn(0x7fc5680b8c70 0x7fc568148480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:04.428 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.418+0000 7fc56ef51700 1 -- 172.21.15.52:0/3092301458 >> 172.21.15.52:0/3092301458 conn(0x7fc5680bd690 msgr2=0x7fc5680b9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:04.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.418+0000 7fc56ef51700 1 -- 172.21.15.52:0/3092301458 shutdown_connections 2023-06-23T18:45:04.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.418+0000 7fc56ef51700 1 -- 172.21.15.52:0/3092301458 wait complete. 2023-06-23T18:45:04.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.420+0000 7fc56ef51700 1 Processor -- start 2023-06-23T18:45:04.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.420+0000 7fc56ef51700 1 -- start start 2023-06-23T18:45:04.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.421+0000 7fc56ef51700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5680b8c70 0x7fc5680bc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:04.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.421+0000 7fc56ef51700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5681426a0 0x7fc5681e0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:04.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.421+0000 7fc56ef51700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5681489c0 0x7fc5681e14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:04.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.421+0000 7fc56ef51700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5680bc5d0 con 0x7fc5681489c0 2023-06-23T18:45:04.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.421+0000 7fc56ef51700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc568145bf0 con 0x7fc5681426a0 2023-06-23T18:45:04.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.421+0000 7fc56ef51700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5681452c0 con 0x7fc5680b8c70 2023-06-23T18:45:04.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.421+0000 7fc56d4ee700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5681489c0 0x7fc5681e14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:04.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.421+0000 7fc56d4ee700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5681489c0 0x7fc5681e14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52450/0 (socket says 172.21.15.52:52450) 2023-06-23T18:45:04.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.421+0000 7fc56d4ee700 1 -- 172.21.15.52:0/444580131 learned_addr learned my addr 172.21.15.52:0/444580131 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:04.430 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.421+0000 7fc56cced700 1 --2- 172.21.15.52:0/444580131 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5680b8c70 0x7fc5680bc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:04.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.421+0000 7fc55ffff700 1 --2- 172.21.15.52:0/444580131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5681426a0 0x7fc5681e0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:04.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.421+0000 7fc56d4ee700 1 -- 172.21.15.52:0/444580131 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5680b8c70 msgr2=0x7fc5680bc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:04.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.421+0000 7fc56d4ee700 1 --2- 172.21.15.52:0/444580131 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5680b8c70 0x7fc5680bc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:04.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.421+0000 7fc56d4ee700 1 -- 172.21.15.52:0/444580131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5681426a0 msgr2=0x7fc5681e0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:04.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.421+0000 7fc56d4ee700 1 --2- 172.21.15.52:0/444580131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5681426a0 0x7fc5681e0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:04.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.421+0000 7fc56d4ee700 1 -- 172.21.15.52:0/444580131 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5640094a0 con 0x7fc5681489c0 2023-06-23T18:45:04.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.421+0000 7fc55ffff700 1 --2- 172.21.15.52:0/444580131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5681426a0 0x7fc5681e0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:04.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.421+0000 7fc56d4ee700 1 --2- 172.21.15.52:0/444580131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5681489c0 0x7fc5681e14c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc56000cba0 tx=0x7fc56000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:04.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.421+0000 7fc55d7fa700 1 -- 172.21.15.52:0/444580131 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56000aa70 con 0x7fc5681489c0 2023-06-23T18:45:04.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.421+0000 7fc55d7fa700 1 -- 172.21.15.52:0/444580131 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56000abf0 con 0x7fc5681489c0 2023-06-23T18:45:04.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.421+0000 7fc55d7fa700 1 -- 172.21.15.52:0/444580131 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5600070d0 con 0x7fc5681489c0 2023-06-23T18:45:04.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.421+0000 7fc56ef51700 1 -- 172.21.15.52:0/444580131 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5681455a0 con 0x7fc5681489c0 2023-06-23T18:45:04.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.422+0000 7fc56ef51700 1 -- 172.21.15.52:0/444580131 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc568142d10 con 0x7fc5681489c0 2023-06-23T18:45:04.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.422+0000 7fc56ef51700 1 -- 172.21.15.52:0/444580131 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc56804e1d0 con 0x7fc5681489c0 2023-06-23T18:45:04.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.423+0000 7fc55d7fa700 1 -- 172.21.15.52:0/444580131 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc560007230 con 0x7fc5681489c0 2023-06-23T18:45:04.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.423+0000 7fc55d7fa700 1 --2- 172.21.15.52:0/444580131 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc55406ace0 0x7fc55406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:04.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.423+0000 7fc55d7fa700 1 -- 172.21.15.52:0/444580131 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc560088f30 con 0x7fc5681489c0 2023-06-23T18:45:04.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.423+0000 7fc56cced700 1 --2- 172.21.15.52:0/444580131 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc55406ace0 0x7fc55406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:04.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.424+0000 7fc56cced700 1 --2- 172.21.15.52:0/444580131 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc55406ace0 0x7fc55406d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc5640090b0 tx=0x7fc564008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:04.434 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.428+0000 7fc55d7fa700 1 -- 172.21.15.52:0/444580131 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc560053f40 con 0x7fc5681489c0 2023-06-23T18:45:04.671 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.666+0000 7fc56ef51700 1 -- 172.21.15.52:0/444580131 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5680b50d0 con 0x7fc5681489c0 2023-06-23T18:45:04.672 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.667+0000 7fc55d7fa700 1 -- 172.21.15.52:0/444580131 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3906 (secure 0 0 0) 0x7fc560018090 con 0x7fc5681489c0 2023-06-23T18:45:04.672 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:04.672 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/299877491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":299877491},{"type":"v1","addr":"172.21.15.89:6835","nonce":299877491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/2826461143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2826461143},{"type":"v1","addr":"172.21.15.52:6833","nonce":2826461143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T18:44:50.642376+0000","modified":"2023-06-23T18:44:53.679243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/4214822260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4214822260},{"type":"v1","addr":"172.21.15.52:6835","nonce":4214822260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-23T18:45:04.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.669+0000 7fc56ef51700 1 -- 172.21.15.52:0/444580131 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc55406ace0 msgr2=0x7fc55406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:04.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.669+0000 7fc56ef51700 1 --2- 172.21.15.52:0/444580131 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc55406ace0 0x7fc55406d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc5640090b0 tx=0x7fc564008030 comp rx=0 tx=0).stop 2023-06-23T18:45:04.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.669+0000 7fc56ef51700 1 -- 172.21.15.52:0/444580131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5681489c0 msgr2=0x7fc5681e14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:04.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.669+0000 7fc56ef51700 1 --2- 172.21.15.52:0/444580131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5681489c0 0x7fc5681e14c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc56000cba0 tx=0x7fc56000ceb0 comp rx=0 tx=0).stop 2023-06-23T18:45:04.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.669+0000 7fc56ef51700 1 -- 172.21.15.52:0/444580131 shutdown_connections 2023-06-23T18:45:04.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.669+0000 7fc56ef51700 1 --2- 172.21.15.52:0/444580131 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc55406ace0 0x7fc55406d190 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:04.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.669+0000 7fc56ef51700 1 --2- 172.21.15.52:0/444580131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc5681489c0 0x7fc5681e14c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:04.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.669+0000 7fc56ef51700 1 --2- 172.21.15.52:0/444580131 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5680b8c70 0x7fc5680bc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:04.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.669+0000 7fc56ef51700 1 --2- 172.21.15.52:0/444580131 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5681426a0 0x7fc5681e0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:04.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.669+0000 7fc56ef51700 1 -- 172.21.15.52:0/444580131 >> 172.21.15.52:0/444580131 conn(0x7fc5680bd690 msgr2=0x7fc5680b7280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:04.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.669+0000 7fc56ef51700 1 -- 172.21.15.52:0/444580131 shutdown_connections 2023-06-23T18:45:04.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.669+0000 7fc56ef51700 1 -- 172.21.15.52:0/444580131 wait complete. 2023-06-23T18:45:04.676 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2023-06-23T18:45:04.686 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:45:04.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.807+0000 7f538f0c8700 1 Processor -- start 2023-06-23T18:45:04.812 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.807+0000 7f538f0c8700 1 -- start start 2023-06-23T18:45:04.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.808+0000 7f538f0c8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f53880b9310 0x7f53880b8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:04.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.808+0000 7f538f0c8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53880b98a0 con 0x7f538814da40 2023-06-23T18:45:04.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.808+0000 7f538f0c8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f538814a6a0 con 0x7f538806c1f0 2023-06-23T18:45:04.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.808+0000 7f538f0c8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f538814a980 con 0x7f53880b9310 2023-06-23T18:45:04.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.808+0000 7f5387fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f538814da40 0x7f53881443e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44954/0 (socket says 172.21.15.52:44954) 2023-06-23T18:45:04.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.808+0000 7f5387fff700 1 -- 172.21.15.52:0/1936023852 learned_addr learned my addr 172.21.15.52:0/1936023852 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:04.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.808+0000 7f538d665700 1 --2- 172.21.15.52:0/1936023852 >> v2:172.21.15.52:3300/0 conn(0x7f53880b9310 0x7f53880b8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:04.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.808+0000 7f53877fe700 1 -- 172.21.15.52:0/1936023852 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3519123541 0 0) 0x7f53880b98a0 con 0x7f538814da40 2023-06-23T18:45:04.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.808+0000 7f53877fe700 1 -- 172.21.15.52:0/1936023852 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53780035b0 con 0x7f538814da40 2023-06-23T18:45:04.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.808+0000 7f538d665700 1 -- 172.21.15.52:0/1936023852 >> v1:172.21.15.89:6789/0 conn(0x7f538806c1f0 legacy=0x7f538814aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:04.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.808+0000 7f538d665700 1 -- 172.21.15.52:0/1936023852 >> v1:172.21.15.52:6789/0 conn(0x7f538814da40 legacy=0x7f53881443e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:04.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.808+0000 7f538d665700 1 -- 172.21.15.52:0/1936023852 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5388144af0 con 0x7f53880b9310 2023-06-23T18:45:04.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.808+0000 7f538d665700 1 --2- 172.21.15.52:0/1936023852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53880b9310 0x7f53880b8870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5380009d90 tx=0x7f538000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1cc981616fb0285 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:04.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.808+0000 7f53877fe700 1 -- 172.21.15.52:0/1936023852 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538000e070 con 0x7f53880b9310 2023-06-23T18:45:04.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.808+0000 7f53877fe700 1 -- 172.21.15.52:0/1936023852 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538000bae0 con 0x7f53880b9310 2023-06-23T18:45:04.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.808+0000 7f53877fe700 1 -- 172.21.15.52:0/1936023852 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538000be90 con 0x7f53880b9310 2023-06-23T18:45:04.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.809+0000 7f538f0c8700 1 -- 172.21.15.52:0/1936023852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53880b9310 msgr2=0x7f53880b8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:04.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.809+0000 7f538f0c8700 1 --2- 172.21.15.52:0/1936023852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53880b9310 0x7f53880b8870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5380009d90 tx=0x7f538000b330 comp rx=0 tx=0).stop 2023-06-23T18:45:04.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.809+0000 7f538f0c8700 1 -- 172.21.15.52:0/1936023852 shutdown_connections 2023-06-23T18:45:04.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.809+0000 7f538f0c8700 1 --2- 172.21.15.52:0/1936023852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53880b9310 0x7f53880b8870 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:04.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.809+0000 7f538f0c8700 1 -- 172.21.15.52:0/1936023852 >> 172.21.15.52:0/1936023852 conn(0x7f53880bdf30 msgr2=0x7f53880b9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:04.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.809+0000 7f538f0c8700 1 -- 172.21.15.52:0/1936023852 shutdown_connections 2023-06-23T18:45:04.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.809+0000 7f538f0c8700 1 -- 172.21.15.52:0/1936023852 wait complete. 2023-06-23T18:45:04.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.810+0000 7f538f0c8700 1 Processor -- start 2023-06-23T18:45:04.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.810+0000 7f538f0c8700 1 -- start start 2023-06-23T18:45:04.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.811+0000 7f538f0c8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f538806c1f0 0x7f5388145c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:04.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.811+0000 7f538f0c8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53880b9310 0x7f5388142100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:04.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.811+0000 7f538f0c8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f538814da40 0x7f53881472f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:04.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.811+0000 7f538f0c8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53880b76a0 con 0x7f53880b9310 2023-06-23T18:45:04.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.811+0000 7f538f0c8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53880b5280 con 0x7f538814da40 2023-06-23T18:45:04.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.811+0000 7f538f0c8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53881dfd30 con 0x7f538806c1f0 2023-06-23T18:45:04.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.811+0000 7f5387fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53880b9310 0x7f5388142100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:04.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.811+0000 7f5387fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53880b9310 0x7f5388142100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52472/0 (socket says 172.21.15.52:52472) 2023-06-23T18:45:04.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.811+0000 7f5387fff700 1 -- 172.21.15.52:0/2482643101 learned_addr learned my addr 172.21.15.52:0/2482643101 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:04.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.811+0000 7f538ce64700 1 --2- 172.21.15.52:0/2482643101 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f538806c1f0 0x7f5388145c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:04.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.811+0000 7f538d665700 1 --2- 172.21.15.52:0/2482643101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f538814da40 0x7f53881472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:04.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.811+0000 7f5387fff700 1 -- 172.21.15.52:0/2482643101 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f538806c1f0 msgr2=0x7f5388145c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:04.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.811+0000 7f5387fff700 1 --2- 172.21.15.52:0/2482643101 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f538806c1f0 0x7f5388145c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:04.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.811+0000 7f5387fff700 1 -- 172.21.15.52:0/2482643101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f538814da40 msgr2=0x7f53881472f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:04.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.811+0000 7f5387fff700 1 --2- 172.21.15.52:0/2482643101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f538814da40 0x7f53881472f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:04.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.811+0000 7f5387fff700 1 -- 172.21.15.52:0/2482643101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5380009a70 con 0x7f53880b9310 2023-06-23T18:45:04.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.811+0000 7f5387fff700 1 --2- 172.21.15.52:0/2482643101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53880b9310 0x7f5388142100 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f537400c420 tx=0x7f537400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:04.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.812+0000 7f53857fa700 1 -- 172.21.15.52:0/2482643101 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5374005d70 con 0x7f53880b9310 2023-06-23T18:45:04.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.812+0000 7f53857fa700 1 -- 172.21.15.52:0/2482643101 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f537400ce30 con 0x7f53880b9310 2023-06-23T18:45:04.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.812+0000 7f538f0c8700 1 -- 172.21.15.52:0/2482643101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53881e0010 con 0x7f53880b9310 2023-06-23T18:45:04.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.812+0000 7f53857fa700 1 -- 172.21.15.52:0/2482643101 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53740072d0 con 0x7f53880b9310 2023-06-23T18:45:04.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.812+0000 7f538f0c8700 1 -- 172.21.15.52:0/2482643101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53881e05d0 con 0x7f53880b9310 2023-06-23T18:45:04.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.812+0000 7f538f0c8700 1 -- 172.21.15.52:0/2482643101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53881e0760 con 0x7f53880b9310 2023-06-23T18:45:04.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.813+0000 7f53857fa700 1 -- 172.21.15.52:0/2482643101 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5374007430 con 0x7f53880b9310 2023-06-23T18:45:04.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.813+0000 7f53857fa700 1 --2- 172.21.15.52:0/2482643101 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f536c06ace0 0x7f536c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:04.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.813+0000 7f53857fa700 1 -- 172.21.15.52:0/2482643101 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5374088680 con 0x7f53880b9310 2023-06-23T18:45:04.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.814+0000 7f538ce64700 1 --2- 172.21.15.52:0/2482643101 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f536c06ace0 0x7f536c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:04.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.814+0000 7f538ce64700 1 --2- 172.21.15.52:0/2482643101 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f536c06ace0 0x7f536c06d190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f537c007fd0 tx=0x7f537c007ec0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:04.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:04.818+0000 7f53857fa700 1 -- 172.21.15.52:0/2482643101 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f53740537e0 con 0x7f53880b9310 2023-06-23T18:45:05.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.017+0000 7f538f0c8700 1 -- 172.21.15.52:0/2482643101 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f538804e1d0 con 0x7f53880b9310 2023-06-23T18:45:05.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.019+0000 7f53857fa700 1 -- 172.21.15.52:0/2482643101 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7f5374056e00 con 0x7f53880b9310 2023-06-23T18:45:05.024 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:05.024 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","created":"2023-06-23T18:44:31.918434+0000","modified":"2023-06-23T18:44:51.644330+0000","last_up_change":"2023-06-23T18:44:42.169624+0000","last_in_change":"2023-06-23T18:44:34.510501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-23T18:44:43.346578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-23T18:44:43.829719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:44:48.517897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:44:49.621134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c371fb28-1b15-4e43-8d5a-43e402920ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6812","nonce":1066999520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6815","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6818","nonce":1066999520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6829","nonce":1066999520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6823","nonce":1066999520}]},"public_addr":"172.21.15.52:6812/1066999520","cluster_addr":"172.21.15.52:6818/1066999520","heartbeat_back_addr":"172.21.15.52:6829/1066999520","heartbeat_front_addr":"172.21.15.52:6823/1066999520","state":["exists","up"]},{"osd":1,"uuid":"4a142f04-33eb-47ec-9cc5-b08b44d82658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6813","nonce":2360219751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6819","nonce":2360219751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6830","nonce":2360219751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6825","nonce":2360219751}]},"public_addr":"172.21.15.52:6813/2360219751","cluster_addr":"172.21.15.52:6819/2360219751","heartbeat_back_addr":"172.21.15.52:6830/2360219751","heartbeat_front_addr":"172.21.15.52:6825/2360219751","state":["exists","up"]},{"osd":2,"uuid":"d7bb089d-4c55-4370-ba59-7fe88c39512a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6801","nonce":835073005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6803","nonce":835073005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6807","nonce":835073005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6805","nonce":835073005}]},"public_addr":"172.21.15.52:6801/835073005","cluster_addr":"172.21.15.52:6803/835073005","heartbeat_back_addr":"172.21.15.52:6807/835073005","heartbeat_front_addr":"172.21.15.52:6805/835073005","state":["exists","up"]},{"osd":3,"uuid":"4bcdcdc3-6a8f-468e-877e-57f76079ac3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6811","nonce":2852700864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6817","nonce":2852700864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6831","nonce":2852700864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6824","nonce":2852700864}]},"public_addr":"172.21.15.52:6811/2852700864","cluster_addr":"172.21.15.52:6817/2852700864","heartbeat_back_addr":"172.21.15.52:6831/2852700864","heartbeat_front_addr":"172.21.15.52:6824/2852700864","state":["exists","up"]},{"osd":4,"uuid":"cac63000-ae94-4b08-93e6-a99119640b63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6809","nonce":2538664679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6811","nonce":2538664679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6815","nonce":2538664679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6813","nonce":2538664679}]},"public_addr":"172.21.15.89:6809/2538664679","cluster_addr":"172.21.15.89:6811/2538664679","heartbeat_back_addr":"172.21.15.89:6815/2538664679","heartbeat_front_addr":"172.21.15.89:6813/2538664679","state":["exists","up"]},{"osd":5,"uuid":"45c53102-18a6-4fd7-9c25-8ea5e1ef6851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6801","nonce":1683710352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6803","nonce":1683710352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6807","nonce":1683710352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6805","nonce":1683710352}]},"public_addr":"172.21.15.89:6801/1683710352","cluster_addr":"172.21.15.89:6803/1683710352","heartbeat_back_addr":"172.21.15.89:6807/1683710352","heartbeat_front_addr":"172.21.15.89:6805/1683710352","state":["exists","up"]},{"osd":6,"uuid":"abee09d1-8eba-484f-a25c-871c1fe2e843","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6817","nonce":3890899288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6819","nonce":3890899288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6823","nonce":3890899288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6821","nonce":3890899288}]},"public_addr":"172.21.15.89:6817/3890899288","cluster_addr":"172.21.15.89:6819/3890899288","heartbeat_back_addr":"172.21.15.89:6823/3890899288","heartbeat_front_addr":"172.21.15.89:6821/3890899288","state":["exists","up"]},{"osd":7,"uuid":"5acf9e2e-00dd-4f9b-a7d9-3d820f695de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6825","nonce":2989085420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6827","nonce":2989085420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6831","nonce":2989085420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6829","nonce":2989085420}]},"public_addr":"172.21.15.89:6825/2989085420","cluster_addr":"172.21.15.89:6827/2989085420","heartbeat_back_addr":"172.21.15.89:6831/2989085420","heartbeat_front_addr":"172.21.15.89:6829/2989085420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.663866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.710904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.619347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.660102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.686933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.724635+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.669111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.678740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:45:05.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.021+0000 7f538f0c8700 1 -- 172.21.15.52:0/2482643101 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f536c06ace0 msgr2=0x7f536c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:05.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.021+0000 7f538f0c8700 1 --2- 172.21.15.52:0/2482643101 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f536c06ace0 0x7f536c06d190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f537c007fd0 tx=0x7f537c007ec0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.021+0000 7f538f0c8700 1 -- 172.21.15.52:0/2482643101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53880b9310 msgr2=0x7f5388142100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:05.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.021+0000 7f538f0c8700 1 --2- 172.21.15.52:0/2482643101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53880b9310 0x7f5388142100 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f537400c420 tx=0x7f537400c730 comp rx=0 tx=0).stop 2023-06-23T18:45:05.026 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.021+0000 7f538f0c8700 1 -- 172.21.15.52:0/2482643101 shutdown_connections 2023-06-23T18:45:05.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.021+0000 7f538f0c8700 1 --2- 172.21.15.52:0/2482643101 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f536c06ace0 0x7f536c06d190 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.021+0000 7f538f0c8700 1 --2- 172.21.15.52:0/2482643101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f538814da40 0x7f53881472f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.021+0000 7f538f0c8700 1 --2- 172.21.15.52:0/2482643101 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f538806c1f0 0x7f5388145c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.021+0000 7f538f0c8700 1 --2- 172.21.15.52:0/2482643101 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f53880b9310 0x7f5388142100 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.021+0000 7f538f0c8700 1 -- 172.21.15.52:0/2482643101 >> 172.21.15.52:0/2482643101 conn(0x7f53880bdf30 msgr2=0x7f53880bb470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:05.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.021+0000 7f538f0c8700 1 -- 172.21.15.52:0/2482643101 shutdown_connections 2023-06-23T18:45:05.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.021+0000 7f538f0c8700 1 -- 172.21.15.52:0/2482643101 wait complete. 2023-06-23T18:45:05.038 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T18:45:05.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.159+0000 7fe6e985f700 1 Processor -- start 2023-06-23T18:45:05.165 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.159+0000 7fe6e985f700 1 -- start start 2023-06-23T18:45:05.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.160+0000 7fe6e985f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe6e406a0d0 0x7fe6e40bc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:05.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.160+0000 7fe6e985f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe6e4144920 0x7fe6e4154da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:05.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.160+0000 7fe6e985f700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e40b7aa0 con 0x7fe6e41444a0 2023-06-23T18:45:05.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.160+0000 7fe6e985f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e40b5f30 con 0x7fe6e4144920 2023-06-23T18:45:05.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.160+0000 7fe6e985f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e40b6210 con 0x7fe6e406a0d0 2023-06-23T18:45:05.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.160+0000 7fe6e37fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe6e4144920 0x7fe6e4154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:05.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.160+0000 7fe6dbfff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe6e41444a0 0x7fe6e40b54e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:44958/0 (socket says 172.21.15.52:44958) 2023-06-23T18:45:05.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.160+0000 7fe6dbfff700 1 -- 172.21.15.52:0/2925476632 learned_addr learned my addr 172.21.15.52:0/2925476632 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:05.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.160+0000 7fe6e2ffd700 1 --2- 172.21.15.52:0/2925476632 >> v2:172.21.15.89:3300/0 conn(0x7fe6e406a0d0 0x7fe6e40bc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:05.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.160+0000 7fe6e37fe700 1 -- 172.21.15.52:0/2925476632 >> v2:172.21.15.89:3300/0 conn(0x7fe6e406a0d0 msgr2=0x7fe6e40bc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:05.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.160+0000 7fe6e37fe700 1 --2- 172.21.15.52:0/2925476632 >> v2:172.21.15.89:3300/0 conn(0x7fe6e406a0d0 0x7fe6e40bc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.160+0000 7fe6e37fe700 1 -- 172.21.15.52:0/2925476632 >> v1:172.21.15.52:6789/0 conn(0x7fe6e41444a0 legacy=0x7fe6e40b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:05.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.160+0000 7fe6e37fe700 1 -- 172.21.15.52:0/2925476632 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e40b64f0 con 0x7fe6e4144920 2023-06-23T18:45:05.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.160+0000 7fe6e27fc700 1 -- 172.21.15.52:0/2925476632 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3900976131 0 0) 0x7fe6e40b7aa0 con 0x7fe6e41444a0 2023-06-23T18:45:05.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.161+0000 7fe6e37fe700 1 --2- 172.21.15.52:0/2925476632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6e4144920 0x7fe6e4154da0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe6e408a170 tx=0x7fe6dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfbc3e9ec07848d3 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:05.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.161+0000 7fe6e27fc700 1 -- 172.21.15.52:0/2925476632 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc00e070 con 0x7fe6e4144920 2023-06-23T18:45:05.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.161+0000 7fe6e27fc700 1 -- 172.21.15.52:0/2925476632 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6dc00bbd0 con 0x7fe6e4144920 2023-06-23T18:45:05.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.161+0000 7fe6e27fc700 1 -- 172.21.15.52:0/2925476632 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc012430 con 0x7fe6e4144920 2023-06-23T18:45:05.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.161+0000 7fe6e985f700 1 -- 172.21.15.52:0/2925476632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6e4144920 msgr2=0x7fe6e4154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:05.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.161+0000 7fe6e985f700 1 --2- 172.21.15.52:0/2925476632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6e4144920 0x7fe6e4154da0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe6e408a170 tx=0x7fe6dc00b330 comp rx=0 tx=0).stop 2023-06-23T18:45:05.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.161+0000 7fe6e985f700 1 -- 172.21.15.52:0/2925476632 shutdown_connections 2023-06-23T18:45:05.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.161+0000 7fe6e985f700 1 --2- 172.21.15.52:0/2925476632 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6e4144920 0x7fe6e4154da0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.161+0000 7fe6e985f700 1 --2- 172.21.15.52:0/2925476632 >> v2:172.21.15.89:3300/0 conn(0x7fe6e406a0d0 0x7fe6e40bc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.161+0000 7fe6e985f700 1 -- 172.21.15.52:0/2925476632 >> 172.21.15.52:0/2925476632 conn(0x7fe6e406bb90 msgr2=0x7fe6e406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:05.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.161+0000 7fe6e985f700 1 -- 172.21.15.52:0/2925476632 shutdown_connections 2023-06-23T18:45:05.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.161+0000 7fe6e985f700 1 -- 172.21.15.52:0/2925476632 wait complete. 2023-06-23T18:45:05.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.162+0000 7fe6e985f700 1 Processor -- start 2023-06-23T18:45:05.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.162+0000 7fe6e985f700 1 -- start start 2023-06-23T18:45:05.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.163+0000 7fe6e985f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6e406a0d0 0x7fe6e41d6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:05.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.163+0000 7fe6e985f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6e41444a0 0x7fe6e4140780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:05.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.163+0000 7fe6e985f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6e4144920 0x7fe6e4140cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:05.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.163+0000 7fe6e985f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e41d70d0 con 0x7fe6e41444a0 2023-06-23T18:45:05.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.163+0000 7fe6e985f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e4141570 con 0x7fe6e4144920 2023-06-23T18:45:05.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.163+0000 7fe6e985f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e41d74e0 con 0x7fe6e406a0d0 2023-06-23T18:45:05.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.163+0000 7fe6dbfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6e41444a0 0x7fe6e4140780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:05.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.163+0000 7fe6dbfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6e41444a0 0x7fe6e4140780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52488/0 (socket says 172.21.15.52:52488) 2023-06-23T18:45:05.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.163+0000 7fe6dbfff700 1 -- 172.21.15.52:0/3307870933 learned_addr learned my addr 172.21.15.52:0/3307870933 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:05.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.163+0000 7fe6e2ffd700 1 --2- 172.21.15.52:0/3307870933 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6e406a0d0 0x7fe6e41d6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:05.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.163+0000 7fe6e37fe700 1 --2- 172.21.15.52:0/3307870933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6e4144920 0x7fe6e4140cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:05.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.163+0000 7fe6dbfff700 1 -- 172.21.15.52:0/3307870933 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6e406a0d0 msgr2=0x7fe6e41d6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:05.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.163+0000 7fe6dbfff700 1 --2- 172.21.15.52:0/3307870933 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6e406a0d0 0x7fe6e41d6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.163+0000 7fe6dbfff700 1 -- 172.21.15.52:0/3307870933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6e4144920 msgr2=0x7fe6e4140cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:05.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.163+0000 7fe6dbfff700 1 --2- 172.21.15.52:0/3307870933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6e4144920 0x7fe6e4140cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.163+0000 7fe6dbfff700 1 -- 172.21.15.52:0/3307870933 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6dc009a70 con 0x7fe6e41444a0 2023-06-23T18:45:05.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.163+0000 7fe6dbfff700 1 --2- 172.21.15.52:0/3307870933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6e41444a0 0x7fe6e4140780 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc00c750 tx=0x7fe6cc00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:05.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.164+0000 7fe6e0ff9700 1 -- 172.21.15.52:0/3307870933 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc004c80 con 0x7fe6e41444a0 2023-06-23T18:45:05.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.164+0000 7fe6e0ff9700 1 -- 172.21.15.52:0/3307870933 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6cc004e00 con 0x7fe6e41444a0 2023-06-23T18:45:05.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.164+0000 7fe6e0ff9700 1 -- 172.21.15.52:0/3307870933 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc007310 con 0x7fe6e41444a0 2023-06-23T18:45:05.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.164+0000 7fe6e985f700 1 -- 172.21.15.52:0/3307870933 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e4142ec0 con 0x7fe6e41444a0 2023-06-23T18:45:05.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.164+0000 7fe6e985f700 1 -- 172.21.15.52:0/3307870933 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e41434a0 con 0x7fe6e41444a0 2023-06-23T18:45:05.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.165+0000 7fe6e985f700 1 -- 172.21.15.52:0/3307870933 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e40bcd70 con 0x7fe6e41444a0 2023-06-23T18:45:05.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.166+0000 7fe6e0ff9700 1 -- 172.21.15.52:0/3307870933 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe6cc007470 con 0x7fe6e41444a0 2023-06-23T18:45:05.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.166+0000 7fe6e0ff9700 1 --2- 172.21.15.52:0/3307870933 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe6c406ace0 0x7fe6c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:05.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.166+0000 7fe6e0ff9700 1 -- 172.21.15.52:0/3307870933 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe6cc0893d0 con 0x7fe6e41444a0 2023-06-23T18:45:05.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.166+0000 7fe6e2ffd700 1 --2- 172.21.15.52:0/3307870933 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe6c406ace0 0x7fe6c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:05.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.167+0000 7fe6e2ffd700 1 --2- 172.21.15.52:0/3307870933 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe6c406ace0 0x7fe6c406d190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009930 tx=0x7fe6d4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:05.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.171+0000 7fe6e0ff9700 1 -- 172.21.15.52:0/3307870933 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe6cc054350 con 0x7fe6e41444a0 2023-06-23T18:45:05.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.411+0000 7fe6e985f700 1 -- 172.21.15.52:0/3307870933 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6e404e1d0 con 0x7fe6e41444a0 2023-06-23T18:45:05.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.412+0000 7fe6e0ff9700 1 -- 172.21.15.52:0/3307870933 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3906 (secure 0 0 0) 0x7fe6cc057970 con 0x7fe6e41444a0 2023-06-23T18:45:05.417 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:05.417 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/299877491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":299877491},{"type":"v1","addr":"172.21.15.89:6835","nonce":299877491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/2826461143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2826461143},{"type":"v1","addr":"172.21.15.52:6833","nonce":2826461143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T18:44:50.642376+0000","modified":"2023-06-23T18:44:53.679243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/4214822260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4214822260},{"type":"v1","addr":"172.21.15.52:6835","nonce":4214822260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-23T18:45:05.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.414+0000 7fe6e985f700 1 -- 172.21.15.52:0/3307870933 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe6c406ace0 msgr2=0x7fe6c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:05.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.414+0000 7fe6e985f700 1 --2- 172.21.15.52:0/3307870933 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe6c406ace0 0x7fe6c406d190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009930 tx=0x7fe6d4008040 comp rx=0 tx=0).stop 2023-06-23T18:45:05.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.414+0000 7fe6e985f700 1 -- 172.21.15.52:0/3307870933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6e41444a0 msgr2=0x7fe6e4140780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:05.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.414+0000 7fe6e985f700 1 --2- 172.21.15.52:0/3307870933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6e41444a0 0x7fe6e4140780 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc00c750 tx=0x7fe6cc00cb10 comp rx=0 tx=0).stop 2023-06-23T18:45:05.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.414+0000 7fe6e985f700 1 -- 172.21.15.52:0/3307870933 shutdown_connections 2023-06-23T18:45:05.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.414+0000 7fe6e985f700 1 --2- 172.21.15.52:0/3307870933 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe6c406ace0 0x7fe6c406d190 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.414+0000 7fe6e985f700 1 --2- 172.21.15.52:0/3307870933 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6e4144920 0x7fe6e4140cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.414+0000 7fe6e985f700 1 --2- 172.21.15.52:0/3307870933 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6e406a0d0 0x7fe6e41d6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.414+0000 7fe6e985f700 1 --2- 172.21.15.52:0/3307870933 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6e41444a0 0x7fe6e4140780 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.414+0000 7fe6e985f700 1 -- 172.21.15.52:0/3307870933 >> 172.21.15.52:0/3307870933 conn(0x7fe6e406bb90 msgr2=0x7fe6e414a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:05.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.414+0000 7fe6e985f700 1 -- 172.21.15.52:0/3307870933 shutdown_connections 2023-06-23T18:45:05.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.414+0000 7fe6e985f700 1 -- 172.21.15.52:0/3307870933 wait complete. 2023-06-23T18:45:05.420 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2023-06-23T18:45:05.732 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-23T18:44:50.642376+0000', 'modified': '2023-06-23T18:44:53.679243+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4275}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4275': {'gid': 4275, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.52:6835/4214822260', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6834', 'nonce': 4214822260}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 4214822260}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-23T18:45:05.732 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-23T18:45:05.733 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-06-23T18:45:05.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.855+0000 7fd70e756700 1 Processor -- start 2023-06-23T18:45:05.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.855+0000 7fd70e756700 1 -- start start 2023-06-23T18:45:05.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.855+0000 7fd70e756700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd7080b7de0 0x7fd70814a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:05.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.855+0000 7fd70e756700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd70814ae30 0x7fd70806a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:05.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.855+0000 7fd70e756700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7080b37c0 con 0x7fd70806f0d0 2023-06-23T18:45:05.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.855+0000 7fd70e756700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70814b2d0 con 0x7fd7080b7de0 2023-06-23T18:45:05.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.855+0000 7fd70e756700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7080706b0 con 0x7fd70814ae30 2023-06-23T18:45:05.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.855+0000 7fd707fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd7080b7de0 0x7fd70814a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:05.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.856+0000 7fd707fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fd7080b7de0 0x7fd70814a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38276/0 (socket says 172.21.15.52:38276) 2023-06-23T18:45:05.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.856+0000 7fd707fff700 1 -- 172.21.15.52:0/3271185665 learned_addr learned my addr 172.21.15.52:0/3271185665 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:05.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.856+0000 7fd70ccf3700 1 --2- 172.21.15.52:0/3271185665 >> v2:172.21.15.89:3300/0 conn(0x7fd70814ae30 0x7fd70806a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:05.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.856+0000 7fd707fff700 1 -- 172.21.15.52:0/3271185665 >> v2:172.21.15.89:3300/0 conn(0x7fd70814ae30 msgr2=0x7fd70806a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:05.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.856+0000 7fd707fff700 1 --2- 172.21.15.52:0/3271185665 >> v2:172.21.15.89:3300/0 conn(0x7fd70814ae30 0x7fd70806a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.856+0000 7fd707fff700 1 -- 172.21.15.52:0/3271185665 >> v1:172.21.15.89:6789/0 conn(0x7fd70806f0d0 legacy=0x7fd708069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:05.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.856+0000 7fd707fff700 1 -- 172.21.15.52:0/3271185665 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd708070990 con 0x7fd7080b7de0 2023-06-23T18:45:05.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.856+0000 7fd707fff700 1 --2- 172.21.15.52:0/3271185665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7080b7de0 0x7fd70814a8f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd708071a10 tx=0x7fd6f800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0f5fc6ae74f56c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:05.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.856+0000 7fd706ffd700 1 -- 172.21.15.52:0/3271185665 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f800dd30 con 0x7fd7080b7de0 2023-06-23T18:45:05.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.856+0000 7fd706ffd700 1 -- 172.21.15.52:0/3271185665 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f800de90 con 0x7fd7080b7de0 2023-06-23T18:45:05.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.856+0000 7fd706ffd700 1 -- 172.21.15.52:0/3271185665 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8010690 con 0x7fd7080b7de0 2023-06-23T18:45:05.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.857+0000 7fd70e756700 1 -- 172.21.15.52:0/3271185665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7080b7de0 msgr2=0x7fd70814a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:05.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.857+0000 7fd70e756700 1 --2- 172.21.15.52:0/3271185665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7080b7de0 0x7fd70814a8f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd708071a10 tx=0x7fd6f800be70 comp rx=0 tx=0).stop 2023-06-23T18:45:05.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.857+0000 7fd70e756700 1 -- 172.21.15.52:0/3271185665 shutdown_connections 2023-06-23T18:45:05.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.857+0000 7fd70e756700 1 --2- 172.21.15.52:0/3271185665 >> v2:172.21.15.89:3300/0 conn(0x7fd70814ae30 0x7fd70806a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.857+0000 7fd70e756700 1 --2- 172.21.15.52:0/3271185665 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd7080b7de0 0x7fd70814a8f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.857+0000 7fd70e756700 1 -- 172.21.15.52:0/3271185665 >> 172.21.15.52:0/3271185665 conn(0x7fd7080bc170 msgr2=0x7fd7080bc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:05.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.857+0000 7fd70e756700 1 -- 172.21.15.52:0/3271185665 shutdown_connections 2023-06-23T18:45:05.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.857+0000 7fd70e756700 1 -- 172.21.15.52:0/3271185665 wait complete. 2023-06-23T18:45:05.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.858+0000 7fd70e756700 1 Processor -- start 2023-06-23T18:45:05.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.858+0000 7fd70e756700 1 -- start start 2023-06-23T18:45:05.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.859+0000 7fd70e756700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd70806f0d0 0x7fd7080a91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:05.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.859+0000 7fd70e756700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7080b7de0 0x7fd7080a7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:05.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.859+0000 7fd70e756700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd70814ae30 0x7fd7080a8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:05.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.859+0000 7fd70e756700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7080a9710 con 0x7fd70814ae30 2023-06-23T18:45:05.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.859+0000 7fd70e756700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7081db870 con 0x7fd7080b7de0 2023-06-23T18:45:05.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.859+0000 7fd70e756700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7081dbb50 con 0x7fd70806f0d0 2023-06-23T18:45:05.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.859+0000 7fd70ccf3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd70814ae30 0x7fd7080a8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:05.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.859+0000 7fd70ccf3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd70814ae30 0x7fd7080a8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38278/0 (socket says 172.21.15.52:38278) 2023-06-23T18:45:05.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.859+0000 7fd707fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd70806f0d0 0x7fd7080a91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:05.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.859+0000 7fd70ccf3700 1 -- 172.21.15.52:0/4174493558 learned_addr learned my addr 172.21.15.52:0/4174493558 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:05.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.859+0000 7fd7077fe700 1 --2- 172.21.15.52:0/4174493558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7080b7de0 0x7fd7080a7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:05.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.859+0000 7fd70ccf3700 1 -- 172.21.15.52:0/4174493558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd70806f0d0 msgr2=0x7fd7080a91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:05.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.859+0000 7fd70ccf3700 1 --2- 172.21.15.52:0/4174493558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd70806f0d0 0x7fd7080a91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.859+0000 7fd70ccf3700 1 -- 172.21.15.52:0/4174493558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7080b7de0 msgr2=0x7fd7080a7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:05.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.859+0000 7fd70ccf3700 1 --2- 172.21.15.52:0/4174493558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7080b7de0 0x7fd7080a7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.859+0000 7fd70ccf3700 1 -- 172.21.15.52:0/4174493558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f800b7f0 con 0x7fd70814ae30 2023-06-23T18:45:05.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.859+0000 7fd70ccf3700 1 --2- 172.21.15.52:0/4174493558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd70814ae30 0x7fd7080a8070 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd700007e60 tx=0x7fd70000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:05.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.859+0000 7fd704ff9700 1 -- 172.21.15.52:0/4174493558 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70000ed30 con 0x7fd70814ae30 2023-06-23T18:45:05.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.859+0000 7fd704ff9700 1 -- 172.21.15.52:0/4174493558 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd700014420 con 0x7fd70814ae30 2023-06-23T18:45:05.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.860+0000 7fd70e756700 1 -- 172.21.15.52:0/4174493558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7081dbe30 con 0x7fd70814ae30 2023-06-23T18:45:05.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.860+0000 7fd704ff9700 1 -- 172.21.15.52:0/4174493558 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7000147d0 con 0x7fd70814ae30 2023-06-23T18:45:05.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.860+0000 7fd70e756700 1 -- 172.21.15.52:0/4174493558 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7080a9d10 con 0x7fd70814ae30 2023-06-23T18:45:05.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.861+0000 7fd704ff9700 1 -- 172.21.15.52:0/4174493558 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd700014930 con 0x7fd70814ae30 2023-06-23T18:45:05.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.862+0000 7fd704ff9700 1 --2- 172.21.15.52:0/4174493558 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fd6f406ad10 0x7fd6f406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:05.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.862+0000 7fd704ff9700 1 -- 172.21.15.52:0/4174493558 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd700089a60 con 0x7fd70814ae30 2023-06-23T18:45:05.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.862+0000 7fd707fff700 1 --2- 172.21.15.52:0/4174493558 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fd6f406ad10 0x7fd6f406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:05.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.863+0000 7fd707fff700 1 --2- 172.21.15.52:0/4174493558 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fd6f406ad10 0x7fd6f406d1c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800b6f0 tx=0x7fd6f8012000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:05.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.863+0000 7fd71a8f1b80 1 Processor -- start 2023-06-23T18:45:05.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.864+0000 7fd71a8f1b80 1 -- start start 2023-06-23T18:45:05.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.864+0000 7fd71a8f1b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649be7aa110 0x5649be7d7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:05.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.864+0000 7fd71a8f1b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7dc830 0x5649be7d8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:05.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.864+0000 7fd71a8f1b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5649be7a5e60 0x5649be7a62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:05.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.864+0000 7fd71a8f1b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649be720ea0 con 0x5649be7dc830 2023-06-23T18:45:05.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.864+0000 7fd71a8f1b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649be694600 con 0x5649be7aa110 2023-06-23T18:45:05.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.864+0000 7fd71a8f1b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649be703910 con 0x5649be7a5e60 2023-06-23T18:45:05.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.864+0000 7fd7077fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7dc830 0x5649be7d8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:05.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.864+0000 7fd7077fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7dc830 0x5649be7d8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38288/0 (socket says 172.21.15.52:38288) 2023-06-23T18:45:05.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.864+0000 7fd7077fe700 1 -- 172.21.15.52:0/2062489088 learned_addr learned my addr 172.21.15.52:0/2062489088 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:05.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.864+0000 7fd707fff700 1 --2- 172.21.15.52:0/2062489088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649be7aa110 0x5649be7d7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:05.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.864+0000 7fd70ccf3700 1 --2- 172.21.15.52:0/2062489088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5649be7a5e60 0x5649be7a62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:05.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.864+0000 7fd7077fe700 1 -- 172.21.15.52:0/2062489088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5649be7a5e60 msgr2=0x5649be7a62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:05.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.864+0000 7fd7077fe700 1 --2- 172.21.15.52:0/2062489088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5649be7a5e60 0x5649be7a62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.878 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.864+0000 7fd7077fe700 1 -- 172.21.15.52:0/2062489088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649be7aa110 msgr2=0x5649be7d7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:05.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.864+0000 7fd7077fe700 1 --2- 172.21.15.52:0/2062489088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649be7aa110 0x5649be7d7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.865+0000 7fd7077fe700 1 -- 172.21.15.52:0/2062489088 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649be4f0790 con 0x5649be7dc830 2023-06-23T18:45:05.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.865+0000 7fd7077fe700 1 --2- 172.21.15.52:0/2062489088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7dc830 0x5649be7d8190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0016f0 tx=0x7fd6fc007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcbe071a8c941013 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:05.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.865+0000 7fd6edffb700 1 -- 172.21.15.52:0/2062489088 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc0052e0 con 0x5649be7dc830 2023-06-23T18:45:05.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.865+0000 7fd6edffb700 1 -- 172.21.15.52:0/2062489088 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6fc005440 con 0x5649be7dc830 2023-06-23T18:45:05.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.865+0000 7fd6edffb700 1 -- 172.21.15.52:0/2062489088 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc003880 con 0x5649be7dc830 2023-06-23T18:45:05.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.865+0000 7fd71a8f1b80 1 -- 172.21.15.52:0/2062489088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7dc830 msgr2=0x5649be7d8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:05.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.865+0000 7fd71a8f1b80 1 --2- 172.21.15.52:0/2062489088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7dc830 0x5649be7d8190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0016f0 tx=0x7fd6fc007ee0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.865+0000 7fd71a8f1b80 1 -- 172.21.15.52:0/2062489088 shutdown_connections 2023-06-23T18:45:05.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.865+0000 7fd71a8f1b80 1 --2- 172.21.15.52:0/2062489088 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5649be7a5e60 0x5649be7a62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.865+0000 7fd71a8f1b80 1 --2- 172.21.15.52:0/2062489088 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649be7aa110 0x5649be7d7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.865+0000 7fd71a8f1b80 1 --2- 172.21.15.52:0/2062489088 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7dc830 0x5649be7d8190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.865+0000 7fd71a8f1b80 1 -- 172.21.15.52:0/2062489088 >> 172.21.15.52:0/2062489088 conn(0x5649be7a0c90 msgr2=0x5649be7aae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:05.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.866+0000 7fd71a8f1b80 1 -- 172.21.15.52:0/2062489088 shutdown_connections 2023-06-23T18:45:05.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.866+0000 7fd71a8f1b80 1 -- 172.21.15.52:0/2062489088 wait complete. 2023-06-23T18:45:05.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.866+0000 7fd71a8f1b80 1 -- start start 2023-06-23T18:45:05.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.866+0000 7fd71a8f1b80 1 Processor -- start 2023-06-23T18:45:05.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.867+0000 7fd71a8f1b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649be7a5e60 0x5649be7edcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:05.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.867+0000 7fd71a8f1b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5649be7aa110 0x5649be7ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:05.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.867+0000 7fd71a8f1b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7dc830 0x5649be7ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:05.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.867+0000 7fd71a8f1b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649be6fcbe0 con 0x5649be7dc830 2023-06-23T18:45:05.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.867+0000 7fd71a8f1b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649be6ba5b0 con 0x5649be7a5e60 2023-06-23T18:45:05.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.867+0000 7fd71a8f1b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649be6a0910 con 0x5649be7aa110 2023-06-23T18:45:05.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.867+0000 7fd71a8f1b80 10 client.0 _ll_register_callbacks cb 0x5649be6b8b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-23T18:45:05.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.867+0000 7fd70ccf3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7dc830 0x5649be7ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:05.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.867+0000 7fd70ccf3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7dc830 0x5649be7ce6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38304/0 (socket says 172.21.15.52:38304) 2023-06-23T18:45:05.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.867+0000 7fd70ccf3700 1 -- 172.21.15.52:0/1133657495 learned_addr learned my addr 172.21.15.52:0/1133657495 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:05.882 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.867+0000 7fd707fff700 1 --2- 172.21.15.52:0/1133657495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649be7a5e60 0x5649be7edcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:05.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.867+0000 7fd7077fe700 1 --2- 172.21.15.52:0/1133657495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5649be7aa110 0x5649be7ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:05.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.867+0000 7fd70ccf3700 1 -- 172.21.15.52:0/1133657495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5649be7aa110 msgr2=0x5649be7ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:05.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.867+0000 7fd70ccf3700 1 --2- 172.21.15.52:0/1133657495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5649be7aa110 0x5649be7ce190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.867+0000 7fd70ccf3700 1 -- 172.21.15.52:0/1133657495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649be7a5e60 msgr2=0x5649be7edcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:05.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.867+0000 7fd70ccf3700 1 --2- 172.21.15.52:0/1133657495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649be7a5e60 0x5649be7edcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.867+0000 7fd70ccf3700 1 -- 172.21.15.52:0/1133657495 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7080b37c0 con 0x5649be7dc830 2023-06-23T18:45:05.883 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.867+0000 7fd707fff700 1 --2- 172.21.15.52:0/1133657495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649be7a5e60 0x5649be7edcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:05.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.868+0000 7fd70ccf3700 1 --2- 172.21.15.52:0/1133657495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7dc830 0x5649be7ce6d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd7000605f0 tx=0x7fd70005c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4244db86e43e92f3 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:05.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.868+0000 7fd6e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-06-23T18:45:05.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.868+0000 7fd6e6ffd700 1 -- 172.21.15.52:0/1133657495 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700056c30 con 0x5649be7dc830 2023-06-23T18:45:05.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.868+0000 7fd6e6ffd700 1 -- 172.21.15.52:0/1133657495 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd700060690 con 0x5649be7dc830 2023-06-23T18:45:05.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.868+0000 7fd71a8f1b80 1 -- 172.21.15.52:0/1133657495 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5649be79e2a0 con 0x5649be7dc830 2023-06-23T18:45:05.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.868+0000 7fd6e6ffd700 1 -- 172.21.15.52:0/1133657495 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd700060850 con 0x5649be7dc830 2023-06-23T18:45:05.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.868+0000 7fd71a8f1b80 10 client.4683 fetch_fsmap learned FSMap version 8 2023-06-23T18:45:05.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.868+0000 7fd71a8f1b80 1 -- 172.21.15.52:0/1133657495 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5649be5dd0a0 con 0x5649be7dc830 2023-06-23T18:45:05.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.868+0000 7fd6e6ffd700 1 -- 172.21.15.52:0/1133657495 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5649be79e2a0 con 0x5649be7dc830 2023-06-23T18:45:05.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.868+0000 7fd6e6ffd700 1 -- 172.21.15.52:0/1133657495 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 8) v1 ==== 2569+0+0 (secure 0 0 0) 0x7fd700059bc0 con 0x5649be7dc830 2023-06-23T18:45:05.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.868+0000 7fd71a8f1b80 10 client.4683 fetch_fsmap finished waiting for FSMap version 8 2023-06-23T18:45:05.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.868+0000 7fd71a8f1b80 10 client.4683 resolve_mds: resolved name 'c' to daemon mds.c 2023-06-23T18:45:05.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.868+0000 7fd71a8f1b80 20 client.4683 populate_metadata read hostname 'smithi052' 2023-06-23T18:45:05.885 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.868+0000 7fd71a8f1b80 1 --2- 172.21.15.52:0/1133657495 >> [v2:172.21.15.52:6834/4214822260,v1:172.21.15.52:6835/4214822260] conn(0x5649be7d6370 0x5649be7d6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:05.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.868+0000 7fd71a8f1b80 4 client.4683 mds_command: new command op to 4275 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-23T18:45:05.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.868+0000 7fd71a8f1b80 1 -- 172.21.15.52:0/1133657495 --> [v2:172.21.15.52:6834/4214822260,v1:172.21.15.52:6835/4214822260] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5649be77a910 con 0x5649be7d6370 2023-06-23T18:45:05.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.868+0000 7fd707fff700 1 --2- 172.21.15.52:0/1133657495 >> [v2:172.21.15.52:6834/4214822260,v1:172.21.15.52:6835/4214822260] conn(0x5649be7d6370 0x5649be7d6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:05.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.869+0000 7fd6e6ffd700 10 client.4683 ms_handle_connect on v2:172.21.15.52:6834/4214822260 2023-06-23T18:45:05.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.869+0000 7fd707fff700 1 --2- 172.21.15.52:0/1133657495 >> [v2:172.21.15.52:6834/4214822260,v1:172.21.15.52:6835/4214822260] conn(0x5649be7d6370 0x5649be7d6740 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f44083ef9e45996 server_cookie=62d0c81a66c0d31e in_seq=0 out_seq=0 2023-06-23T18:45:05.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.869+0000 7fd6e6ffd700 1 -- 172.21.15.52:0/1133657495 <== mds.0 v2:172.21.15.52:6834/4214822260 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5649be77a910 con 0x5649be7d6370 2023-06-23T18:45:05.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.869+0000 7fd6e6ffd700 10 client.4683 handle_command_reply: tid=0 2023-06-23T18:45:05.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.869+0000 7fd71a8f1b80 1 client.4683 shutdown 2023-06-23T18:45:05.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.869+0000 7fd71a8f1b80 1 -- 172.21.15.52:0/1133657495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7dc830 msgr2=0x5649be7ce6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:05.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.869+0000 7fd71a8f1b80 1 --2- 172.21.15.52:0/1133657495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7dc830 0x5649be7ce6d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd7000605f0 tx=0x7fd70005c840 comp rx=0 tx=0).stop 2023-06-23T18:45:05.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.869+0000 7fd71a8f1b80 1 -- 172.21.15.52:0/1133657495 shutdown_connections 2023-06-23T18:45:05.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.869+0000 7fd71a8f1b80 1 --2- 172.21.15.52:0/1133657495 >> [v2:172.21.15.52:6834/4214822260,v1:172.21.15.52:6835/4214822260] conn(0x5649be7d6370 0x5649be7d6740 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.869+0000 7fd71a8f1b80 1 --2- 172.21.15.52:0/1133657495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7dc830 0x5649be7ce6d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.887 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.870+0000 7fd71a8f1b80 1 --2- 172.21.15.52:0/1133657495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649be7a5e60 0x5649be7edcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.870+0000 7fd71a8f1b80 1 --2- 172.21.15.52:0/1133657495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5649be7aa110 0x5649be7ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.870+0000 7fd71a8f1b80 1 -- 172.21.15.52:0/1133657495 >> 172.21.15.52:0/1133657495 conn(0x5649be7a0c90 msgr2=0x5649be7a5680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:05.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.870+0000 7fd6e6ffd700 0 client.4683 ms_handle_reset on v2:172.21.15.52:6834/4214822260 2023-06-23T18:45:05.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.870+0000 7fd71a8f1b80 1 -- 172.21.15.52:0/1133657495 shutdown_connections 2023-06-23T18:45:05.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.870+0000 7fd71a8f1b80 1 -- 172.21.15.52:0/1133657495 wait complete. 2023-06-23T18:45:05.888 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.870+0000 7fd71a8f1b80 20 client.4683 trim_cache size 0 max 16384 2023-06-23T18:45:05.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.887+0000 7fd71a8f1b80 1 Processor -- start 2023-06-23T18:45:05.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.887+0000 7fd71a8f1b80 1 -- start start 2023-06-23T18:45:05.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.888+0000 7fd71a8f1b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649be7a5e60 0x5649be7a6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:05.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.888+0000 7fd71a8f1b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5649be7aa110 0x5649be7e73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:05.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.888+0000 7fd71a8f1b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7dc830 0x5649be7d32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:05.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.888+0000 7fd71a8f1b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649be4f1390 con 0x5649be7dc830 2023-06-23T18:45:05.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.888+0000 7fd71a8f1b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649be7d1a10 con 0x5649be7a5e60 2023-06-23T18:45:05.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.888+0000 7fd71a8f1b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649be7e2e00 con 0x5649be7aa110 2023-06-23T18:45:05.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.888+0000 7fd70ccf3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7dc830 0x5649be7d32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:05.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.888+0000 7fd70ccf3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7dc830 0x5649be7d32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38306/0 (socket says 172.21.15.52:38306) 2023-06-23T18:45:05.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.888+0000 7fd70ccf3700 1 -- 172.21.15.52:0/503922806 learned_addr learned my addr 172.21.15.52:0/503922806 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:05.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.888+0000 7fd70ccf3700 1 -- 172.21.15.52:0/503922806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5649be7aa110 msgr2=0x5649be7e73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:05.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.888+0000 7fd7077fe700 1 --2- 172.21.15.52:0/503922806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5649be7aa110 0x5649be7e73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:05.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.888+0000 7fd70ccf3700 1 --2- 172.21.15.52:0/503922806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5649be7aa110 0x5649be7e73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.888+0000 7fd707fff700 1 --2- 172.21.15.52:0/503922806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649be7a5e60 0x5649be7a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:05.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.888+0000 7fd70ccf3700 1 -- 172.21.15.52:0/503922806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649be7a5e60 msgr2=0x5649be7a6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:05.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.888+0000 7fd70ccf3700 1 --2- 172.21.15.52:0/503922806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649be7a5e60 0x5649be7a6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.888+0000 7fd70ccf3700 1 -- 172.21.15.52:0/503922806 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649be6c2b10 con 0x5649be7dc830 2023-06-23T18:45:05.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.888+0000 7fd70ccf3700 1 --2- 172.21.15.52:0/503922806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7dc830 0x5649be7d32f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd700058760 tx=0x7fd70005c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a735c288d81a994 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:05.896 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.889+0000 7fd6ee7fc700 1 -- 172.21.15.52:0/503922806 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700056c30 con 0x5649be7dc830 2023-06-23T18:45:05.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.889+0000 7fd6ee7fc700 1 -- 172.21.15.52:0/503922806 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd700087d70 con 0x5649be7dc830 2023-06-23T18:45:05.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.889+0000 7fd6ee7fc700 1 -- 172.21.15.52:0/503922806 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700077110 con 0x5649be7dc830 2023-06-23T18:45:05.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.889+0000 7fd71a8f1b80 1 -- 172.21.15.52:0/503922806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7dc830 msgr2=0x5649be7d32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:05.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.889+0000 7fd71a8f1b80 1 --2- 172.21.15.52:0/503922806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7dc830 0x5649be7d32f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd700058760 tx=0x7fd70005c000 comp rx=0 tx=0).stop 2023-06-23T18:45:05.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.889+0000 7fd71a8f1b80 1 -- 172.21.15.52:0/503922806 shutdown_connections 2023-06-23T18:45:05.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.889+0000 7fd71a8f1b80 1 --2- 172.21.15.52:0/503922806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7dc830 0x5649be7d32f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.889+0000 7fd71a8f1b80 1 --2- 172.21.15.52:0/503922806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649be7a5e60 0x5649be7a6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.889+0000 7fd71a8f1b80 1 --2- 172.21.15.52:0/503922806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5649be7aa110 0x5649be7e73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.889+0000 7fd71a8f1b80 1 -- 172.21.15.52:0/503922806 >> 172.21.15.52:0/503922806 conn(0x5649be7a0c90 msgr2=0x5649be8008a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:05.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.889+0000 7fd71a8f1b80 1 -- 172.21.15.52:0/503922806 shutdown_connections 2023-06-23T18:45:05.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.889+0000 7fd71a8f1b80 1 -- 172.21.15.52:0/503922806 wait complete. 2023-06-23T18:45:05.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.890+0000 7fd71a8f1b80 1 -- start start 2023-06-23T18:45:05.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.890+0000 7fd71a8f1b80 1 Processor -- start 2023-06-23T18:45:05.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.891+0000 7fd71a8f1b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7a5e60 0x5649be843ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:05.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.891+0000 7fd71a8f1b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5649be7aa110 0x5649be844000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:05.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.891+0000 7fd71a8f1b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649be7dc830 0x5649be7aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:05.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.891+0000 7fd71a8f1b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649be7f1460 con 0x5649be7a5e60 2023-06-23T18:45:05.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.891+0000 7fd71a8f1b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649be7cb220 con 0x5649be7dc830 2023-06-23T18:45:05.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.891+0000 7fd71a8f1b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649be844540 con 0x5649be7aa110 2023-06-23T18:45:05.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.891+0000 7fd71a8f1b80 10 client.0 _ll_register_callbacks cb 0x7fd7000583c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-23T18:45:05.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.891+0000 7fd707fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7a5e60 0x5649be843ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:05.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.891+0000 7fd707fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7a5e60 0x5649be843ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38318/0 (socket says 172.21.15.52:38318) 2023-06-23T18:45:05.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.891+0000 7fd707fff700 1 -- 172.21.15.52:0/2933862179 learned_addr learned my addr 172.21.15.52:0/2933862179 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:05.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.891+0000 7fd7077fe700 1 --2- 172.21.15.52:0/2933862179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5649be7aa110 0x5649be844000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:05.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.891+0000 7fd70ccf3700 1 --2- 172.21.15.52:0/2933862179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649be7dc830 0x5649be7aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:05.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.891+0000 7fd707fff700 1 -- 172.21.15.52:0/2933862179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5649be7aa110 msgr2=0x5649be844000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:05.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.891+0000 7fd707fff700 1 --2- 172.21.15.52:0/2933862179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5649be7aa110 0x5649be844000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.891+0000 7fd707fff700 1 -- 172.21.15.52:0/2933862179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649be7dc830 msgr2=0x5649be7aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:05.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.891+0000 7fd707fff700 1 --2- 172.21.15.52:0/2933862179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649be7dc830 0x5649be7aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.891+0000 7fd707fff700 1 -- 172.21.15.52:0/2933862179 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5649be5dd0a0 con 0x5649be7a5e60 2023-06-23T18:45:05.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.891+0000 7fd70ccf3700 1 --2- 172.21.15.52:0/2933862179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649be7dc830 0x5649be7aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:05.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.891+0000 7fd707fff700 1 --2- 172.21.15.52:0/2933862179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7a5e60 0x5649be843ac0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8006e90 tx=0x7fd6f8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78eacc6c9a7c6123 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:05.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.891+0000 7fd6e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-06-23T18:45:05.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.891+0000 7fd6e6ffd700 1 -- 172.21.15.52:0/2933862179 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f801d040 con 0x5649be7a5e60 2023-06-23T18:45:05.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.891+0000 7fd6e6ffd700 1 -- 172.21.15.52:0/2933862179 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd6f8010a40 con 0x5649be7a5e60 2023-06-23T18:45:05.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.891+0000 7fd71a8f1b80 1 -- 172.21.15.52:0/2933862179 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd6fc005440 con 0x5649be7a5e60 2023-06-23T18:45:05.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.891+0000 7fd6e6ffd700 1 -- 172.21.15.52:0/2933862179 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6f8010c00 con 0x5649be7a5e60 2023-06-23T18:45:05.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.891+0000 7fd71a8f1b80 10 client.4689 fetch_fsmap learned FSMap version 8 2023-06-23T18:45:05.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.891+0000 7fd71a8f1b80 1 -- 172.21.15.52:0/2933862179 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5649be5511d0 con 0x5649be7a5e60 2023-06-23T18:45:05.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.892+0000 7fd6e6ffd700 1 -- 172.21.15.52:0/2933862179 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6fc005440 con 0x5649be7a5e60 2023-06-23T18:45:05.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.892+0000 7fd6e6ffd700 1 -- 172.21.15.52:0/2933862179 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 8) v1 ==== 2569+0+0 (secure 0 0 0) 0x7fd6f80036a0 con 0x5649be7a5e60 2023-06-23T18:45:05.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.892+0000 7fd71a8f1b80 10 client.4689 fetch_fsmap finished waiting for FSMap version 8 2023-06-23T18:45:05.905 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.892+0000 7fd71a8f1b80 10 client.4689 resolve_mds: resolved name 'c' to daemon mds.c 2023-06-23T18:45:05.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.892+0000 7fd71a8f1b80 20 client.4689 populate_metadata read hostname 'smithi052' 2023-06-23T18:45:05.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.892+0000 7fd71a8f1b80 1 --2- 172.21.15.52:0/2933862179 >> [v2:172.21.15.52:6834/4214822260,v1:172.21.15.52:6835/4214822260] conn(0x5649be7cab20 0x5649be7ab380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:05.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.892+0000 7fd71a8f1b80 4 client.4689 mds_command: new command op to 4275 tid=0[{"prefix": "status"}] 2023-06-23T18:45:05.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.892+0000 7fd71a8f1b80 1 -- 172.21.15.52:0/2933862179 --> [v2:172.21.15.52:6834/4214822260,v1:172.21.15.52:6835/4214822260] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5649be6f5d20 con 0x5649be7cab20 2023-06-23T18:45:05.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.892+0000 7fd7077fe700 1 --2- 172.21.15.52:0/2933862179 >> [v2:172.21.15.52:6834/4214822260,v1:172.21.15.52:6835/4214822260] conn(0x5649be7cab20 0x5649be7ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:05.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.892+0000 7fd6e6ffd700 10 client.4689 ms_handle_connect on v2:172.21.15.52:6834/4214822260 2023-06-23T18:45:05.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.892+0000 7fd7077fe700 1 --2- 172.21.15.52:0/2933862179 >> [v2:172.21.15.52:6834/4214822260,v1:172.21.15.52:6835/4214822260] conn(0x5649be7cab20 0x5649be7ab380 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9398c75b582fd5e4 server_cookie=d076a825fa5b734e in_seq=0 out_seq=0 2023-06-23T18:45:05.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.892+0000 7fd6e6ffd700 1 -- 172.21.15.52:0/2933862179 <== mds.0 v2:172.21.15.52:6834/4214822260 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5649be6f5d20 con 0x5649be7cab20 2023-06-23T18:45:05.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.892+0000 7fd6e6ffd700 10 client.4689 handle_command_reply: tid=0 2023-06-23T18:45:05.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.892+0000 7fd71a8f1b80 1 client.4689 shutdown 2023-06-23T18:45:05.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.893+0000 7fd71a8f1b80 1 -- 172.21.15.52:0/2933862179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7a5e60 msgr2=0x5649be843ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:05.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.893+0000 7fd71a8f1b80 1 --2- 172.21.15.52:0/2933862179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7a5e60 0x5649be843ac0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8006e90 tx=0x7fd6f8010000 comp rx=0 tx=0).stop 2023-06-23T18:45:05.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.893+0000 7fd71a8f1b80 1 -- 172.21.15.52:0/2933862179 shutdown_connections 2023-06-23T18:45:05.907 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.893+0000 7fd71a8f1b80 1 --2- 172.21.15.52:0/2933862179 >> [v2:172.21.15.52:6834/4214822260,v1:172.21.15.52:6835/4214822260] conn(0x5649be7cab20 0x5649be7ab380 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.893+0000 7fd71a8f1b80 1 --2- 172.21.15.52:0/2933862179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x5649be7dc830 0x5649be7aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.893+0000 7fd71a8f1b80 1 --2- 172.21.15.52:0/2933862179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5649be7a5e60 0x5649be843ac0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.893+0000 7fd6e6ffd700 0 client.4689 ms_handle_reset on v2:172.21.15.52:6834/4214822260 2023-06-23T18:45:05.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.893+0000 7fd71a8f1b80 1 --2- 172.21.15.52:0/2933862179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x5649be7aa110 0x5649be844000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.893+0000 7fd71a8f1b80 1 -- 172.21.15.52:0/2933862179 >> 172.21.15.52:0/2933862179 conn(0x5649be7a0c90 msgr2=0x5649be7e7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:05.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.893+0000 7fd71a8f1b80 1 -- 172.21.15.52:0/2933862179 shutdown_connections 2023-06-23T18:45:05.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.893+0000 7fd71a8f1b80 1 -- 172.21.15.52:0/2933862179 wait complete. 2023-06-23T18:45:05.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.893+0000 7fd71a8f1b80 20 client.4689 trim_cache size 0 max 16384 2023-06-23T18:45:05.909 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-06-23T18:45:05.909 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "cd0d1792-8aa8-49a7-9e5c-ba51edbbb077", 2023-06-23T18:45:05.909 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2023-06-23T18:45:05.910 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4275, 2023-06-23T18:45:05.910 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2023-06-23T18:45:05.910 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2023-06-23T18:45:05.910 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2023-06-23T18:45:05.910 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 15.249130308, 2023-06-23T18:45:05.910 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 8, 2023-06-23T18:45:05.910 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 21, 2023-06-23T18:45:05.911 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 21, 2023-06-23T18:45:05.911 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 20.589823705000001 2023-06-23T18:45:05.911 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-06-23T18:45:05.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.893+0000 7fd70e756700 1 -- 172.21.15.52:0/4174493558 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fd6f406ad10 msgr2=0x7fd6f406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:05.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.893+0000 7fd70e756700 1 --2- 172.21.15.52:0/4174493558 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fd6f406ad10 0x7fd6f406d1c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd6f800b6f0 tx=0x7fd6f8012000 comp rx=0 tx=0).stop 2023-06-23T18:45:05.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.893+0000 7fd70e756700 1 -- 172.21.15.52:0/4174493558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd70814ae30 msgr2=0x7fd7080a8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:05.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.893+0000 7fd70e756700 1 --2- 172.21.15.52:0/4174493558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd70814ae30 0x7fd7080a8070 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd700007e60 tx=0x7fd70000e3c0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.893+0000 7fd70e756700 1 -- 172.21.15.52:0/4174493558 shutdown_connections 2023-06-23T18:45:05.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.893+0000 7fd70e756700 1 --2- 172.21.15.52:0/4174493558 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fd6f406ad10 0x7fd6f406d1c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.893+0000 7fd70e756700 1 --2- 172.21.15.52:0/4174493558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd70814ae30 0x7fd7080a8070 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.893+0000 7fd70e756700 1 --2- 172.21.15.52:0/4174493558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd70806f0d0 0x7fd7080a91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.893+0000 7fd70e756700 1 --2- 172.21.15.52:0/4174493558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7080b7de0 0x7fd7080a7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:05.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.893+0000 7fd70e756700 1 -- 172.21.15.52:0/4174493558 >> 172.21.15.52:0/4174493558 conn(0x7fd7080bc170 msgr2=0x7fd70814a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:05.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.893+0000 7fd70e756700 1 -- 172.21.15.52:0/4174493558 shutdown_connections 2023-06-23T18:45:05.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:05.893+0000 7fd70e756700 1 -- 172.21.15.52:0/4174493558 wait complete. 2023-06-23T18:45:05.914 INFO:teuthology.run_tasks:Running task kclient... 2023-06-23T18:45:05.938 INFO:tasks.kclient:Mounting kernel clients... 2023-06-23T18:45:05.939 INFO:tasks.kclient:config is {'client.0': {}} 2023-06-23T18:45:05.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:05.940 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-06-23T18:45:05.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:05.991 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link delete ceph-brx 2023-06-23T18:45:06.068 INFO:teuthology.orchestra.run.smithi158.stderr:Cannot find device "ceph-brx" 2023-06-23T18:45:06.070 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T18:45:06.071 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-06-23T18:45:06.071 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-23T18:45:06.072 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-23T18:45:06.072 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-23T18:45:06.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.194+0000 7f9a3a462700 1 Processor -- start 2023-06-23T18:45:06.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.194+0000 7f9a3a462700 1 -- start start 2023-06-23T18:45:06.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.195+0000 7f9a3a462700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9a3406c1f0 0x7f9a340b8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:06.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.195+0000 7f9a3a462700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a340b98a0 con 0x7f9a3414da40 2023-06-23T18:45:06.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.195+0000 7f9a3a462700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a3414a6a0 con 0x7f9a340b9310 2023-06-23T18:45:06.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.195+0000 7f9a3a462700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a3414a980 con 0x7f9a3406c1f0 2023-06-23T18:45:06.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.195+0000 7f9a2bfff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9a3414da40 0x7f9a3414aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48090/0 (socket says 172.21.15.52:48090) 2023-06-23T18:45:06.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.195+0000 7f9a2bfff700 1 -- 172.21.15.52:0/3754511283 learned_addr learned my addr 172.21.15.52:0/3754511283 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:06.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.195+0000 7f9a33fff700 1 --2- 172.21.15.52:0/3754511283 >> v2:172.21.15.89:3300/0 conn(0x7f9a3406c1f0 0x7f9a340b8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:06.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.195+0000 7f9a337fe700 1 -- 172.21.15.52:0/3754511283 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730771038 0 0) 0x7f9a340b98a0 con 0x7f9a3414da40 2023-06-23T18:45:06.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.195+0000 7f9a337fe700 1 -- 172.21.15.52:0/3754511283 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a200035b0 con 0x7f9a3414da40 2023-06-23T18:45:06.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.195+0000 7f9a337fe700 1 -- 172.21.15.52:0/3754511283 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006905681 0 0) 0x7f9a3414a6a0 con 0x7f9a340b9310 2023-06-23T18:45:06.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.195+0000 7f9a337fe700 1 -- 172.21.15.52:0/3754511283 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a340b98a0 con 0x7f9a340b9310 2023-06-23T18:45:06.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.195+0000 7f9a33fff700 1 -- 172.21.15.52:0/3754511283 >> v1:172.21.15.89:6789/0 conn(0x7f9a340b9310 legacy=0x7f9a341443e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:06.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.195+0000 7f9a33fff700 1 -- 172.21.15.52:0/3754511283 >> v1:172.21.15.52:6789/0 conn(0x7f9a3414da40 legacy=0x7f9a3414aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:06.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.195+0000 7f9a33fff700 1 -- 172.21.15.52:0/3754511283 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a34144af0 con 0x7f9a3406c1f0 2023-06-23T18:45:06.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.196+0000 7f9a33fff700 1 --2- 172.21.15.52:0/3754511283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a3406c1f0 0x7f9a340b8870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009840 tx=0x7f9a24009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6acc50faec818f59 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:06.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.196+0000 7f9a337fe700 1 -- 172.21.15.52:0/3754511283 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24011830 con 0x7f9a3406c1f0 2023-06-23T18:45:06.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.196+0000 7f9a337fe700 1 -- 172.21.15.52:0/3754511283 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a24011990 con 0x7f9a3406c1f0 2023-06-23T18:45:06.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.196+0000 7f9a337fe700 1 -- 172.21.15.52:0/3754511283 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24011d20 con 0x7f9a3406c1f0 2023-06-23T18:45:06.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.196+0000 7f9a3a462700 1 -- 172.21.15.52:0/3754511283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a3406c1f0 msgr2=0x7f9a340b8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:06.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.196+0000 7f9a3a462700 1 --2- 172.21.15.52:0/3754511283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a3406c1f0 0x7f9a340b8870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009840 tx=0x7f9a24009b50 comp rx=0 tx=0).stop 2023-06-23T18:45:06.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.197+0000 7f9a3a462700 1 -- 172.21.15.52:0/3754511283 shutdown_connections 2023-06-23T18:45:06.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.197+0000 7f9a3a462700 1 --2- 172.21.15.52:0/3754511283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a3406c1f0 0x7f9a340b8870 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:06.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.197+0000 7f9a3a462700 1 -- 172.21.15.52:0/3754511283 >> 172.21.15.52:0/3754511283 conn(0x7f9a340bdf30 msgr2=0x7f9a340b9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:06.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.197+0000 7f9a3a462700 1 -- 172.21.15.52:0/3754511283 shutdown_connections 2023-06-23T18:45:06.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.197+0000 7f9a3a462700 1 -- 172.21.15.52:0/3754511283 wait complete. 2023-06-23T18:45:06.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.198+0000 7f9a3a462700 1 Processor -- start 2023-06-23T18:45:06.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.198+0000 7f9a3a462700 1 -- start start 2023-06-23T18:45:06.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.199+0000 7f9a3a462700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a3406c1f0 0x7f9a34147110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:06.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.199+0000 7f9a3a462700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a340b9310 0x7f9a340b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:06.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.199+0000 7f9a3a462700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a3414da40 0x7f9a34146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:06.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.199+0000 7f9a3a462700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a34147650 con 0x7f9a3414da40 2023-06-23T18:45:06.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.199+0000 7f9a3a462700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a34145a00 con 0x7f9a3406c1f0 2023-06-23T18:45:06.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.199+0000 7f9a3a462700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a34145fc0 con 0x7f9a340b9310 2023-06-23T18:45:06.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.199+0000 7f9a389ff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a3414da40 0x7f9a34146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:06.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.199+0000 7f9a389ff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a3414da40 0x7f9a34146450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38320/0 (socket says 172.21.15.52:38320) 2023-06-23T18:45:06.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.199+0000 7f9a389ff700 1 -- 172.21.15.52:0/878936315 learned_addr learned my addr 172.21.15.52:0/878936315 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:06.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.199+0000 7f9a2bfff700 1 --2- 172.21.15.52:0/878936315 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a340b9310 0x7f9a340b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:06.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.199+0000 7f9a33fff700 1 --2- 172.21.15.52:0/878936315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a3406c1f0 0x7f9a34147110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:06.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.199+0000 7f9a389ff700 1 -- 172.21.15.52:0/878936315 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a340b9310 msgr2=0x7f9a340b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:06.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.199+0000 7f9a389ff700 1 --2- 172.21.15.52:0/878936315 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a340b9310 0x7f9a340b13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:06.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.199+0000 7f9a389ff700 1 -- 172.21.15.52:0/878936315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a3406c1f0 msgr2=0x7f9a34147110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:06.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.199+0000 7f9a389ff700 1 --2- 172.21.15.52:0/878936315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a3406c1f0 0x7f9a34147110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:06.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.199+0000 7f9a389ff700 1 -- 172.21.15.52:0/878936315 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a240094a0 con 0x7f9a3414da40 2023-06-23T18:45:06.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.199+0000 7f9a2bfff700 1 --2- 172.21.15.52:0/878936315 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a340b9310 0x7f9a340b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:45:06.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.199+0000 7f9a33fff700 1 --2- 172.21.15.52:0/878936315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a3406c1f0 0x7f9a34147110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:45:06.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.199+0000 7f9a389ff700 1 --2- 172.21.15.52:0/878936315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a3414da40 0x7f9a34146450 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00cc20 tx=0x7f9a2c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:06.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.200+0000 7f9a317fa700 1 -- 172.21.15.52:0/878936315 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c00ac20 con 0x7f9a3414da40 2023-06-23T18:45:06.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.200+0000 7f9a317fa700 1 -- 172.21.15.52:0/878936315 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c00ad80 con 0x7f9a3414da40 2023-06-23T18:45:06.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.200+0000 7f9a3a462700 1 -- 172.21.15.52:0/878936315 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a340b1900 con 0x7f9a3414da40 2023-06-23T18:45:06.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.200+0000 7f9a317fa700 1 -- 172.21.15.52:0/878936315 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c003c20 con 0x7f9a3414da40 2023-06-23T18:45:06.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.200+0000 7f9a3a462700 1 -- 172.21.15.52:0/878936315 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a340b3e60 con 0x7f9a3414da40 2023-06-23T18:45:06.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.201+0000 7f9a3a462700 1 -- 172.21.15.52:0/878936315 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a34146170 con 0x7f9a3414da40 2023-06-23T18:45:06.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.201+0000 7f9a317fa700 1 -- 172.21.15.52:0/878936315 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9a2c0050d0 con 0x7f9a3414da40 2023-06-23T18:45:06.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.202+0000 7f9a317fa700 1 --2- 172.21.15.52:0/878936315 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9a1406ace0 0x7f9a1406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:06.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.202+0000 7f9a317fa700 1 -- 172.21.15.52:0/878936315 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9a2c0895a0 con 0x7f9a3414da40 2023-06-23T18:45:06.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.202+0000 7f9a33fff700 1 --2- 172.21.15.52:0/878936315 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9a1406ace0 0x7f9a1406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:06.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.202+0000 7f9a33fff700 1 --2- 172.21.15.52:0/878936315 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9a1406ace0 0x7f9a1406d190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9a24000c00 tx=0x7f9a2401c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:06.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.206+0000 7f9a317fa700 1 -- 172.21.15.52:0/878936315 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9a34146170 con 0x7f9a3414da40 2023-06-23T18:45:06.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.451+0000 7f9a3a462700 1 -- 172.21.15.52:0/878936315 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9a34146130 con 0x7f9a3414da40 2023-06-23T18:45:06.456 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.451+0000 7f9a317fa700 1 -- 172.21.15.52:0/878936315 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9a2c0546e0 con 0x7f9a3414da40 2023-06-23T18:45:06.456 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-23T18:45:06.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.453+0000 7f9a3a462700 1 -- 172.21.15.52:0/878936315 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9a1406ace0 msgr2=0x7f9a1406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:06.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.453+0000 7f9a3a462700 1 --2- 172.21.15.52:0/878936315 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9a1406ace0 0x7f9a1406d190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9a24000c00 tx=0x7f9a2401c040 comp rx=0 tx=0).stop 2023-06-23T18:45:06.458 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.453+0000 7f9a3a462700 1 -- 172.21.15.52:0/878936315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a3414da40 msgr2=0x7f9a34146450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:06.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.453+0000 7f9a3a462700 1 --2- 172.21.15.52:0/878936315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a3414da40 0x7f9a34146450 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00cc20 tx=0x7f9a2c00a060 comp rx=0 tx=0).stop 2023-06-23T18:45:06.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.453+0000 7f9a3a462700 1 -- 172.21.15.52:0/878936315 shutdown_connections 2023-06-23T18:45:06.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.453+0000 7f9a3a462700 1 --2- 172.21.15.52:0/878936315 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9a1406ace0 0x7f9a1406d190 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:06.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.453+0000 7f9a3a462700 1 --2- 172.21.15.52:0/878936315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a3414da40 0x7f9a34146450 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:06.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.453+0000 7f9a3a462700 1 --2- 172.21.15.52:0/878936315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a3406c1f0 0x7f9a34147110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:06.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.453+0000 7f9a3a462700 1 --2- 172.21.15.52:0/878936315 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a340b9310 0x7f9a340b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:06.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.453+0000 7f9a3a462700 1 -- 172.21.15.52:0/878936315 >> 172.21.15.52:0/878936315 conn(0x7f9a340bdf30 msgr2=0x7f9a340bb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:06.459 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.453+0000 7f9a3a462700 1 -- 172.21.15.52:0/878936315 shutdown_connections 2023-06-23T18:45:06.460 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:06.453+0000 7f9a3a462700 1 -- 172.21.15.52:0/878936315 wait complete. 2023-06-23T18:45:06.470 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-23T18:45:06.470 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-23T18:45:06.471 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi158.front.sepia.ceph.com 2023-06-23T18:45:06.471 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-23T18:45:06.471 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-23T18:45:06.471 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-23T18:45:06.471 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-23T18:45:06.472 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-23T18:45:06.472 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-23T18:45:06.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:06.473 DEBUG:teuthology.orchestra.run.smithi158:> ip addr 2023-06-23T18:45:06.518 INFO:teuthology.orchestra.run.smithi158.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-23T18:45:06.519 INFO:teuthology.orchestra.run.smithi158.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-23T18:45:06.519 INFO:teuthology.orchestra.run.smithi158.stdout: inet 127.0.0.1/8 scope host lo 2023-06-23T18:45:06.520 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-06-23T18:45:06.520 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 ::1/128 scope host 2023-06-23T18:45:06.520 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-06-23T18:45:06.520 INFO:teuthology.orchestra.run.smithi158.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-23T18:45:06.521 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d4 brd ff:ff:ff:ff:ff:ff 2023-06-23T18:45:06.521 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f0 2023-06-23T18:45:06.521 INFO:teuthology.orchestra.run.smithi158.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-23T18:45:06.521 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d5 brd ff:ff:ff:ff:ff:ff 2023-06-23T18:45:06.521 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f1 2023-06-23T18:45:06.521 INFO:teuthology.orchestra.run.smithi158.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-23T18:45:06.521 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6e brd ff:ff:ff:ff:ff:ff 2023-06-23T18:45:06.522 INFO:teuthology.orchestra.run.smithi158.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-23T18:45:06.522 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6f brd ff:ff:ff:ff:ff:ff 2023-06-23T18:45:06.522 INFO:teuthology.orchestra.run.smithi158.stdout: inet 172.21.15.158/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-06-23T18:45:06.522 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft 42369sec preferred_lft 42369sec 2023-06-23T18:45:06.522 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::ec4:7aff:fe88:726f/64 scope link 2023-06-23T18:45:06.522 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-06-23T18:45:06.523 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-23T18:45:06.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:06.524 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-06-23T18:45:06.524 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-06-23T18:45:06.525 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link add name ceph-brx type bridge 2023-06-23T18:45:06.525 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip addr flush dev ceph-brx 2023-06-23T18:45:06.525 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set ceph-brx up 2023-06-23T18:45:06.525 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-23T18:45:06.525 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-06-23T18:45:06.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:06.950 DEBUG:teuthology.orchestra.run.smithi158:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-23T18:45:07.049 INFO:teuthology.orchestra.run.smithi158.stdout:1 2023-06-23T18:45:07.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:07.052 DEBUG:teuthology.orchestra.run.smithi158:> route 2023-06-23T18:45:07.130 INFO:teuthology.orchestra.run.smithi158.stdout:Kernel IP routing table 2023-06-23T18:45:07.131 INFO:teuthology.orchestra.run.smithi158.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-23T18:45:07.131 INFO:teuthology.orchestra.run.smithi158.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-23T18:45:07.131 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-23T18:45:07.131 INFO:teuthology.orchestra.run.smithi158.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-23T18:45:07.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:07.133 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-06-23T18:45:07.133 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-06-23T18:45:07.133 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-23T18:45:07.133 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-23T18:45:07.134 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-23T18:45:07.134 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-06-23T18:45:07.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:07.827 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-06-23T18:45:07.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:07.874 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list-id 2023-06-23T18:45:07.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:07.959 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-06-23T18:45:07.960 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-06-23T18:45:07.960 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-23T18:45:07.960 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-06-23T18:45:07.960 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-06-23T18:45:08.101 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-06-23T18:45:08.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:08.102 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-06-23T18:45:08.103 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-06-23T18:45:08.103 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-06-23T18:45:08.103 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-23T18:45:08.103 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-06-23T18:45:08.104 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-06-23T18:45:08.104 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-06-23T18:45:08.104 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-06-23T18:45:08.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:08.373 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-06-23T18:45:08.374 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-06-23T18:45:08.374 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set brx.0 up 2023-06-23T18:45:08.374 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set dev brx.0 master ceph-brx 2023-06-23T18:45:08.374 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-06-23T18:45:08.553 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-23T18:45:08.553 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-23T18:45:08.598 INFO:teuthology.orchestra.run.smithi158.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-23T18:45:08.599 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-23T18:45:08.599 DEBUG:teuthology.orchestra.run.smithi158:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-23T18:45:08.683 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-06-23T18:45:08.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:08.684 DEBUG:teuthology.orchestra.run.smithi158:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-23T18:45:08.827 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-23T18:45:08.827 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-23T18:45:09.282 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-23T18:45:09.283 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-23T18:45:09.283 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-06-23T18:45:09.283 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 0@cd0d1792-8aa8-49a7-9e5c-ba51edbbb077.cephfs=/ 2023-06-23T18:45:09.283 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.52:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2023-06-23T18:45:09.290 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-23T18:45:09.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:09.291 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-23T18:45:09.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:09.361 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-23T18:45:09.470 INFO:teuthology.orchestra.run.smithi158.stdout:client4698 2023-06-23T18:45:09.471 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-06-23T18:45:09.471 DEBUG:teuthology.orchestra.run.smithi158:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T18:45:09.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:09.517 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-23T18:45:09.666 INFO:teuthology.orchestra.run.smithi158.stdout:client4698 2023-06-23T18:45:09.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:09.667 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-23T18:45:09.772 INFO:teuthology.orchestra.run.smithi158.stdout:client4698 2023-06-23T18:45:09.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:09.773 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/cd0d1792-8aa8-49a7-9e5c-ba51edbbb077.client4698/status') 2023-06-23T18:45:09.894 INFO:teuthology.orchestra.run.smithi158.stdout:instance: client.4698 (3)172.21.15.158:0/1035066547 2023-06-23T18:45:09.894 INFO:teuthology.orchestra.run.smithi158.stdout:blocklisted: false 2023-06-23T18:45:09.895 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records in 2023-06-23T18:45:09.895 INFO:teuthology.orchestra.run.smithi158.stderr:0+1 records out 2023-06-23T18:45:09.895 INFO:teuthology.orchestra.run.smithi158.stderr:71 bytes copied, 5.4287e-05 s, 1.3 MB/s 2023-06-23T18:45:09.897 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-06-23T18:45:09.914 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:45:10.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.049+0000 7fdc5f68e700 1 Processor -- start 2023-06-23T18:45:10.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.049+0000 7fdc5f68e700 1 -- start start 2023-06-23T18:45:10.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.049+0000 7fdc5f68e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc5806a0d0 0x7fdc580bc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:10.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.049+0000 7fdc5f68e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdc581448f0 0x7fdc58154da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:10.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.050+0000 7fdc5f68e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc580b7aa0 con 0x7fdc581444a0 2023-06-23T18:45:10.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.050+0000 7fdc5f68e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc580b5f30 con 0x7fdc581448f0 2023-06-23T18:45:10.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.050+0000 7fdc5f68e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc580b6210 con 0x7fdc5806a0d0 2023-06-23T18:45:10.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.050+0000 7fdc5dc2b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdc581448f0 0x7fdc58154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:10.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.050+0000 7fdc5dc2b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdc581448f0 0x7fdc58154da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38328/0 (socket says 172.21.15.52:38328) 2023-06-23T18:45:10.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.050+0000 7fdc5dc2b700 1 -- 172.21.15.52:0/286215704 learned_addr learned my addr 172.21.15.52:0/286215704 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:10.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.050+0000 7fdc5d42a700 1 --2- 172.21.15.52:0/286215704 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc5806a0d0 0x7fdc580bc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:10.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.050+0000 7fdc5dc2b700 1 -- 172.21.15.52:0/286215704 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc5806a0d0 msgr2=0x7fdc580bc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:10.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.050+0000 7fdc5dc2b700 1 --2- 172.21.15.52:0/286215704 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc5806a0d0 0x7fdc580bc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:10.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.050+0000 7fdc5dc2b700 1 -- 172.21.15.52:0/286215704 >> v1:172.21.15.89:6789/0 conn(0x7fdc581444a0 legacy=0x7fdc580b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:10.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.050+0000 7fdc5dc2b700 1 -- 172.21.15.52:0/286215704 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc580b64f0 con 0x7fdc581448f0 2023-06-23T18:45:10.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.050+0000 7fdc5d42a700 1 --2- 172.21.15.52:0/286215704 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc5806a0d0 0x7fdc580bc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:45:10.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.050+0000 7fdc5dc2b700 1 --2- 172.21.15.52:0/286215704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc581448f0 0x7fdc58154da0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009e50 tx=0x7fdc5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d2990809300dcb server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:10.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.050+0000 7fdc4bfff700 1 -- 172.21.15.52:0/286215704 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5000e070 con 0x7fdc581448f0 2023-06-23T18:45:10.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.050+0000 7fdc4bfff700 1 -- 172.21.15.52:0/286215704 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc50003a20 con 0x7fdc581448f0 2023-06-23T18:45:10.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.050+0000 7fdc4bfff700 1 -- 172.21.15.52:0/286215704 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc50003dd0 con 0x7fdc581448f0 2023-06-23T18:45:10.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.051+0000 7fdc5f68e700 1 -- 172.21.15.52:0/286215704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc581448f0 msgr2=0x7fdc58154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:10.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.051+0000 7fdc5f68e700 1 --2- 172.21.15.52:0/286215704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc581448f0 0x7fdc58154da0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009e50 tx=0x7fdc5000b330 comp rx=0 tx=0).stop 2023-06-23T18:45:10.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.051+0000 7fdc5f68e700 1 -- 172.21.15.52:0/286215704 shutdown_connections 2023-06-23T18:45:10.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.051+0000 7fdc5f68e700 1 --2- 172.21.15.52:0/286215704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc581448f0 0x7fdc58154da0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:10.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.051+0000 7fdc5f68e700 1 --2- 172.21.15.52:0/286215704 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc5806a0d0 0x7fdc580bc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:10.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.051+0000 7fdc5f68e700 1 -- 172.21.15.52:0/286215704 >> 172.21.15.52:0/286215704 conn(0x7fdc5806bb90 msgr2=0x7fdc5806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:10.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.051+0000 7fdc5f68e700 1 -- 172.21.15.52:0/286215704 shutdown_connections 2023-06-23T18:45:10.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.051+0000 7fdc5f68e700 1 -- 172.21.15.52:0/286215704 wait complete. 2023-06-23T18:45:10.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.053+0000 7fdc5f68e700 1 Processor -- start 2023-06-23T18:45:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.053+0000 7fdc5f68e700 1 -- start start 2023-06-23T18:45:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.053+0000 7fdc5f68e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc5806a0d0 0x7fdc580baf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.053+0000 7fdc5f68e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc581444a0 0x7fdc58140ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.053+0000 7fdc5f68e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc581448f0 0x7fdc5813bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.053+0000 7fdc5f68e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc580bb4a0 con 0x7fdc581448f0 2023-06-23T18:45:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.053+0000 7fdc5f68e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc58142390 con 0x7fdc5806a0d0 2023-06-23T18:45:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.053+0000 7fdc5f68e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc581409a0 con 0x7fdc581444a0 2023-06-23T18:45:10.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.054+0000 7fdc5dc2b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc581448f0 0x7fdc5813bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.054+0000 7fdc5dc2b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc581448f0 0x7fdc5813bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38340/0 (socket says 172.21.15.52:38340) 2023-06-23T18:45:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.054+0000 7fdc5dc2b700 1 -- 172.21.15.52:0/3708677668 learned_addr learned my addr 172.21.15.52:0/3708677668 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.054+0000 7fdc5cc29700 1 --2- 172.21.15.52:0/3708677668 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc581444a0 0x7fdc58140ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.054+0000 7fdc5d42a700 1 --2- 172.21.15.52:0/3708677668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc5806a0d0 0x7fdc580baf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.054+0000 7fdc5dc2b700 1 -- 172.21.15.52:0/3708677668 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc581444a0 msgr2=0x7fdc58140ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.054+0000 7fdc5dc2b700 1 --2- 172.21.15.52:0/3708677668 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc581444a0 0x7fdc58140ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:10.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.054+0000 7fdc5dc2b700 1 -- 172.21.15.52:0/3708677668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc5806a0d0 msgr2=0x7fdc580baf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.054+0000 7fdc5dc2b700 1 --2- 172.21.15.52:0/3708677668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc5806a0d0 0x7fdc580baf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.054+0000 7fdc5dc2b700 1 -- 172.21.15.52:0/3708677668 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc50009b30 con 0x7fdc581448f0 2023-06-23T18:45:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.054+0000 7fdc5dc2b700 1 --2- 172.21.15.52:0/3708677668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc581448f0 0x7fdc5813bb00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdc50015040 tx=0x7fdc50004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.054+0000 7fdc49ffb700 1 -- 172.21.15.52:0/3708677668 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc500044c0 con 0x7fdc581448f0 2023-06-23T18:45:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.054+0000 7fdc49ffb700 1 -- 172.21.15.52:0/3708677668 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc50004640 con 0x7fdc581448f0 2023-06-23T18:45:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.054+0000 7fdc49ffb700 1 -- 172.21.15.52:0/3708677668 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc50012430 con 0x7fdc581448f0 2023-06-23T18:45:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.054+0000 7fdc5f68e700 1 -- 172.21.15.52:0/3708677668 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc58142e00 con 0x7fdc581448f0 2023-06-23T18:45:10.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.055+0000 7fdc5f68e700 1 -- 172.21.15.52:0/3708677668 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc581433c0 con 0x7fdc581448f0 2023-06-23T18:45:10.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.055+0000 7fdc5f68e700 1 -- 172.21.15.52:0/3708677668 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc58140cf0 con 0x7fdc581448f0 2023-06-23T18:45:10.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.056+0000 7fdc49ffb700 1 -- 172.21.15.52:0/3708677668 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdc50012590 con 0x7fdc581448f0 2023-06-23T18:45:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.056+0000 7fdc49ffb700 1 --2- 172.21.15.52:0/3708677668 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdc3c06ace0 0x7fdc3c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.057+0000 7fdc49ffb700 1 -- 172.21.15.52:0/3708677668 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdc5008ab00 con 0x7fdc581448f0 2023-06-23T18:45:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.057+0000 7fdc5d42a700 1 --2- 172.21.15.52:0/3708677668 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdc3c06ace0 0x7fdc3c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:10.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.057+0000 7fdc5d42a700 1 --2- 172.21.15.52:0/3708677668 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdc3c06ace0 0x7fdc3c06d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c006fd0 tx=0x7fdc4c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:10.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.061+0000 7fdc49ffb700 1 -- 172.21.15.52:0/3708677668 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdc5008ce60 con 0x7fdc581448f0 2023-06-23T18:45:10.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.260+0000 7fdc5f68e700 1 -- 172.21.15.52:0/3708677668 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc5804e1d0 con 0x7fdc581448f0 2023-06-23T18:45:10.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.262+0000 7fdc49ffb700 1 -- 172.21.15.52:0/3708677668 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7fdc50055b10 con 0x7fdc581448f0 2023-06-23T18:45:10.267 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:10.267 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","created":"2023-06-23T18:44:31.918434+0000","modified":"2023-06-23T18:44:51.644330+0000","last_up_change":"2023-06-23T18:44:42.169624+0000","last_in_change":"2023-06-23T18:44:34.510501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-23T18:44:43.346578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-23T18:44:43.829719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:44:48.517897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:44:49.621134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c371fb28-1b15-4e43-8d5a-43e402920ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6812","nonce":1066999520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6815","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6818","nonce":1066999520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6829","nonce":1066999520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6823","nonce":1066999520}]},"public_addr":"172.21.15.52:6812/1066999520","cluster_addr":"172.21.15.52:6818/1066999520","heartbeat_back_addr":"172.21.15.52:6829/1066999520","heartbeat_front_addr":"172.21.15.52:6823/1066999520","state":["exists","up"]},{"osd":1,"uuid":"4a142f04-33eb-47ec-9cc5-b08b44d82658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6813","nonce":2360219751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6819","nonce":2360219751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6830","nonce":2360219751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6825","nonce":2360219751}]},"public_addr":"172.21.15.52:6813/2360219751","cluster_addr":"172.21.15.52:6819/2360219751","heartbeat_back_addr":"172.21.15.52:6830/2360219751","heartbeat_front_addr":"172.21.15.52:6825/2360219751","state":["exists","up"]},{"osd":2,"uuid":"d7bb089d-4c55-4370-ba59-7fe88c39512a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6801","nonce":835073005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6803","nonce":835073005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6807","nonce":835073005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6805","nonce":835073005}]},"public_addr":"172.21.15.52:6801/835073005","cluster_addr":"172.21.15.52:6803/835073005","heartbeat_back_addr":"172.21.15.52:6807/835073005","heartbeat_front_addr":"172.21.15.52:6805/835073005","state":["exists","up"]},{"osd":3,"uuid":"4bcdcdc3-6a8f-468e-877e-57f76079ac3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6811","nonce":2852700864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6817","nonce":2852700864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6831","nonce":2852700864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6824","nonce":2852700864}]},"public_addr":"172.21.15.52:6811/2852700864","cluster_addr":"172.21.15.52:6817/2852700864","heartbeat_back_addr":"172.21.15.52:6831/2852700864","heartbeat_front_addr":"172.21.15.52:6824/2852700864","state":["exists","up"]},{"osd":4,"uuid":"cac63000-ae94-4b08-93e6-a99119640b63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6809","nonce":2538664679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6811","nonce":2538664679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6815","nonce":2538664679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6813","nonce":2538664679}]},"public_addr":"172.21.15.89:6809/2538664679","cluster_addr":"172.21.15.89:6811/2538664679","heartbeat_back_addr":"172.21.15.89:6815/2538664679","heartbeat_front_addr":"172.21.15.89:6813/2538664679","state":["exists","up"]},{"osd":5,"uuid":"45c53102-18a6-4fd7-9c25-8ea5e1ef6851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6801","nonce":1683710352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6803","nonce":1683710352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6807","nonce":1683710352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6805","nonce":1683710352}]},"public_addr":"172.21.15.89:6801/1683710352","cluster_addr":"172.21.15.89:6803/1683710352","heartbeat_back_addr":"172.21.15.89:6807/1683710352","heartbeat_front_addr":"172.21.15.89:6805/1683710352","state":["exists","up"]},{"osd":6,"uuid":"abee09d1-8eba-484f-a25c-871c1fe2e843","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6817","nonce":3890899288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6819","nonce":3890899288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6823","nonce":3890899288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6821","nonce":3890899288}]},"public_addr":"172.21.15.89:6817/3890899288","cluster_addr":"172.21.15.89:6819/3890899288","heartbeat_back_addr":"172.21.15.89:6823/3890899288","heartbeat_front_addr":"172.21.15.89:6821/3890899288","state":["exists","up"]},{"osd":7,"uuid":"5acf9e2e-00dd-4f9b-a7d9-3d820f695de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6825","nonce":2989085420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6827","nonce":2989085420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6831","nonce":2989085420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6829","nonce":2989085420}]},"public_addr":"172.21.15.89:6825/2989085420","cluster_addr":"172.21.15.89:6827/2989085420","heartbeat_back_addr":"172.21.15.89:6831/2989085420","heartbeat_front_addr":"172.21.15.89:6829/2989085420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.663866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.710904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.619347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.660102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.686933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.724635+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.669111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.678740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:45:10.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.264+0000 7fdc5f68e700 1 -- 172.21.15.52:0/3708677668 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdc3c06ace0 msgr2=0x7fdc3c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:10.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.264+0000 7fdc5f68e700 1 --2- 172.21.15.52:0/3708677668 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdc3c06ace0 0x7fdc3c06d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c006fd0 tx=0x7fdc4c008040 comp rx=0 tx=0).stop 2023-06-23T18:45:10.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.264+0000 7fdc5f68e700 1 -- 172.21.15.52:0/3708677668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc581448f0 msgr2=0x7fdc5813bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:10.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.264+0000 7fdc5f68e700 1 --2- 172.21.15.52:0/3708677668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc581448f0 0x7fdc5813bb00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdc50015040 tx=0x7fdc50004ad0 comp rx=0 tx=0).stop 2023-06-23T18:45:10.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.264+0000 7fdc5f68e700 1 -- 172.21.15.52:0/3708677668 shutdown_connections 2023-06-23T18:45:10.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.264+0000 7fdc5f68e700 1 --2- 172.21.15.52:0/3708677668 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdc3c06ace0 0x7fdc3c06d190 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:10.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.264+0000 7fdc5f68e700 1 --2- 172.21.15.52:0/3708677668 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdc581448f0 0x7fdc5813bb00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:10.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.264+0000 7fdc5f68e700 1 --2- 172.21.15.52:0/3708677668 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc5806a0d0 0x7fdc580baf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:10.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.264+0000 7fdc5f68e700 1 --2- 172.21.15.52:0/3708677668 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc581444a0 0x7fdc58140ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:10.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.264+0000 7fdc5f68e700 1 -- 172.21.15.52:0/3708677668 >> 172.21.15.52:0/3708677668 conn(0x7fdc5806bb90 msgr2=0x7fdc580b54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:10.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.264+0000 7fdc5f68e700 1 -- 172.21.15.52:0/3708677668 shutdown_connections 2023-06-23T18:45:10.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.264+0000 7fdc5f68e700 1 -- 172.21.15.52:0/3708677668 wait complete. 2023-06-23T18:45:10.281 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-23T18:44:43.346578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-23T18:44:43.829719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T18:44:48.517897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T18:44:49.621134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-23T18:45:10.282 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T18:45:10.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.405+0000 7f3d8c428700 1 Processor -- start 2023-06-23T18:45:10.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.406+0000 7f3d8c428700 1 -- start start 2023-06-23T18:45:10.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.407+0000 7f3d8c428700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d84071240 0x7f3d841472e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:10.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.407+0000 7f3d8c428700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d84147c80 con 0x7f3d84147820 2023-06-23T18:45:10.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.407+0000 7f3d8c428700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d840b8360 con 0x7f3d840b8c80 2023-06-23T18:45:10.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.407+0000 7f3d8c428700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d840b4bb0 con 0x7f3d84071240 2023-06-23T18:45:10.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.407+0000 7f3d8a9c5700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f3d84147820 0x7f3d84151a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48094/0 (socket says 172.21.15.52:48094) 2023-06-23T18:45:10.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.407+0000 7f3d8a9c5700 1 -- 172.21.15.52:0/449017136 learned_addr learned my addr 172.21.15.52:0/449017136 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:10.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.407+0000 7f3d899c3700 1 --2- 172.21.15.52:0/449017136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d84071240 0x7f3d841472e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:10.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.407+0000 7f3d891c2700 1 -- 172.21.15.52:0/449017136 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2952991518 0 0) 0x7f3d84147c80 con 0x7f3d84147820 2023-06-23T18:45:10.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.407+0000 7f3d891c2700 1 -- 172.21.15.52:0/449017136 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d700035b0 con 0x7f3d84147820 2023-06-23T18:45:10.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.407+0000 7f3d891c2700 1 -- 172.21.15.52:0/449017136 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677514288 0 0) 0x7f3d840b8360 con 0x7f3d840b8c80 2023-06-23T18:45:10.413 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.407+0000 7f3d891c2700 1 -- 172.21.15.52:0/449017136 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d84147c80 con 0x7f3d840b8c80 2023-06-23T18:45:10.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.407+0000 7f3d899c3700 1 -- 172.21.15.52:0/449017136 >> v1:172.21.15.89:6789/0 conn(0x7f3d840b8c80 legacy=0x7f3d84141220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:10.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.407+0000 7f3d891c2700 1 -- 172.21.15.52:0/449017136 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 14356917 0 0) 0x7f3d700035b0 con 0x7f3d84147820 2023-06-23T18:45:10.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.407+0000 7f3d899c3700 1 -- 172.21.15.52:0/449017136 >> v1:172.21.15.52:6789/0 conn(0x7f3d84147820 legacy=0x7f3d84151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:10.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.407+0000 7f3d899c3700 1 -- 172.21.15.52:0/449017136 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d84141930 con 0x7f3d84071240 2023-06-23T18:45:10.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.408+0000 7f3d899c3700 1 --2- 172.21.15.52:0/449017136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d84071240 0x7f3d841472e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3d74009870 tx=0x7f3d74009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaa50bbc48ba5b2a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:10.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.408+0000 7f3d891c2700 1 -- 172.21.15.52:0/449017136 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c0019f0 con 0x7f3d84071240 2023-06-23T18:45:10.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.408+0000 7f3d891c2700 1 -- 172.21.15.52:0/449017136 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d74004030 con 0x7f3d84071240 2023-06-23T18:45:10.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.408+0000 7f3d891c2700 1 -- 172.21.15.52:0/449017136 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d740043c0 con 0x7f3d84071240 2023-06-23T18:45:10.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.408+0000 7f3d8c428700 1 -- 172.21.15.52:0/449017136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d84071240 msgr2=0x7f3d841472e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:10.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.408+0000 7f3d8c428700 1 --2- 172.21.15.52:0/449017136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d84071240 0x7f3d841472e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3d74009870 tx=0x7f3d74009b80 comp rx=0 tx=0).stop 2023-06-23T18:45:10.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.408+0000 7f3d8c428700 1 -- 172.21.15.52:0/449017136 shutdown_connections 2023-06-23T18:45:10.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.408+0000 7f3d8c428700 1 --2- 172.21.15.52:0/449017136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d84071240 0x7f3d841472e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:10.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.408+0000 7f3d8c428700 1 -- 172.21.15.52:0/449017136 >> 172.21.15.52:0/449017136 conn(0x7f3d840bd420 msgr2=0x7f3d840bd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:10.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.408+0000 7f3d8c428700 1 -- 172.21.15.52:0/449017136 shutdown_connections 2023-06-23T18:45:10.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.408+0000 7f3d8c428700 1 -- 172.21.15.52:0/449017136 wait complete. 2023-06-23T18:45:10.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.410+0000 7f3d8c428700 1 Processor -- start 2023-06-23T18:45:10.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.410+0000 7f3d8c428700 1 -- start start 2023-06-23T18:45:10.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.410+0000 7f3d8c428700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d84071240 0x7f3d841e2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:10.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.410+0000 7f3d8c428700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d840b8c80 0x7f3d8413a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:10.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.410+0000 7f3d8c428700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d84147820 0x7f3d841d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:10.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.410+0000 7f3d8c428700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8413ae90 con 0x7f3d840b8c80 2023-06-23T18:45:10.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.410+0000 7f3d8c428700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d841e3ed0 con 0x7f3d84147820 2023-06-23T18:45:10.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.410+0000 7f3d8c428700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d841d0f60 con 0x7f3d84071240 2023-06-23T18:45:10.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.410+0000 7f3d899c3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d840b8c80 0x7f3d8413a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:10.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.410+0000 7f3d899c3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d840b8c80 0x7f3d8413a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38356/0 (socket says 172.21.15.52:38356) 2023-06-23T18:45:10.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.410+0000 7f3d899c3700 1 -- 172.21.15.52:0/649697857 learned_addr learned my addr 172.21.15.52:0/649697857 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:10.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.411+0000 7f3d8a1c4700 1 --2- 172.21.15.52:0/649697857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d84071240 0x7f3d841e2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:10.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.411+0000 7f3d8a9c5700 1 --2- 172.21.15.52:0/649697857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d84147820 0x7f3d841d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:10.419 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.411+0000 7f3d899c3700 1 -- 172.21.15.52:0/649697857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d84071240 msgr2=0x7f3d841e2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:10.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.411+0000 7f3d899c3700 1 --2- 172.21.15.52:0/649697857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d84071240 0x7f3d841e2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:10.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.411+0000 7f3d899c3700 1 -- 172.21.15.52:0/649697857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d84147820 msgr2=0x7f3d841d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:10.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.411+0000 7f3d899c3700 1 --2- 172.21.15.52:0/649697857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d84147820 0x7f3d841d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:10.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.411+0000 7f3d899c3700 1 -- 172.21.15.52:0/649697857 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d740094a0 con 0x7f3d840b8c80 2023-06-23T18:45:10.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.411+0000 7f3d899c3700 1 --2- 172.21.15.52:0/649697857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d840b8c80 0x7f3d8413a950 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3d740097c0 tx=0x7f3d74004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:10.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.411+0000 7f3d7affd700 1 -- 172.21.15.52:0/649697857 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d740045d0 con 0x7f3d840b8c80 2023-06-23T18:45:10.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.411+0000 7f3d7affd700 1 -- 172.21.15.52:0/649697857 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d74011630 con 0x7f3d840b8c80 2023-06-23T18:45:10.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.411+0000 7f3d8c428700 1 -- 172.21.15.52:0/649697857 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d840b4450 con 0x7f3d840b8c80 2023-06-23T18:45:10.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.411+0000 7f3d7affd700 1 -- 172.21.15.52:0/649697857 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d740119c0 con 0x7f3d840b8c80 2023-06-23T18:45:10.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.411+0000 7f3d8c428700 1 -- 172.21.15.52:0/649697857 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8413e1e0 con 0x7f3d840b8c80 2023-06-23T18:45:10.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.412+0000 7f3d8c428700 1 -- 172.21.15.52:0/649697857 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8404e1d0 con 0x7f3d840b8c80 2023-06-23T18:45:10.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.412+0000 7f3d7affd700 1 -- 172.21.15.52:0/649697857 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3d74021070 con 0x7f3d840b8c80 2023-06-23T18:45:10.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.413+0000 7f3d7affd700 1 --2- 172.21.15.52:0/649697857 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3d6806ace0 0x7f3d6806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:10.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.413+0000 7f3d7affd700 1 -- 172.21.15.52:0/649697857 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3d7408a8a0 con 0x7f3d840b8c80 2023-06-23T18:45:10.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.413+0000 7f3d8a1c4700 1 --2- 172.21.15.52:0/649697857 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3d6806ace0 0x7f3d6806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:10.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.413+0000 7f3d8a1c4700 1 --2- 172.21.15.52:0/649697857 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3d6806ace0 0x7f3d6806d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3d80007fd0 tx=0x7f3d80009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:10.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.417+0000 7f3d7affd700 1 -- 172.21.15.52:0/649697857 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3d740559e0 con 0x7f3d840b8c80 2023-06-23T18:45:10.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.613+0000 7f3d8c428700 1 -- 172.21.15.52:0/649697857 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3d84071000 con 0x7f3d840b8c80 2023-06-23T18:45:10.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.613+0000 7f3d7affd700 1 -- 172.21.15.52:0/649697857 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3d74029020 con 0x7f3d840b8c80 2023-06-23T18:45:10.618 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-06-23T18:45:10.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.615+0000 7f3d8c428700 1 -- 172.21.15.52:0/649697857 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3d6806ace0 msgr2=0x7f3d6806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:10.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.615+0000 7f3d8c428700 1 --2- 172.21.15.52:0/649697857 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3d6806ace0 0x7f3d6806d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3d80007fd0 tx=0x7f3d80009040 comp rx=0 tx=0).stop 2023-06-23T18:45:10.620 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.615+0000 7f3d8c428700 1 -- 172.21.15.52:0/649697857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d840b8c80 msgr2=0x7f3d8413a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:10.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.615+0000 7f3d8c428700 1 --2- 172.21.15.52:0/649697857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d840b8c80 0x7f3d8413a950 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3d740097c0 tx=0x7f3d74004750 comp rx=0 tx=0).stop 2023-06-23T18:45:10.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.615+0000 7f3d8c428700 1 -- 172.21.15.52:0/649697857 shutdown_connections 2023-06-23T18:45:10.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.615+0000 7f3d8c428700 1 --2- 172.21.15.52:0/649697857 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3d6806ace0 0x7f3d6806d190 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:10.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.615+0000 7f3d8c428700 1 --2- 172.21.15.52:0/649697857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3d84147820 0x7f3d841d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:10.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.615+0000 7f3d8c428700 1 --2- 172.21.15.52:0/649697857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3d84071240 0x7f3d841e2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:10.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.615+0000 7f3d8c428700 1 --2- 172.21.15.52:0/649697857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3d840b8c80 0x7f3d8413a950 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:10.621 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.615+0000 7f3d8c428700 1 -- 172.21.15.52:0/649697857 >> 172.21.15.52:0/649697857 conn(0x7f3d840bd420 msgr2=0x7f3d840bd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:10.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.615+0000 7f3d8c428700 1 -- 172.21.15.52:0/649697857 shutdown_connections 2023-06-23T18:45:10.622 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.615+0000 7f3d8c428700 1 -- 172.21.15.52:0/649697857 wait complete. 2023-06-23T18:45:10.632 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T18:45:10.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.755+0000 7fcfd0ef7700 1 Processor -- start 2023-06-23T18:45:10.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.756+0000 7fcfd0ef7700 1 -- start start 2023-06-23T18:45:10.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.756+0000 7fcfd0ef7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfcc0be840 0x7fcfcc155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:10.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.756+0000 7fcfd0ef7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfcc14a680 con 0x7fcfcc0b9170 2023-06-23T18:45:10.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.756+0000 7fcfd0ef7700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfcc06b3e0 con 0x7fcfcc0be470 2023-06-23T18:45:10.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.756+0000 7fcfd0ef7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc06b6c0 con 0x7fcfcc0be840 2023-06-23T18:45:10.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.756+0000 7fcfc9d9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fcfcc0b9170 0x7fcfcc06cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48106/0 (socket says 172.21.15.52:48106) 2023-06-23T18:45:10.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.756+0000 7fcfc9d9b700 1 -- 172.21.15.52:0/253841182 learned_addr learned my addr 172.21.15.52:0/253841182 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:10.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.757+0000 7fcfcad9d700 1 --2- 172.21.15.52:0/253841182 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfcc0be840 0x7fcfcc155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:10.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.757+0000 7fcfc959a700 1 -- 172.21.15.52:0/253841182 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1671923791 0 0) 0x7fcfcc14a680 con 0x7fcfcc0b9170 2023-06-23T18:45:10.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.757+0000 7fcfc959a700 1 -- 172.21.15.52:0/253841182 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfb40035b0 con 0x7fcfcc0b9170 2023-06-23T18:45:10.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.757+0000 7fcfc959a700 1 -- 172.21.15.52:0/253841182 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2482993239 0 0) 0x7fcfb40035b0 con 0x7fcfcc0b9170 2023-06-23T18:45:10.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.757+0000 7fcfc959a700 1 -- 172.21.15.52:0/253841182 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfcc0be840 msgr2=0x7fcfcc155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:10.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.757+0000 7fcfc959a700 1 --2- 172.21.15.52:0/253841182 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfcc0be840 0x7fcfcc155ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:10.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.757+0000 7fcfc959a700 1 -- 172.21.15.52:0/253841182 >> v1:172.21.15.89:6789/0 conn(0x7fcfcc0be470 legacy=0x7fcfcc14b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:10.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.757+0000 7fcfc959a700 1 -- 172.21.15.52:0/253841182 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfcc14a8e0 con 0x7fcfcc0b9170 2023-06-23T18:45:10.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.757+0000 7fcfc959a700 1 -- 172.21.15.52:0/253841182 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7fcfbc001670 con 0x7fcfcc0b9170 2023-06-23T18:45:10.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.757+0000 7fcfc959a700 1 -- 172.21.15.52:0/253841182 >> v1:172.21.15.52:6789/0 conn(0x7fcfcc0b9170 legacy=0x7fcfcc06cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:10.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.757+0000 7fcfc959a700 1 --2- 172.21.15.52:0/253841182 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfcc0be840 0x7fcfb4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:10.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.757+0000 7fcfc959a700 1 --2- 172.21.15.52:0/253841182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfb4003f70 0x7fcfb4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:10.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.757+0000 7fcfc959a700 1 --2- 172.21.15.52:0/253841182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfb4004d90 0x7fcfb4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:10.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.757+0000 7fcfc959a700 1 -- 172.21.15.52:0/253841182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc06b6c0 con 0x7fcfb4003f70 2023-06-23T18:45:10.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.757+0000 7fcfc959a700 1 -- 172.21.15.52:0/253841182 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb400ba40 con 0x7fcfb4004d90 2023-06-23T18:45:10.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.757+0000 7fcfc959a700 1 -- 172.21.15.52:0/253841182 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb400bc00 con 0x7fcfcc0be840 2023-06-23T18:45:10.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.757+0000 7fcfc9d9b700 1 --2- 172.21.15.52:0/253841182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfb4003f70 0x7fcfb4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:10.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.757+0000 7fcfca59c700 1 --2- 172.21.15.52:0/253841182 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfcc0be840 0x7fcfb4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:10.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.757+0000 7fcfcad9d700 1 --2- 172.21.15.52:0/253841182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfb4004d90 0x7fcfb4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:10.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.757+0000 7fcfc9d9b700 1 -- 172.21.15.52:0/253841182 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfcc0be840 msgr2=0x7fcfb4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:10.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.757+0000 7fcfc9d9b700 1 --2- 172.21.15.52:0/253841182 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfcc0be840 0x7fcfb4003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:10.767 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.757+0000 7fcfc9d9b700 1 -- 172.21.15.52:0/253841182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfb4004d90 msgr2=0x7fcfb4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:10.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.757+0000 7fcfc9d9b700 1 --2- 172.21.15.52:0/253841182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfb4004d90 0x7fcfb4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:10.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.757+0000 7fcfc9d9b700 1 -- 172.21.15.52:0/253841182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb40035b0 con 0x7fcfb4003f70 2023-06-23T18:45:10.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.758+0000 7fcfc9d9b700 1 --2- 172.21.15.52:0/253841182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfb4003f70 0x7fcfb4004850 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc00c2f0 tx=0x7fcfb4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ba80791faa1b53 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:10.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.758+0000 7fcfc959a700 1 -- 172.21.15.52:0/253841182 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc00ce30 con 0x7fcfb4003f70 2023-06-23T18:45:10.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.758+0000 7fcfc959a700 1 -- 172.21.15.52:0/253841182 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfbc005960 con 0x7fcfb4003f70 2023-06-23T18:45:10.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.758+0000 7fcfc959a700 1 -- 172.21.15.52:0/253841182 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc005d10 con 0x7fcfb4003f70 2023-06-23T18:45:10.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.758+0000 7fcfd0ef7700 1 -- 172.21.15.52:0/253841182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfb4003f70 msgr2=0x7fcfb4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:10.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.758+0000 7fcfd0ef7700 1 --2- 172.21.15.52:0/253841182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfb4003f70 0x7fcfb4004850 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc00c2f0 tx=0x7fcfb4005880 comp rx=0 tx=0).stop 2023-06-23T18:45:10.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.758+0000 7fcfcad9d700 1 -- 172.21.15.52:0/253841182 reap_dead start 2023-06-23T18:45:10.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.758+0000 7fcfd0ef7700 1 -- 172.21.15.52:0/253841182 shutdown_connections 2023-06-23T18:45:10.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.758+0000 7fcfd0ef7700 1 -- 172.21.15.52:0/253841182 >> 172.21.15.52:0/253841182 conn(0x7fcfcc071410 msgr2=0x7fcfcc071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:10.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.758+0000 7fcfd0ef7700 1 -- 172.21.15.52:0/253841182 shutdown_connections 2023-06-23T18:45:10.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.758+0000 7fcfd0ef7700 1 -- 172.21.15.52:0/253841182 wait complete. 2023-06-23T18:45:10.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.760+0000 7fcfd0ef7700 1 Processor -- start 2023-06-23T18:45:10.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.760+0000 7fcfd0ef7700 1 -- start start 2023-06-23T18:45:10.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.760+0000 7fcfd0ef7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfb4003f70 0x7fcfcc14e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:10.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.760+0000 7fcfd0ef7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfcc149bc0 0x7fcfcc1e3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:10.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.760+0000 7fcfd0ef7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfcc1e3ed0 0x7fcfcc1410f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:10.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.760+0000 7fcfd0ef7700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc1e4340 con 0x7fcfcc149bc0 2023-06-23T18:45:10.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.760+0000 7fcfd0ef7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc14a030 con 0x7fcfb4003f70 2023-06-23T18:45:10.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.760+0000 7fcfd0ef7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc14c010 con 0x7fcfcc1e3ed0 2023-06-23T18:45:10.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.761+0000 7fcfc9d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfcc149bc0 0x7fcfcc1e3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:10.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.761+0000 7fcfc9d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfcc149bc0 0x7fcfcc1e3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38382/0 (socket says 172.21.15.52:38382) 2023-06-23T18:45:10.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.761+0000 7fcfc9d9b700 1 -- 172.21.15.52:0/3292100084 learned_addr learned my addr 172.21.15.52:0/3292100084 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:10.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.761+0000 7fcfcad9d700 1 --2- 172.21.15.52:0/3292100084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfcc1e3ed0 0x7fcfcc1410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:10.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.761+0000 7fcfca59c700 1 --2- 172.21.15.52:0/3292100084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfb4003f70 0x7fcfcc14e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:10.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.761+0000 7fcfc9d9b700 1 -- 172.21.15.52:0/3292100084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfcc1e3ed0 msgr2=0x7fcfcc1410f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:10.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.761+0000 7fcfc9d9b700 1 --2- 172.21.15.52:0/3292100084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfcc1e3ed0 0x7fcfcc1410f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:10.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.761+0000 7fcfc9d9b700 1 -- 172.21.15.52:0/3292100084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfb4003f70 msgr2=0x7fcfcc14e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:10.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.761+0000 7fcfc9d9b700 1 --2- 172.21.15.52:0/3292100084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfb4003f70 0x7fcfcc14e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:10.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.761+0000 7fcfc9d9b700 1 -- 172.21.15.52:0/3292100084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfcc14c2f0 con 0x7fcfcc149bc0 2023-06-23T18:45:10.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.761+0000 7fcfc9d9b700 1 --2- 172.21.15.52:0/3292100084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfcc149bc0 0x7fcfcc1e3990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcfb400ba10 tx=0x7fcfbc001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:10.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.761+0000 7fcfbaffd700 1 -- 172.21.15.52:0/3292100084 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc001660 con 0x7fcfcc149bc0 2023-06-23T18:45:10.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.761+0000 7fcfbaffd700 1 -- 172.21.15.52:0/3292100084 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfbc005e80 con 0x7fcfcc149bc0 2023-06-23T18:45:10.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.761+0000 7fcfd0ef7700 1 -- 172.21.15.52:0/3292100084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfcc1e3470 con 0x7fcfcc149bc0 2023-06-23T18:45:10.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.761+0000 7fcfbaffd700 1 -- 172.21.15.52:0/3292100084 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc004cc0 con 0x7fcfcc149bc0 2023-06-23T18:45:10.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.761+0000 7fcfd0ef7700 1 -- 172.21.15.52:0/3292100084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfcc1d7720 con 0x7fcfcc149bc0 2023-06-23T18:45:10.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.762+0000 7fcfd0ef7700 1 -- 172.21.15.52:0/3292100084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfcc1e37e0 con 0x7fcfcc149bc0 2023-06-23T18:45:10.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.763+0000 7fcfbaffd700 1 -- 172.21.15.52:0/3292100084 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcfbc0070d0 con 0x7fcfcc149bc0 2023-06-23T18:45:10.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.763+0000 7fcfbaffd700 1 --2- 172.21.15.52:0/3292100084 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcfac06ace0 0x7fcfac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:10.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.763+0000 7fcfbaffd700 1 -- 172.21.15.52:0/3292100084 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcfbc08ac80 con 0x7fcfcc149bc0 2023-06-23T18:45:10.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.763+0000 7fcfca59c700 1 --2- 172.21.15.52:0/3292100084 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcfac06ace0 0x7fcfac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:10.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.764+0000 7fcfca59c700 1 --2- 172.21.15.52:0/3292100084 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcfac06ace0 0x7fcfac06d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcfc00011a0 tx=0x7fcfc0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:10.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.768+0000 7fcfbaffd700 1 -- 172.21.15.52:0/3292100084 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcfbc055fa0 con 0x7fcfcc149bc0 2023-06-23T18:45:10.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.967+0000 7fcfd0ef7700 1 -- 172.21.15.52:0/3292100084 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcfcc1492b0 con 0x7fcfcc149bc0 2023-06-23T18:45:10.972 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.968+0000 7fcfbaffd700 1 -- 172.21.15.52:0/3292100084 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcfbc007da0 con 0x7fcfcc149bc0 2023-06-23T18:45:10.973 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-06-23T18:45:10.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.970+0000 7fcfd0ef7700 1 -- 172.21.15.52:0/3292100084 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcfac06ace0 msgr2=0x7fcfac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:10.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.970+0000 7fcfd0ef7700 1 --2- 172.21.15.52:0/3292100084 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcfac06ace0 0x7fcfac06d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcfc00011a0 tx=0x7fcfc0009040 comp rx=0 tx=0).stop 2023-06-23T18:45:10.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.970+0000 7fcfd0ef7700 1 -- 172.21.15.52:0/3292100084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfcc149bc0 msgr2=0x7fcfcc1e3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:10.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.970+0000 7fcfd0ef7700 1 --2- 172.21.15.52:0/3292100084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfcc149bc0 0x7fcfcc1e3990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcfb400ba10 tx=0x7fcfbc001a00 comp rx=0 tx=0).stop 2023-06-23T18:45:10.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.970+0000 7fcfd0ef7700 1 -- 172.21.15.52:0/3292100084 shutdown_connections 2023-06-23T18:45:10.975 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.970+0000 7fcfd0ef7700 1 --2- 172.21.15.52:0/3292100084 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcfac06ace0 0x7fcfac06d190 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:10.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.970+0000 7fcfd0ef7700 1 --2- 172.21.15.52:0/3292100084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfcc1e3ed0 0x7fcfcc1410f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:10.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.970+0000 7fcfd0ef7700 1 --2- 172.21.15.52:0/3292100084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfb4003f70 0x7fcfcc14e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:10.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.970+0000 7fcfd0ef7700 1 --2- 172.21.15.52:0/3292100084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcfcc149bc0 0x7fcfcc1e3990 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:10.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.970+0000 7fcfd0ef7700 1 -- 172.21.15.52:0/3292100084 >> 172.21.15.52:0/3292100084 conn(0x7fcfcc071410 msgr2=0x7fcfcc143d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:10.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.970+0000 7fcfd0ef7700 1 -- 172.21.15.52:0/3292100084 shutdown_connections 2023-06-23T18:45:10.976 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:10.970+0000 7fcfd0ef7700 1 -- 172.21.15.52:0/3292100084 wait complete. 2023-06-23T18:45:10.986 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T18:45:11.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.111+0000 7ff3e892a700 1 Processor -- start 2023-06-23T18:45:11.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.111+0000 7ff3e892a700 1 -- start start 2023-06-23T18:45:11.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.112+0000 7ff3e892a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3e40b6c50 0x7ff3e40b87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:11.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.112+0000 7ff3e892a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff3e40b7da0 0x7ff3e41422d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:11.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.112+0000 7ff3e892a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e406c750 con 0x7ff3e40b9960 2023-06-23T18:45:11.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.112+0000 7ff3e892a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e40b9540 con 0x7ff3e40b7da0 2023-06-23T18:45:11.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.112+0000 7ff3e892a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e40b8d10 con 0x7ff3e40b6c50 2023-06-23T18:45:11.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.112+0000 7ff3e259c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3e40b6c50 0x7ff3e40b87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:11.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.112+0000 7ff3e2d9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff3e40b7da0 0x7ff3e41422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:11.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.112+0000 7ff3e1d9b700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff3e40b9960 0x7ff3e406b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.52:54330/0 (socket says 172.21.15.52:54330) 2023-06-23T18:45:11.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.112+0000 7ff3e1d9b700 1 -- 172.21.15.52:0/69655626 learned_addr learned my addr 172.21.15.52:0/69655626 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:11.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.112+0000 7ff3e259c700 1 -- 172.21.15.52:0/69655626 >> v2:172.21.15.89:3300/0 conn(0x7ff3e40b7da0 msgr2=0x7ff3e41422d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:11.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.112+0000 7ff3e259c700 1 --2- 172.21.15.52:0/69655626 >> v2:172.21.15.89:3300/0 conn(0x7ff3e40b7da0 0x7ff3e41422d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:11.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.112+0000 7ff3e259c700 1 -- 172.21.15.52:0/69655626 >> v1:172.21.15.89:6789/0 conn(0x7ff3e40b9960 legacy=0x7ff3e406b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:11.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.112+0000 7ff3e259c700 1 -- 172.21.15.52:0/69655626 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e4071e20 con 0x7ff3e40b6c50 2023-06-23T18:45:11.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.112+0000 7ff3e2d9d700 1 --2- 172.21.15.52:0/69655626 >> v2:172.21.15.89:3300/0 conn(0x7ff3e40b7da0 0x7ff3e41422d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:45:11.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.112+0000 7ff3e259c700 1 --2- 172.21.15.52:0/69655626 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3e40b6c50 0x7ff3e40b87d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009840 tx=0x7ff3d8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d517b46eba3b9b8 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:11.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.113+0000 7ff3e159a700 1 -- 172.21.15.52:0/69655626 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8011830 con 0x7ff3e40b6c50 2023-06-23T18:45:11.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.113+0000 7ff3e159a700 1 -- 172.21.15.52:0/69655626 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d8011990 con 0x7ff3e40b6c50 2023-06-23T18:45:11.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.113+0000 7ff3e159a700 1 -- 172.21.15.52:0/69655626 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8011d20 con 0x7ff3e40b6c50 2023-06-23T18:45:11.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.113+0000 7ff3e892a700 1 -- 172.21.15.52:0/69655626 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3e40b6c50 msgr2=0x7ff3e40b87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:11.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.113+0000 7ff3e892a700 1 --2- 172.21.15.52:0/69655626 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3e40b6c50 0x7ff3e40b87d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009840 tx=0x7ff3d8009b50 comp rx=0 tx=0).stop 2023-06-23T18:45:11.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.113+0000 7ff3e892a700 1 -- 172.21.15.52:0/69655626 shutdown_connections 2023-06-23T18:45:11.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.113+0000 7ff3e892a700 1 --2- 172.21.15.52:0/69655626 >> v2:172.21.15.89:3300/0 conn(0x7ff3e40b7da0 0x7ff3e41422d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:11.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.113+0000 7ff3e892a700 1 --2- 172.21.15.52:0/69655626 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3e40b6c50 0x7ff3e40b87d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:11.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.113+0000 7ff3e892a700 1 -- 172.21.15.52:0/69655626 >> 172.21.15.52:0/69655626 conn(0x7ff3e40bd420 msgr2=0x7ff3e40bd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:11.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.113+0000 7ff3e892a700 1 -- 172.21.15.52:0/69655626 shutdown_connections 2023-06-23T18:45:11.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.113+0000 7ff3e892a700 1 -- 172.21.15.52:0/69655626 wait complete. 2023-06-23T18:45:11.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.115+0000 7ff3e892a700 1 Processor -- start 2023-06-23T18:45:11.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.115+0000 7ff3e892a700 1 -- start start 2023-06-23T18:45:11.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.115+0000 7ff3e892a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e40b6c50 0x7ff3e41392f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:11.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.115+0000 7ff3e892a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3e40b7da0 0x7ff3e41345e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:11.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.115+0000 7ff3e892a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3e40b9960 0x7ff3e41326b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:11.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.115+0000 7ff3e892a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e4139830 con 0x7ff3e40b6c50 2023-06-23T18:45:11.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.115+0000 7ff3e892a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e4134150 con 0x7ff3e40b9960 2023-06-23T18:45:11.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.115+0000 7ff3e892a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e4134b20 con 0x7ff3e40b7da0 2023-06-23T18:45:11.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.115+0000 7ff3e259c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e40b6c50 0x7ff3e41392f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:11.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.115+0000 7ff3e259c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e40b6c50 0x7ff3e41392f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38398/0 (socket says 172.21.15.52:38398) 2023-06-23T18:45:11.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.115+0000 7ff3e259c700 1 -- 172.21.15.52:0/4242340954 learned_addr learned my addr 172.21.15.52:0/4242340954 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:11.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.116+0000 7ff3e1d9b700 1 --2- 172.21.15.52:0/4242340954 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3e40b7da0 0x7ff3e41345e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:11.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.116+0000 7ff3e2d9d700 1 --2- 172.21.15.52:0/4242340954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3e40b9960 0x7ff3e41326b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:11.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.116+0000 7ff3e259c700 1 -- 172.21.15.52:0/4242340954 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3e40b7da0 msgr2=0x7ff3e41345e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:11.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.116+0000 7ff3e259c700 1 --2- 172.21.15.52:0/4242340954 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3e40b7da0 0x7ff3e41345e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:11.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.116+0000 7ff3e259c700 1 -- 172.21.15.52:0/4242340954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3e40b9960 msgr2=0x7ff3e41326b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:11.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.116+0000 7ff3e259c700 1 --2- 172.21.15.52:0/4242340954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3e40b9960 0x7ff3e41326b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:11.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.116+0000 7ff3e259c700 1 -- 172.21.15.52:0/4242340954 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3dc009a70 con 0x7ff3e40b6c50 2023-06-23T18:45:11.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.116+0000 7ff3e2d9d700 1 --2- 172.21.15.52:0/4242340954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3e40b9960 0x7ff3e41326b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:11.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.116+0000 7ff3e259c700 1 --2- 172.21.15.52:0/4242340954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e40b6c50 0x7ff3e41392f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009b90 tx=0x7ff3d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:11.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.116+0000 7ff3d2ffd700 1 -- 172.21.15.52:0/4242340954 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d80038a0 con 0x7ff3e40b6c50 2023-06-23T18:45:11.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.116+0000 7ff3d2ffd700 1 -- 172.21.15.52:0/4242340954 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d801e070 con 0x7ff3e40b6c50 2023-06-23T18:45:11.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.116+0000 7ff3e892a700 1 -- 172.21.15.52:0/4242340954 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d80094a0 con 0x7ff3e40b6c50 2023-06-23T18:45:11.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.116+0000 7ff3d2ffd700 1 -- 172.21.15.52:0/4242340954 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8003c40 con 0x7ff3e40b6c50 2023-06-23T18:45:11.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.116+0000 7ff3e892a700 1 -- 172.21.15.52:0/4242340954 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e4135200 con 0x7ff3e40b6c50 2023-06-23T18:45:11.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.117+0000 7ff3e892a700 1 -- 172.21.15.52:0/4242340954 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3e404e1d0 con 0x7ff3e40b6c50 2023-06-23T18:45:11.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.118+0000 7ff3d2ffd700 1 -- 172.21.15.52:0/4242340954 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff3d802d450 con 0x7ff3e40b6c50 2023-06-23T18:45:11.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.118+0000 7ff3d2ffd700 1 --2- 172.21.15.52:0/4242340954 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff3c406ace0 0x7ff3c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:11.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.118+0000 7ff3d2ffd700 1 -- 172.21.15.52:0/4242340954 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff3d808a420 con 0x7ff3e40b6c50 2023-06-23T18:45:11.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.118+0000 7ff3e1d9b700 1 --2- 172.21.15.52:0/4242340954 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff3c406ace0 0x7ff3c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:11.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.118+0000 7ff3e1d9b700 1 --2- 172.21.15.52:0/4242340954 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff3c406ace0 0x7ff3c406d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff3e41401c0 tx=0x7ff3d4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:11.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.122+0000 7ff3d2ffd700 1 -- 172.21.15.52:0/4242340954 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff3d80554e0 con 0x7ff3e40b6c50 2023-06-23T18:45:11.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.317+0000 7ff3e892a700 1 -- 172.21.15.52:0/4242340954 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff3e406a9e0 con 0x7ff3e40b6c50 2023-06-23T18:45:11.322 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.317+0000 7ff3d2ffd700 1 -- 172.21.15.52:0/4242340954 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff3d8058b00 con 0x7ff3e40b6c50 2023-06-23T18:45:11.323 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2023-06-23T18:45:11.324 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.319+0000 7ff3e892a700 1 -- 172.21.15.52:0/4242340954 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff3c406ace0 msgr2=0x7ff3c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:11.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.319+0000 7ff3e892a700 1 --2- 172.21.15.52:0/4242340954 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff3c406ace0 0x7ff3c406d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff3e41401c0 tx=0x7ff3d4009040 comp rx=0 tx=0).stop 2023-06-23T18:45:11.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.319+0000 7ff3e892a700 1 -- 172.21.15.52:0/4242340954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e40b6c50 msgr2=0x7ff3e41392f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:11.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.319+0000 7ff3e892a700 1 --2- 172.21.15.52:0/4242340954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e40b6c50 0x7ff3e41392f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009b90 tx=0x7ff3d8004750 comp rx=0 tx=0).stop 2023-06-23T18:45:11.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.319+0000 7ff3e892a700 1 -- 172.21.15.52:0/4242340954 shutdown_connections 2023-06-23T18:45:11.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.319+0000 7ff3e892a700 1 --2- 172.21.15.52:0/4242340954 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff3c406ace0 0x7ff3c406d190 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:11.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.319+0000 7ff3e892a700 1 --2- 172.21.15.52:0/4242340954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff3e40b9960 0x7ff3e41326b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:11.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.319+0000 7ff3e892a700 1 --2- 172.21.15.52:0/4242340954 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3e40b6c50 0x7ff3e41392f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:11.325 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.319+0000 7ff3e892a700 1 --2- 172.21.15.52:0/4242340954 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff3e40b7da0 0x7ff3e41345e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:11.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.320+0000 7ff3e892a700 1 -- 172.21.15.52:0/4242340954 >> 172.21.15.52:0/4242340954 conn(0x7ff3e40bd420 msgr2=0x7ff3e40bd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:11.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.320+0000 7ff3e892a700 1 -- 172.21.15.52:0/4242340954 shutdown_connections 2023-06-23T18:45:11.326 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.320+0000 7ff3e892a700 1 -- 172.21.15.52:0/4242340954 wait complete. 2023-06-23T18:45:11.336 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T18:45:11.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.462+0000 7f594e0de700 1 Processor -- start 2023-06-23T18:45:11.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.462+0000 7f594e0de700 1 -- start start 2023-06-23T18:45:11.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.463+0000 7f594e0de700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5948070930 0x7f594806fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:11.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.463+0000 7f594e0de700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59480afe00 0x7f59480b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:11.471 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.463+0000 7f594e0de700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59480b6fe0 con 0x7f594806b0e0 2023-06-23T18:45:11.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.463+0000 7f594e0de700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5948071c00 con 0x7f5948070930 2023-06-23T18:45:11.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.463+0000 7f594e0de700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59480b6a20 con 0x7f59480afe00 2023-06-23T18:45:11.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.463+0000 7f5946ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5948070930 0x7f594806fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:11.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.463+0000 7f59477fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f594806b0e0 0x7f59480b73c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48122/0 (socket says 172.21.15.52:48122) 2023-06-23T18:45:11.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.463+0000 7f5946ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5948070930 0x7f594806fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38400/0 (socket says 172.21.15.52:38400) 2023-06-23T18:45:11.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.463+0000 7f59477fe700 1 -- 172.21.15.52:0/1836388142 learned_addr learned my addr 172.21.15.52:0/1836388142 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:11.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.463+0000 7f5947fff700 1 --2- 172.21.15.52:0/1836388142 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59480afe00 0x7f59480b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:11.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.463+0000 7f5946ffd700 1 -- 172.21.15.52:0/1836388142 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59480afe00 msgr2=0x7f59480b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:11.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.463+0000 7f5946ffd700 1 --2- 172.21.15.52:0/1836388142 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59480afe00 0x7f59480b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:11.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.463+0000 7f5946ffd700 1 -- 172.21.15.52:0/1836388142 >> v1:172.21.15.52:6789/0 conn(0x7f594806b0e0 legacy=0x7f59480b73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:11.473 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.463+0000 7f5946ffd700 1 -- 172.21.15.52:0/1836388142 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59480b6d00 con 0x7f5948070930 2023-06-23T18:45:11.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.463+0000 7f59467fc700 1 -- 172.21.15.52:0/1836388142 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2469733705 0 0) 0x7f59480b6fe0 con 0x7f594806b0e0 2023-06-23T18:45:11.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.463+0000 7f5946ffd700 1 --2- 172.21.15.52:0/1836388142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5948070930 0x7f594806fab0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5930009840 tx=0x7f5930009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef130fa85c898793 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:11.474 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.463+0000 7f59467fc700 1 -- 172.21.15.52:0/1836388142 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5930011830 con 0x7f5948070930 2023-06-23T18:45:11.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.463+0000 7f59467fc700 1 -- 172.21.15.52:0/1836388142 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5930011990 con 0x7f5948070930 2023-06-23T18:45:11.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.463+0000 7f59467fc700 1 -- 172.21.15.52:0/1836388142 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5930011d20 con 0x7f5948070930 2023-06-23T18:45:11.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.464+0000 7f594e0de700 1 -- 172.21.15.52:0/1836388142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5948070930 msgr2=0x7f594806fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:11.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.464+0000 7f594e0de700 1 --2- 172.21.15.52:0/1836388142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5948070930 0x7f594806fab0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5930009840 tx=0x7f5930009b50 comp rx=0 tx=0).stop 2023-06-23T18:45:11.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.464+0000 7f594e0de700 1 -- 172.21.15.52:0/1836388142 shutdown_connections 2023-06-23T18:45:11.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.464+0000 7f594e0de700 1 --2- 172.21.15.52:0/1836388142 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59480afe00 0x7f59480b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:11.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.464+0000 7f594e0de700 1 --2- 172.21.15.52:0/1836388142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5948070930 0x7f594806fab0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:11.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.464+0000 7f594e0de700 1 -- 172.21.15.52:0/1836388142 >> 172.21.15.52:0/1836388142 conn(0x7f59480b95c0 msgr2=0x7f59480b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:11.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.464+0000 7f594e0de700 1 -- 172.21.15.52:0/1836388142 shutdown_connections 2023-06-23T18:45:11.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.464+0000 7f594e0de700 1 -- 172.21.15.52:0/1836388142 wait complete. 2023-06-23T18:45:11.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.465+0000 7f594e0de700 1 Processor -- start 2023-06-23T18:45:11.478 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.465+0000 7f594e0de700 1 -- start start 2023-06-23T18:45:11.481 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.466+0000 7f594e0de700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f594806b0e0 0x7f59481d3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:11.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.466+0000 7f594e0de700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5948070930 0x7f59481d2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:11.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.466+0000 7f594e0de700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59480afe00 0x7f59481d2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:11.482 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.466+0000 7f594e0de700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59481d78b0 con 0x7f594806b0e0 2023-06-23T18:45:11.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.466+0000 7f594e0de700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59481d0c60 con 0x7f59480afe00 2023-06-23T18:45:11.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.466+0000 7f594e0de700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59481d72f0 con 0x7f5948070930 2023-06-23T18:45:11.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.466+0000 7f59477fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f594806b0e0 0x7f59481d3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:11.483 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.466+0000 7f59477fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f594806b0e0 0x7f59481d3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38402/0 (socket says 172.21.15.52:38402) 2023-06-23T18:45:11.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.466+0000 7f59477fe700 1 -- 172.21.15.52:0/3101465604 learned_addr learned my addr 172.21.15.52:0/3101465604 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:11.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.466+0000 7f5946ffd700 1 --2- 172.21.15.52:0/3101465604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5948070930 0x7f59481d2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:11.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.466+0000 7f5947fff700 1 --2- 172.21.15.52:0/3101465604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59480afe00 0x7f59481d2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:11.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.466+0000 7f59477fe700 1 -- 172.21.15.52:0/3101465604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5948070930 msgr2=0x7f59481d2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:11.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.466+0000 7f59477fe700 1 --2- 172.21.15.52:0/3101465604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5948070930 0x7f59481d2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:11.484 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.466+0000 7f59477fe700 1 -- 172.21.15.52:0/3101465604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59480afe00 msgr2=0x7f59481d2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:11.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.466+0000 7f59477fe700 1 --2- 172.21.15.52:0/3101465604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59480afe00 0x7f59481d2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:11.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.466+0000 7f59477fe700 1 -- 172.21.15.52:0/3101465604 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59300094a0 con 0x7f594806b0e0 2023-06-23T18:45:11.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.466+0000 7f5947fff700 1 --2- 172.21.15.52:0/3101465604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59480afe00 0x7f59481d2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:11.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.466+0000 7f59477fe700 1 --2- 172.21.15.52:0/3101465604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f594806b0e0 0x7f59481d3490 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f59380011e0 tx=0x7f593800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:11.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.467+0000 7f593ffff700 1 -- 172.21.15.52:0/3101465604 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5938004c80 con 0x7f594806b0e0 2023-06-23T18:45:11.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.467+0000 7f593ffff700 1 -- 172.21.15.52:0/3101465604 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5938004de0 con 0x7f594806b0e0 2023-06-23T18:45:11.485 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.467+0000 7f594e0de700 1 -- 172.21.15.52:0/3101465604 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59481d75d0 con 0x7f594806b0e0 2023-06-23T18:45:11.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.467+0000 7f593ffff700 1 -- 172.21.15.52:0/3101465604 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5938007310 con 0x7f594806b0e0 2023-06-23T18:45:11.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.467+0000 7f594e0de700 1 -- 172.21.15.52:0/3101465604 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59481d3bb0 con 0x7f594806b0e0 2023-06-23T18:45:11.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.468+0000 7f594e0de700 1 -- 172.21.15.52:0/3101465604 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59481d0f40 con 0x7f594806b0e0 2023-06-23T18:45:11.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.468+0000 7f593ffff700 1 -- 172.21.15.52:0/3101465604 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5938007470 con 0x7f594806b0e0 2023-06-23T18:45:11.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.468+0000 7f593ffff700 1 --2- 172.21.15.52:0/3101465604 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f592806ace0 0x7f592806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:11.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.468+0000 7f593ffff700 1 -- 172.21.15.52:0/3101465604 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f59380890c0 con 0x7f594806b0e0 2023-06-23T18:45:11.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.469+0000 7f5946ffd700 1 --2- 172.21.15.52:0/3101465604 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f592806ace0 0x7f592806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:11.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.469+0000 7f5946ffd700 1 --2- 172.21.15.52:0/3101465604 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f592806ace0 0x7f592806d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f59300090b0 tx=0x7f5930008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:11.487 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.473+0000 7f593ffff700 1 -- 172.21.15.52:0/3101465604 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5938054200 con 0x7f594806b0e0 2023-06-23T18:45:11.674 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.670+0000 7f594e0de700 1 -- 172.21.15.52:0/3101465604 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f594804e1d0 con 0x7f594806b0e0 2023-06-23T18:45:11.675 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.670+0000 7f593ffff700 1 -- 172.21.15.52:0/3101465604 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5938057820 con 0x7f594806b0e0 2023-06-23T18:45:11.675 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-06-23T18:45:11.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.672+0000 7f594e0de700 1 -- 172.21.15.52:0/3101465604 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f592806ace0 msgr2=0x7f592806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:11.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.672+0000 7f594e0de700 1 --2- 172.21.15.52:0/3101465604 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f592806ace0 0x7f592806d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f59300090b0 tx=0x7f5930008030 comp rx=0 tx=0).stop 2023-06-23T18:45:11.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.672+0000 7f594e0de700 1 -- 172.21.15.52:0/3101465604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f594806b0e0 msgr2=0x7f59481d3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:11.677 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.672+0000 7f594e0de700 1 --2- 172.21.15.52:0/3101465604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f594806b0e0 0x7f59481d3490 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f59380011e0 tx=0x7f593800ca30 comp rx=0 tx=0).stop 2023-06-23T18:45:11.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.672+0000 7f594e0de700 1 -- 172.21.15.52:0/3101465604 shutdown_connections 2023-06-23T18:45:11.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.672+0000 7f594e0de700 1 --2- 172.21.15.52:0/3101465604 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f592806ace0 0x7f592806d190 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:11.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.672+0000 7f594e0de700 1 --2- 172.21.15.52:0/3101465604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59480afe00 0x7f59481d2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:11.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.672+0000 7f594e0de700 1 --2- 172.21.15.52:0/3101465604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f594806b0e0 0x7f59481d3490 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:11.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.672+0000 7f594e0de700 1 --2- 172.21.15.52:0/3101465604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5948070930 0x7f59481d2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:11.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.672+0000 7f594e0de700 1 -- 172.21.15.52:0/3101465604 >> 172.21.15.52:0/3101465604 conn(0x7f59480b95c0 msgr2=0x7f59480bc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:11.678 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.672+0000 7f594e0de700 1 -- 172.21.15.52:0/3101465604 shutdown_connections 2023-06-23T18:45:11.679 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.672+0000 7f594e0de700 1 -- 172.21.15.52:0/3101465604 wait complete. 2023-06-23T18:45:11.689 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:45:11.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.811+0000 7fe3a5468700 1 Processor -- start 2023-06-23T18:45:11.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.811+0000 7fe3a5468700 1 -- start start 2023-06-23T18:45:11.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.811+0000 7fe3a5468700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe3a006a0d0 0x7fe3a00bc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:11.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.811+0000 7fe3a5468700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a0144920 0x7fe3a0154da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:11.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.811+0000 7fe3a5468700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a00b7aa0 con 0x7fe3a01444a0 2023-06-23T18:45:11.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.811+0000 7fe3a5468700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a00b5f30 con 0x7fe3a006a0d0 2023-06-23T18:45:11.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.811+0000 7fe3a5468700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a00b6210 con 0x7fe3a0144920 2023-06-23T18:45:11.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.811+0000 7fe39effd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe3a006a0d0 0x7fe3a00bc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:11.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.811+0000 7fe39effd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe3a006a0d0 0x7fe3a00bc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38412/0 (socket says 172.21.15.52:38412) 2023-06-23T18:45:11.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.811+0000 7fe39effd700 1 -- 172.21.15.52:0/2259925689 learned_addr learned my addr 172.21.15.52:0/2259925689 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:11.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.812+0000 7fe39f7fe700 1 --2- 172.21.15.52:0/2259925689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a0144920 0x7fe3a0154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:11.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.812+0000 7fe39effd700 1 -- 172.21.15.52:0/2259925689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a0144920 msgr2=0x7fe3a0154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:11.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.812+0000 7fe39effd700 1 --2- 172.21.15.52:0/2259925689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a0144920 0x7fe3a0154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:11.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.812+0000 7fe39effd700 1 -- 172.21.15.52:0/2259925689 >> v1:172.21.15.89:6789/0 conn(0x7fe3a01444a0 legacy=0x7fe3a00b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:11.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.812+0000 7fe39effd700 1 -- 172.21.15.52:0/2259925689 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a00b64f0 con 0x7fe3a006a0d0 2023-06-23T18:45:11.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.812+0000 7fe39f7fe700 1 --2- 172.21.15.52:0/2259925689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a0144920 0x7fe3a0154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:45:11.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.812+0000 7fe39effd700 1 --2- 172.21.15.52:0/2259925689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a006a0d0 0x7fe3a00bc8b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe3900098f0 tx=0x7fe390009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da7f7974641e16e server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:11.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.812+0000 7fe39dffb700 1 -- 172.21.15.52:0/2259925689 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe390004230 con 0x7fe3a006a0d0 2023-06-23T18:45:11.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.812+0000 7fe39dffb700 1 -- 172.21.15.52:0/2259925689 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe390004390 con 0x7fe3a006a0d0 2023-06-23T18:45:11.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.812+0000 7fe39dffb700 1 -- 172.21.15.52:0/2259925689 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3900036a0 con 0x7fe3a006a0d0 2023-06-23T18:45:11.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.813+0000 7fe3a5468700 1 -- 172.21.15.52:0/2259925689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a006a0d0 msgr2=0x7fe3a00bc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:11.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.813+0000 7fe3a5468700 1 --2- 172.21.15.52:0/2259925689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a006a0d0 0x7fe3a00bc8b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe3900098f0 tx=0x7fe390009c00 comp rx=0 tx=0).stop 2023-06-23T18:45:11.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.813+0000 7fe3a5468700 1 -- 172.21.15.52:0/2259925689 shutdown_connections 2023-06-23T18:45:11.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.813+0000 7fe3a5468700 1 --2- 172.21.15.52:0/2259925689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a0144920 0x7fe3a0154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:11.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.813+0000 7fe3a5468700 1 --2- 172.21.15.52:0/2259925689 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a006a0d0 0x7fe3a00bc8b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:11.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.813+0000 7fe3a5468700 1 -- 172.21.15.52:0/2259925689 >> 172.21.15.52:0/2259925689 conn(0x7fe3a006bb90 msgr2=0x7fe3a006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:11.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.813+0000 7fe3a5468700 1 -- 172.21.15.52:0/2259925689 shutdown_connections 2023-06-23T18:45:11.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.813+0000 7fe3a5468700 1 -- 172.21.15.52:0/2259925689 wait complete. 2023-06-23T18:45:11.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.814+0000 7fe3a5468700 1 Processor -- start 2023-06-23T18:45:11.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.814+0000 7fe3a5468700 1 -- start start 2023-06-23T18:45:11.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.815+0000 7fe3a5468700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a006a0d0 0x7fe3a0140e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:11.824 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.815+0000 7fe3a5468700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a01444a0 0x7fe3a01e36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:11.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.815+0000 7fe3a5468700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3a0144920 0x7fe3a01e3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:11.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.815+0000 7fe3a5468700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a01413c0 con 0x7fe3a006a0d0 2023-06-23T18:45:11.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.815+0000 7fe3a5468700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a0147aa0 con 0x7fe3a0144920 2023-06-23T18:45:11.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.815+0000 7fe3a5468700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a01459e0 con 0x7fe3a01444a0 2023-06-23T18:45:11.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.815+0000 7fe39effd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a006a0d0 0x7fe3a0140e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:11.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.815+0000 7fe39effd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a006a0d0 0x7fe3a0140e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38428/0 (socket says 172.21.15.52:38428) 2023-06-23T18:45:11.825 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.815+0000 7fe39effd700 1 -- 172.21.15.52:0/1803984042 learned_addr learned my addr 172.21.15.52:0/1803984042 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:11.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.815+0000 7fe39e7fc700 1 --2- 172.21.15.52:0/1803984042 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a01444a0 0x7fe3a01e36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:11.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.815+0000 7fe39f7fe700 1 --2- 172.21.15.52:0/1803984042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3a0144920 0x7fe3a01e3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:11.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.815+0000 7fe39effd700 1 -- 172.21.15.52:0/1803984042 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a01444a0 msgr2=0x7fe3a01e36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:11.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.815+0000 7fe39effd700 1 --2- 172.21.15.52:0/1803984042 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a01444a0 0x7fe3a01e36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:11.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.815+0000 7fe39effd700 1 -- 172.21.15.52:0/1803984042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3a0144920 msgr2=0x7fe3a01e3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:11.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.815+0000 7fe39effd700 1 --2- 172.21.15.52:0/1803984042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3a0144920 0x7fe3a01e3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:11.826 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.815+0000 7fe39effd700 1 -- 172.21.15.52:0/1803984042 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe390009550 con 0x7fe3a006a0d0 2023-06-23T18:45:11.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.815+0000 7fe39effd700 1 --2- 172.21.15.52:0/1803984042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a006a0d0 0x7fe3a0140e80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe390009130 tx=0x7fe390004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:11.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.815+0000 7fe3977fe700 1 -- 172.21.15.52:0/1803984042 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe390003cd0 con 0x7fe3a006a0d0 2023-06-23T18:45:11.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.815+0000 7fe3977fe700 1 -- 172.21.15.52:0/1803984042 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39001f070 con 0x7fe3a006a0d0 2023-06-23T18:45:11.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.815+0000 7fe3a5468700 1 -- 172.21.15.52:0/1803984042 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a0145140 con 0x7fe3a006a0d0 2023-06-23T18:45:11.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.815+0000 7fe3977fe700 1 -- 172.21.15.52:0/1803984042 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39000b8a0 con 0x7fe3a006a0d0 2023-06-23T18:45:11.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.815+0000 7fe3a5468700 1 -- 172.21.15.52:0/1803984042 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a0145700 con 0x7fe3a006a0d0 2023-06-23T18:45:11.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.816+0000 7fe3a5468700 1 -- 172.21.15.52:0/1803984042 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a004e1d0 con 0x7fe3a006a0d0 2023-06-23T18:45:11.827 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.817+0000 7fe3977fe700 1 -- 172.21.15.52:0/1803984042 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe390021030 con 0x7fe3a006a0d0 2023-06-23T18:45:11.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.817+0000 7fe3977fe700 1 --2- 172.21.15.52:0/1803984042 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe38006ace0 0x7fe38006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:11.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.817+0000 7fe3977fe700 1 -- 172.21.15.52:0/1803984042 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe39008a920 con 0x7fe3a006a0d0 2023-06-23T18:45:11.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.817+0000 7fe39e7fc700 1 --2- 172.21.15.52:0/1803984042 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe38006ace0 0x7fe38006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:11.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.818+0000 7fe39e7fc700 1 --2- 172.21.15.52:0/1803984042 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe38006ace0 0x7fe38006d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe3a01e4400 tx=0x7fe388007ec0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:11.828 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:11.822+0000 7fe3977fe700 1 -- 172.21.15.52:0/1803984042 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe390055a60 con 0x7fe3a006a0d0 2023-06-23T18:45:12.023 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.019+0000 7fe3a5468700 1 -- 172.21.15.52:0/1803984042 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3a004e1d0 con 0x7fe3a006a0d0 2023-06-23T18:45:12.024 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.020+0000 7fe3977fe700 1 -- 172.21.15.52:0/1803984042 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7fe390059080 con 0x7fe3a006a0d0 2023-06-23T18:45:12.025 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:12.025 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","created":"2023-06-23T18:44:31.918434+0000","modified":"2023-06-23T18:44:51.644330+0000","last_up_change":"2023-06-23T18:44:42.169624+0000","last_in_change":"2023-06-23T18:44:34.510501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-23T18:44:43.346578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-23T18:44:43.829719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:44:48.517897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:44:49.621134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c371fb28-1b15-4e43-8d5a-43e402920ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6812","nonce":1066999520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6815","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6818","nonce":1066999520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6829","nonce":1066999520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6823","nonce":1066999520}]},"public_addr":"172.21.15.52:6812/1066999520","cluster_addr":"172.21.15.52:6818/1066999520","heartbeat_back_addr":"172.21.15.52:6829/1066999520","heartbeat_front_addr":"172.21.15.52:6823/1066999520","state":["exists","up"]},{"osd":1,"uuid":"4a142f04-33eb-47ec-9cc5-b08b44d82658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6813","nonce":2360219751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6819","nonce":2360219751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6830","nonce":2360219751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6825","nonce":2360219751}]},"public_addr":"172.21.15.52:6813/2360219751","cluster_addr":"172.21.15.52:6819/2360219751","heartbeat_back_addr":"172.21.15.52:6830/2360219751","heartbeat_front_addr":"172.21.15.52:6825/2360219751","state":["exists","up"]},{"osd":2,"uuid":"d7bb089d-4c55-4370-ba59-7fe88c39512a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6801","nonce":835073005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6803","nonce":835073005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6807","nonce":835073005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6805","nonce":835073005}]},"public_addr":"172.21.15.52:6801/835073005","cluster_addr":"172.21.15.52:6803/835073005","heartbeat_back_addr":"172.21.15.52:6807/835073005","heartbeat_front_addr":"172.21.15.52:6805/835073005","state":["exists","up"]},{"osd":3,"uuid":"4bcdcdc3-6a8f-468e-877e-57f76079ac3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6811","nonce":2852700864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6817","nonce":2852700864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6831","nonce":2852700864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6824","nonce":2852700864}]},"public_addr":"172.21.15.52:6811/2852700864","cluster_addr":"172.21.15.52:6817/2852700864","heartbeat_back_addr":"172.21.15.52:6831/2852700864","heartbeat_front_addr":"172.21.15.52:6824/2852700864","state":["exists","up"]},{"osd":4,"uuid":"cac63000-ae94-4b08-93e6-a99119640b63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6809","nonce":2538664679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6811","nonce":2538664679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6815","nonce":2538664679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6813","nonce":2538664679}]},"public_addr":"172.21.15.89:6809/2538664679","cluster_addr":"172.21.15.89:6811/2538664679","heartbeat_back_addr":"172.21.15.89:6815/2538664679","heartbeat_front_addr":"172.21.15.89:6813/2538664679","state":["exists","up"]},{"osd":5,"uuid":"45c53102-18a6-4fd7-9c25-8ea5e1ef6851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6801","nonce":1683710352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6803","nonce":1683710352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6807","nonce":1683710352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6805","nonce":1683710352}]},"public_addr":"172.21.15.89:6801/1683710352","cluster_addr":"172.21.15.89:6803/1683710352","heartbeat_back_addr":"172.21.15.89:6807/1683710352","heartbeat_front_addr":"172.21.15.89:6805/1683710352","state":["exists","up"]},{"osd":6,"uuid":"abee09d1-8eba-484f-a25c-871c1fe2e843","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6817","nonce":3890899288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6819","nonce":3890899288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6823","nonce":3890899288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6821","nonce":3890899288}]},"public_addr":"172.21.15.89:6817/3890899288","cluster_addr":"172.21.15.89:6819/3890899288","heartbeat_back_addr":"172.21.15.89:6823/3890899288","heartbeat_front_addr":"172.21.15.89:6821/3890899288","state":["exists","up"]},{"osd":7,"uuid":"5acf9e2e-00dd-4f9b-a7d9-3d820f695de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6825","nonce":2989085420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6827","nonce":2989085420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6831","nonce":2989085420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6829","nonce":2989085420}]},"public_addr":"172.21.15.89:6825/2989085420","cluster_addr":"172.21.15.89:6827/2989085420","heartbeat_back_addr":"172.21.15.89:6831/2989085420","heartbeat_front_addr":"172.21.15.89:6829/2989085420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.663866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.710904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.619347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.660102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.686933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.724635+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.669111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.678740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:45:12.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.022+0000 7fe3a5468700 1 -- 172.21.15.52:0/1803984042 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe38006ace0 msgr2=0x7fe38006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:12.027 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.022+0000 7fe3a5468700 1 --2- 172.21.15.52:0/1803984042 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe38006ace0 0x7fe38006d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe3a01e4400 tx=0x7fe388007ec0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.022+0000 7fe3a5468700 1 -- 172.21.15.52:0/1803984042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a006a0d0 msgr2=0x7fe3a0140e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:12.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.022+0000 7fe3a5468700 1 --2- 172.21.15.52:0/1803984042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a006a0d0 0x7fe3a0140e80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe390009130 tx=0x7fe390004750 comp rx=0 tx=0).stop 2023-06-23T18:45:12.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.022+0000 7fe3a5468700 1 -- 172.21.15.52:0/1803984042 shutdown_connections 2023-06-23T18:45:12.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.022+0000 7fe3a5468700 1 --2- 172.21.15.52:0/1803984042 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe38006ace0 0x7fe38006d190 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.022+0000 7fe3a5468700 1 --2- 172.21.15.52:0/1803984042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3a0144920 0x7fe3a01e3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.022+0000 7fe3a5468700 1 --2- 172.21.15.52:0/1803984042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3a006a0d0 0x7fe3a0140e80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.028 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.022+0000 7fe3a5468700 1 --2- 172.21.15.52:0/1803984042 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a01444a0 0x7fe3a01e36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.022+0000 7fe3a5468700 1 -- 172.21.15.52:0/1803984042 >> 172.21.15.52:0/1803984042 conn(0x7fe3a006bb90 msgr2=0x7fe3a00bf9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:12.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.022+0000 7fe3a5468700 1 -- 172.21.15.52:0/1803984042 shutdown_connections 2023-06-23T18:45:12.029 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.022+0000 7fe3a5468700 1 -- 172.21.15.52:0/1803984042 wait complete. 2023-06-23T18:45:12.039 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-23T18:44:43.346578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-23T18:44:43.829719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T18:44:48.517897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T18:44:49.621134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-23T18:45:12.039 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T18:45:12.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.163+0000 7facb3b7e700 1 Processor -- start 2023-06-23T18:45:12.168 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.163+0000 7facb3b7e700 1 -- start start 2023-06-23T18:45:12.169 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.164+0000 7facb3b7e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7facac0b9950 0x7facac06c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:12.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.164+0000 7facb3b7e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facac0b3c90 con 0x7facac152d40 2023-06-23T18:45:12.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.164+0000 7facb3b7e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facac0706a0 con 0x7facac147b40 2023-06-23T18:45:12.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.164+0000 7facb3b7e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facac0718d0 con 0x7facac0b9950 2023-06-23T18:45:12.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.164+0000 7facb211b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7facac152d40 0x7facac155120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48130/0 (socket says 172.21.15.52:48130) 2023-06-23T18:45:12.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.164+0000 7facb211b700 1 -- 172.21.15.52:0/4195856226 learned_addr learned my addr 172.21.15.52:0/4195856226 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:12.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.164+0000 7facb1119700 1 --2- 172.21.15.52:0/4195856226 >> v2:172.21.15.89:3300/0 conn(0x7facac0b9950 0x7facac06c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:12.170 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.164+0000 7facb0918700 1 -- 172.21.15.52:0/4195856226 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598109573 0 0) 0x7facac0b3c90 con 0x7facac152d40 2023-06-23T18:45:12.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.164+0000 7facb0918700 1 -- 172.21.15.52:0/4195856226 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac980035b0 con 0x7facac152d40 2023-06-23T18:45:12.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.165+0000 7facb1119700 1 -- 172.21.15.52:0/4195856226 >> v1:172.21.15.89:6789/0 conn(0x7facac147b40 legacy=0x7facac0b90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:12.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.165+0000 7facb1119700 1 -- 172.21.15.52:0/4195856226 >> v1:172.21.15.52:6789/0 conn(0x7facac152d40 legacy=0x7facac155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:12.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.165+0000 7facb1119700 1 -- 172.21.15.52:0/4195856226 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facac0b4260 con 0x7facac0b9950 2023-06-23T18:45:12.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.165+0000 7facb1119700 1 --2- 172.21.15.52:0/4195856226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facac0b9950 0x7facac06c010 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faca8009840 tx=0x7faca8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d08b8a2bb00d57e server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:12.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.165+0000 7facb0918700 1 -- 172.21.15.52:0/4195856226 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca8011830 con 0x7facac0b9950 2023-06-23T18:45:12.171 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.165+0000 7facb0918700 1 -- 172.21.15.52:0/4195856226 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca8011990 con 0x7facac0b9950 2023-06-23T18:45:12.172 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.165+0000 7facb0918700 1 -- 172.21.15.52:0/4195856226 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca8011d20 con 0x7facac0b9950 2023-06-23T18:45:12.173 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.165+0000 7facb3b7e700 1 -- 172.21.15.52:0/4195856226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facac0b9950 msgr2=0x7facac06c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:12.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.165+0000 7facb3b7e700 1 --2- 172.21.15.52:0/4195856226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facac0b9950 0x7facac06c010 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faca8009840 tx=0x7faca8009b50 comp rx=0 tx=0).stop 2023-06-23T18:45:12.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.165+0000 7facb3b7e700 1 -- 172.21.15.52:0/4195856226 shutdown_connections 2023-06-23T18:45:12.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.165+0000 7facb3b7e700 1 --2- 172.21.15.52:0/4195856226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facac0b9950 0x7facac06c010 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.165+0000 7facb3b7e700 1 -- 172.21.15.52:0/4195856226 >> 172.21.15.52:0/4195856226 conn(0x7facac0be000 msgr2=0x7facac0b9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:12.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.166+0000 7facb3b7e700 1 -- 172.21.15.52:0/4195856226 shutdown_connections 2023-06-23T18:45:12.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.166+0000 7facb3b7e700 1 -- 172.21.15.52:0/4195856226 wait complete. 2023-06-23T18:45:12.174 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.167+0000 7facb3b7e700 1 Processor -- start 2023-06-23T18:45:12.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.167+0000 7facb3b7e700 1 -- start start 2023-06-23T18:45:12.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.167+0000 7facb3b7e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facac0b9950 0x7facac137770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:12.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.167+0000 7facb3b7e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facac147b40 0x7facac1e3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:12.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.167+0000 7facb3b7e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facac152d40 0x7facac14a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:12.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.167+0000 7facb3b7e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac137cb0 con 0x7facac147b40 2023-06-23T18:45:12.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.167+0000 7facb3b7e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac13b690 con 0x7facac152d40 2023-06-23T18:45:12.175 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.167+0000 7facb3b7e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facac1e1240 con 0x7facac0b9950 2023-06-23T18:45:12.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.167+0000 7facb1119700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facac147b40 0x7facac1e3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:12.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.167+0000 7facb1119700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facac147b40 0x7facac1e3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38440/0 (socket says 172.21.15.52:38440) 2023-06-23T18:45:12.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.167+0000 7facb1119700 1 -- 172.21.15.52:0/2666163010 learned_addr learned my addr 172.21.15.52:0/2666163010 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:12.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.168+0000 7facb191a700 1 --2- 172.21.15.52:0/2666163010 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facac0b9950 0x7facac137770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:12.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.168+0000 7facb211b700 1 --2- 172.21.15.52:0/2666163010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facac152d40 0x7facac14a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:12.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.168+0000 7facb1119700 1 -- 172.21.15.52:0/2666163010 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facac0b9950 msgr2=0x7facac137770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:12.176 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.168+0000 7facb1119700 1 --2- 172.21.15.52:0/2666163010 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facac0b9950 0x7facac137770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.168+0000 7facb1119700 1 -- 172.21.15.52:0/2666163010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facac152d40 msgr2=0x7facac14a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:12.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.168+0000 7facb1119700 1 --2- 172.21.15.52:0/2666163010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facac152d40 0x7facac14a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.168+0000 7facb1119700 1 -- 172.21.15.52:0/2666163010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca80094a0 con 0x7facac147b40 2023-06-23T18:45:12.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.168+0000 7facb1119700 1 --2- 172.21.15.52:0/2666163010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facac147b40 0x7facac1e3300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7faca8009fd0 tx=0x7faca8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:12.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.168+0000 7faca27fc700 1 -- 172.21.15.52:0/2666163010 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca80038a0 con 0x7facac147b40 2023-06-23T18:45:12.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.168+0000 7faca27fc700 1 -- 172.21.15.52:0/2666163010 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca801f070 con 0x7facac147b40 2023-06-23T18:45:12.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.168+0000 7faca27fc700 1 -- 172.21.15.52:0/2666163010 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca8003c00 con 0x7facac147b40 2023-06-23T18:45:12.177 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.168+0000 7facb3b7e700 1 -- 172.21.15.52:0/2666163010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facac1e3b80 con 0x7facac147b40 2023-06-23T18:45:12.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.168+0000 7facb3b7e700 1 -- 172.21.15.52:0/2666163010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facac1e3840 con 0x7facac147b40 2023-06-23T18:45:12.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.169+0000 7facb3b7e700 1 -- 172.21.15.52:0/2666163010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facac1e0d30 con 0x7facac147b40 2023-06-23T18:45:12.178 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.170+0000 7faca27fc700 1 -- 172.21.15.52:0/2666163010 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faca801a430 con 0x7facac147b40 2023-06-23T18:45:12.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.170+0000 7faca27fc700 1 --2- 172.21.15.52:0/2666163010 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fac9006ace0 0x7fac9006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:12.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.170+0000 7faca27fc700 1 -- 172.21.15.52:0/2666163010 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faca8021070 con 0x7facac147b40 2023-06-23T18:45:12.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.170+0000 7facb191a700 1 --2- 172.21.15.52:0/2666163010 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fac9006ace0 0x7fac9006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:12.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.171+0000 7facb191a700 1 --2- 172.21.15.52:0/2666163010 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fac9006ace0 0x7fac9006d190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fac9c000f60 tx=0x7fac9c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:12.179 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.174+0000 7faca27fc700 1 -- 172.21.15.52:0/2666163010 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7facac1e0d30 con 0x7facac147b40 2023-06-23T18:45:12.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.368+0000 7facb3b7e700 1 -- 172.21.15.52:0/2666163010 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7facac1e0d30 con 0x7facac147b40 2023-06-23T18:45:12.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.369+0000 7faca27fc700 1 -- 172.21.15.52:0/2666163010 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7facac1e0d30 con 0x7facac147b40 2023-06-23T18:45:12.374 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-06-23T18:45:12.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.371+0000 7facb3b7e700 1 -- 172.21.15.52:0/2666163010 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fac9006ace0 msgr2=0x7fac9006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:12.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.371+0000 7facb3b7e700 1 --2- 172.21.15.52:0/2666163010 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fac9006ace0 0x7fac9006d190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fac9c000f60 tx=0x7fac9c009040 comp rx=0 tx=0).stop 2023-06-23T18:45:12.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.371+0000 7facb3b7e700 1 -- 172.21.15.52:0/2666163010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facac147b40 msgr2=0x7facac1e3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:12.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.371+0000 7facb3b7e700 1 --2- 172.21.15.52:0/2666163010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facac147b40 0x7facac1e3300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7faca8009fd0 tx=0x7faca8004750 comp rx=0 tx=0).stop 2023-06-23T18:45:12.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.371+0000 7facb3b7e700 1 -- 172.21.15.52:0/2666163010 shutdown_connections 2023-06-23T18:45:12.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.371+0000 7facb3b7e700 1 --2- 172.21.15.52:0/2666163010 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fac9006ace0 0x7fac9006d190 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.371+0000 7facb3b7e700 1 --2- 172.21.15.52:0/2666163010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facac152d40 0x7facac14a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.371+0000 7facb3b7e700 1 --2- 172.21.15.52:0/2666163010 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7facac0b9950 0x7facac137770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.371+0000 7facb3b7e700 1 --2- 172.21.15.52:0/2666163010 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7facac147b40 0x7facac1e3300 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.371+0000 7facb3b7e700 1 -- 172.21.15.52:0/2666163010 >> 172.21.15.52:0/2666163010 conn(0x7facac0be000 msgr2=0x7facac145580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:12.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.371+0000 7facb3b7e700 1 -- 172.21.15.52:0/2666163010 shutdown_connections 2023-06-23T18:45:12.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.371+0000 7facb3b7e700 1 -- 172.21.15.52:0/2666163010 wait complete. 2023-06-23T18:45:12.388 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T18:45:12.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.511+0000 7f8494486700 1 Processor -- start 2023-06-23T18:45:12.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.511+0000 7f8494486700 1 -- start start 2023-06-23T18:45:12.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.512+0000 7f8494486700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f848c06b0e0 0x7f848c140b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:12.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.512+0000 7f8494486700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f848c141090 0x7f848c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:12.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.512+0000 7f8494486700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f848c071050 0x7f848c14a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:12.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.512+0000 7f8494486700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848c070140 con 0x7f848c141090 2023-06-23T18:45:12.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.512+0000 7f8494486700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848c070420 con 0x7f848c071050 2023-06-23T18:45:12.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.512+0000 7f8494486700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848c070700 con 0x7f848c06b0e0 2023-06-23T18:45:12.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.512+0000 7f8491a21700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f848c141090 0x7f848c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:12.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.512+0000 7f8491a21700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f848c141090 0x7f848c070b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38446/0 (socket says 172.21.15.52:38446) 2023-06-23T18:45:12.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.512+0000 7f8491a21700 1 -- 172.21.15.52:0/3864924548 learned_addr learned my addr 172.21.15.52:0/3864924548 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:12.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.512+0000 7f8492a23700 1 --2- 172.21.15.52:0/3864924548 >> v2:172.21.15.89:3300/0 conn(0x7f848c071050 0x7f848c14a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:12.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.512+0000 7f8492222700 1 --2- 172.21.15.52:0/3864924548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f848c06b0e0 0x7f848c140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:12.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.513+0000 7f8491a21700 1 -- 172.21.15.52:0/3864924548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f848c06b0e0 msgr2=0x7f848c140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:12.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.513+0000 7f8491a21700 1 --2- 172.21.15.52:0/3864924548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f848c06b0e0 0x7f848c140b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.513+0000 7f8491a21700 1 -- 172.21.15.52:0/3864924548 >> v2:172.21.15.89:3300/0 conn(0x7f848c071050 msgr2=0x7f848c14a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:12.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.513+0000 7f8491a21700 1 --2- 172.21.15.52:0/3864924548 >> v2:172.21.15.89:3300/0 conn(0x7f848c071050 0x7f848c14a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.513+0000 7f8491a21700 1 -- 172.21.15.52:0/3864924548 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848c0b92e0 con 0x7f848c141090 2023-06-23T18:45:12.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.513+0000 7f8492a23700 1 --2- 172.21.15.52:0/3864924548 >> v2:172.21.15.89:3300/0 conn(0x7f848c071050 0x7f848c14a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:12.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.513+0000 7f8491a21700 1 --2- 172.21.15.52:0/3864924548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f848c141090 0x7f848c070b10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f848c06f540 tx=0x7f847c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ca26cd724b0c04 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:12.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.513+0000 7f8491220700 1 -- 172.21.15.52:0/3864924548 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847c011830 con 0x7f848c141090 2023-06-23T18:45:12.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.513+0000 7f8491220700 1 -- 172.21.15.52:0/3864924548 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847c011990 con 0x7f848c141090 2023-06-23T18:45:12.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.513+0000 7f8491220700 1 -- 172.21.15.52:0/3864924548 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847c011d20 con 0x7f848c141090 2023-06-23T18:45:12.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.513+0000 7f8494486700 1 -- 172.21.15.52:0/3864924548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f848c141090 msgr2=0x7f848c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:12.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.513+0000 7f8494486700 1 --2- 172.21.15.52:0/3864924548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f848c141090 0x7f848c070b10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f848c06f540 tx=0x7f847c009bd0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.513+0000 7f8494486700 1 -- 172.21.15.52:0/3864924548 shutdown_connections 2023-06-23T18:45:12.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.513+0000 7f8494486700 1 --2- 172.21.15.52:0/3864924548 >> v2:172.21.15.89:3300/0 conn(0x7f848c071050 0x7f848c14a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.513+0000 7f8494486700 1 --2- 172.21.15.52:0/3864924548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f848c06b0e0 0x7f848c140b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.513+0000 7f8494486700 1 --2- 172.21.15.52:0/3864924548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f848c141090 0x7f848c070b10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.513+0000 7f8494486700 1 -- 172.21.15.52:0/3864924548 >> 172.21.15.52:0/3864924548 conn(0x7f848c0b95c0 msgr2=0x7f848c0b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:12.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.514+0000 7f8494486700 1 -- 172.21.15.52:0/3864924548 shutdown_connections 2023-06-23T18:45:12.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.514+0000 7f8494486700 1 -- 172.21.15.52:0/3864924548 wait complete. 2023-06-23T18:45:12.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.515+0000 7f8494486700 1 Processor -- start 2023-06-23T18:45:12.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.515+0000 7f8494486700 1 -- start start 2023-06-23T18:45:12.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.515+0000 7f8494486700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f848c06b0e0 0x7f848c1e3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:12.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.515+0000 7f8494486700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f848c071050 0x7f848c0b2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:12.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.515+0000 7f8494486700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f848c141090 0x7f848c0b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:12.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.515+0000 7f8494486700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c146100 con 0x7f848c06b0e0 2023-06-23T18:45:12.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.515+0000 7f8494486700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c145130 con 0x7f848c071050 2023-06-23T18:45:12.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.515+0000 7f8494486700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848c145410 con 0x7f848c141090 2023-06-23T18:45:12.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.515+0000 7f8492222700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f848c06b0e0 0x7f848c1e3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:12.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.515+0000 7f8492222700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f848c06b0e0 0x7f848c1e3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38450/0 (socket says 172.21.15.52:38450) 2023-06-23T18:45:12.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.515+0000 7f8492222700 1 -- 172.21.15.52:0/84556361 learned_addr learned my addr 172.21.15.52:0/84556361 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:12.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.515+0000 7f8491a21700 1 --2- 172.21.15.52:0/84556361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f848c071050 0x7f848c0b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:12.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.515+0000 7f8492a23700 1 --2- 172.21.15.52:0/84556361 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f848c141090 0x7f848c0b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:12.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.516+0000 7f8492222700 1 -- 172.21.15.52:0/84556361 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f848c141090 msgr2=0x7f848c0b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:12.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.516+0000 7f8492222700 1 --2- 172.21.15.52:0/84556361 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f848c141090 0x7f848c0b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.516+0000 7f8492222700 1 -- 172.21.15.52:0/84556361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f848c071050 msgr2=0x7f848c0b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:12.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.516+0000 7f8492222700 1 --2- 172.21.15.52:0/84556361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f848c071050 0x7f848c0b2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.516+0000 7f8492222700 1 -- 172.21.15.52:0/84556361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f847c009550 con 0x7f848c06b0e0 2023-06-23T18:45:12.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.516+0000 7f8492222700 1 --2- 172.21.15.52:0/84556361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f848c06b0e0 0x7f848c1e3230 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f848800e930 tx=0x7f848800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:12.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.516+0000 7f8482ffd700 1 -- 172.21.15.52:0/84556361 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488013680 con 0x7f848c06b0e0 2023-06-23T18:45:12.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.516+0000 7f8482ffd700 1 -- 172.21.15.52:0/84556361 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84880137e0 con 0x7f848c06b0e0 2023-06-23T18:45:12.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.516+0000 7f8494486700 1 -- 172.21.15.52:0/84556361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f848c1456f0 con 0x7f848c06b0e0 2023-06-23T18:45:12.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.516+0000 7f8482ffd700 1 -- 172.21.15.52:0/84556361 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488013b70 con 0x7f848c06b0e0 2023-06-23T18:45:12.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.516+0000 7f8494486700 1 -- 172.21.15.52:0/84556361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f848c144770 con 0x7f848c06b0e0 2023-06-23T18:45:12.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.517+0000 7f8494486700 1 -- 172.21.15.52:0/84556361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f848c0b6da0 con 0x7f848c06b0e0 2023-06-23T18:45:12.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.517+0000 7f8482ffd700 1 -- 172.21.15.52:0/84556361 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8488013cd0 con 0x7f848c06b0e0 2023-06-23T18:45:12.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.518+0000 7f8482ffd700 1 --2- 172.21.15.52:0/84556361 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f847006ace0 0x7f847006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:12.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.518+0000 7f8482ffd700 1 -- 172.21.15.52:0/84556361 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8488089360 con 0x7f848c06b0e0 2023-06-23T18:45:12.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.518+0000 7f8491a21700 1 --2- 172.21.15.52:0/84556361 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f847006ace0 0x7f847006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:12.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.518+0000 7f8491a21700 1 --2- 172.21.15.52:0/84556361 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f847006ace0 0x7f847006d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f847c009c10 tx=0x7f847c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:12.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.522+0000 7f8482ffd700 1 -- 172.21.15.52:0/84556361 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f84880544a0 con 0x7f848c06b0e0 2023-06-23T18:45:12.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.714+0000 7f8494486700 1 -- 172.21.15.52:0/84556361 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f848c04e1d0 con 0x7f848c06b0e0 2023-06-23T18:45:12.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.714+0000 7f8482ffd700 1 -- 172.21.15.52:0/84556361 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8488057ac0 con 0x7f848c06b0e0 2023-06-23T18:45:12.719 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-06-23T18:45:12.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.716+0000 7f8494486700 1 -- 172.21.15.52:0/84556361 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f847006ace0 msgr2=0x7f847006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:12.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.716+0000 7f8494486700 1 --2- 172.21.15.52:0/84556361 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f847006ace0 0x7f847006d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f847c009c10 tx=0x7f847c008030 comp rx=0 tx=0).stop 2023-06-23T18:45:12.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.716+0000 7f8494486700 1 -- 172.21.15.52:0/84556361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f848c06b0e0 msgr2=0x7f848c1e3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:12.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.716+0000 7f8494486700 1 --2- 172.21.15.52:0/84556361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f848c06b0e0 0x7f848c1e3230 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f848800e930 tx=0x7f848800ec40 comp rx=0 tx=0).stop 2023-06-23T18:45:12.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.716+0000 7f8494486700 1 -- 172.21.15.52:0/84556361 shutdown_connections 2023-06-23T18:45:12.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.716+0000 7f8494486700 1 --2- 172.21.15.52:0/84556361 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f847006ace0 0x7f847006d190 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.716+0000 7f8494486700 1 --2- 172.21.15.52:0/84556361 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f848c141090 0x7f848c0b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.716+0000 7f8494486700 1 --2- 172.21.15.52:0/84556361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f848c06b0e0 0x7f848c1e3230 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.716+0000 7f8494486700 1 --2- 172.21.15.52:0/84556361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f848c071050 0x7f848c0b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.716+0000 7f8494486700 1 -- 172.21.15.52:0/84556361 >> 172.21.15.52:0/84556361 conn(0x7f848c0b95c0 msgr2=0x7f848c13f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:12.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.716+0000 7f8494486700 1 -- 172.21.15.52:0/84556361 shutdown_connections 2023-06-23T18:45:12.723 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.716+0000 7f8494486700 1 -- 172.21.15.52:0/84556361 wait complete. 2023-06-23T18:45:12.733 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T18:45:12.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.857+0000 7f29cdf22700 1 Processor -- start 2023-06-23T18:45:12.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.857+0000 7f29cdf22700 1 -- start start 2023-06-23T18:45:12.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.858+0000 7f29cdf22700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f29c814abd0 0x7f29c8070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:12.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.858+0000 7f29cdf22700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c8141260 con 0x7f29c806b0e0 2023-06-23T18:45:12.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.858+0000 7f29cdf22700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c8070140 con 0x7f29c8070b10 2023-06-23T18:45:12.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.858+0000 7f29cdf22700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c8070420 con 0x7f29c814abd0 2023-06-23T18:45:12.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.858+0000 7f29c77fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f29c806b0e0 0x7f29c8140b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48132/0 (socket says 172.21.15.52:48132) 2023-06-23T18:45:12.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.858+0000 7f29c77fe700 1 -- 172.21.15.52:0/2252634487 learned_addr learned my addr 172.21.15.52:0/2252634487 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:12.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.858+0000 7f29c7fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f29c814abd0 0x7f29c8070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:12.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.858+0000 7f29c7fff700 1 -- 172.21.15.52:0/2252634487 >> v1:172.21.15.89:6789/0 conn(0x7f29c8070b10 legacy=0x7f29c814a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:12.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.858+0000 7f29c7fff700 1 -- 172.21.15.52:0/2252634487 >> v1:172.21.15.52:6789/0 conn(0x7f29c806b0e0 legacy=0x7f29c8140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:12.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.858+0000 7f29c7fff700 1 -- 172.21.15.52:0/2252634487 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c8070700 con 0x7f29c814abd0 2023-06-23T18:45:12.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.858+0000 7f29c6ffd700 1 -- 172.21.15.52:0/2252634487 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016293984 0 0) 0x7f29c8141260 con 0x7f29c806b0e0 2023-06-23T18:45:12.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.859+0000 7f29c7fff700 1 --2- 172.21.15.52:0/2252634487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c814abd0 0x7f29c8070f70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f29c000aea0 tx=0x7f29c000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c9378a219855cd server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:12.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.859+0000 7f29c6ffd700 1 -- 172.21.15.52:0/2252634487 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c000f070 con 0x7f29c814abd0 2023-06-23T18:45:12.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.859+0000 7f29c6ffd700 1 -- 172.21.15.52:0/2252634487 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c000c9c0 con 0x7f29c814abd0 2023-06-23T18:45:12.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.859+0000 7f29c6ffd700 1 -- 172.21.15.52:0/2252634487 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c000cd70 con 0x7f29c814abd0 2023-06-23T18:45:12.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.859+0000 7f29cdf22700 1 -- 172.21.15.52:0/2252634487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c814abd0 msgr2=0x7f29c8070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:12.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.859+0000 7f29cdf22700 1 --2- 172.21.15.52:0/2252634487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c814abd0 0x7f29c8070f70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f29c000aea0 tx=0x7f29c000c330 comp rx=0 tx=0).stop 2023-06-23T18:45:12.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.859+0000 7f29cdf22700 1 -- 172.21.15.52:0/2252634487 shutdown_connections 2023-06-23T18:45:12.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.859+0000 7f29cdf22700 1 --2- 172.21.15.52:0/2252634487 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c814abd0 0x7f29c8070f70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.859+0000 7f29cdf22700 1 -- 172.21.15.52:0/2252634487 >> 172.21.15.52:0/2252634487 conn(0x7f29c80b95c0 msgr2=0x7f29c80b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:12.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.859+0000 7f29cdf22700 1 -- 172.21.15.52:0/2252634487 shutdown_connections 2023-06-23T18:45:12.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.859+0000 7f29cdf22700 1 -- 172.21.15.52:0/2252634487 wait complete. 2023-06-23T18:45:12.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.860+0000 7f29cdf22700 1 Processor -- start 2023-06-23T18:45:12.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.861+0000 7f29cdf22700 1 -- start start 2023-06-23T18:45:12.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.861+0000 7f29cdf22700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29c806b0e0 0x7f29c80b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:12.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.861+0000 7f29cdf22700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29c8070b10 0x7f29c8142bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:12.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.861+0000 7f29cdf22700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c814abd0 0x7f29c8143130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:12.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.861+0000 7f29cdf22700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c8147e50 con 0x7f29c814abd0 2023-06-23T18:45:12.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.861+0000 7f29cdf22700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c80b4eb0 con 0x7f29c806b0e0 2023-06-23T18:45:12.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.861+0000 7f29cdf22700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c8143670 con 0x7f29c8070b10 2023-06-23T18:45:12.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.861+0000 7f29c7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c814abd0 0x7f29c8143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:12.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.861+0000 7f29c7fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c814abd0 0x7f29c8143130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38464/0 (socket says 172.21.15.52:38464) 2023-06-23T18:45:12.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.861+0000 7f29c7fff700 1 -- 172.21.15.52:0/1677668274 learned_addr learned my addr 172.21.15.52:0/1677668274 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:12.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.862+0000 7f29c77fe700 1 --2- 172.21.15.52:0/1677668274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29c806b0e0 0x7f29c80b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:12.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.862+0000 7f29beffd700 1 --2- 172.21.15.52:0/1677668274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29c8070b10 0x7f29c8142bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:12.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.862+0000 7f29c7fff700 1 -- 172.21.15.52:0/1677668274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29c8070b10 msgr2=0x7f29c8142bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:12.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.862+0000 7f29c7fff700 1 --2- 172.21.15.52:0/1677668274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29c8070b10 0x7f29c8142bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.862+0000 7f29c7fff700 1 -- 172.21.15.52:0/1677668274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29c806b0e0 msgr2=0x7f29c80b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:12.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.862+0000 7f29c7fff700 1 --2- 172.21.15.52:0/1677668274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29c806b0e0 0x7f29c80b4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:12.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.862+0000 7f29c7fff700 1 -- 172.21.15.52:0/1677668274 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c000ab80 con 0x7f29c814abd0 2023-06-23T18:45:12.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.862+0000 7f29c7fff700 1 --2- 172.21.15.52:0/1677668274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c814abd0 0x7f29c8143130 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f29c806f1e0 tx=0x7f29c0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:12.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.862+0000 7f29c4ff9700 1 -- 172.21.15.52:0/1677668274 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c001c630 con 0x7f29c814abd0 2023-06-23T18:45:12.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.862+0000 7f29c4ff9700 1 -- 172.21.15.52:0/1677668274 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c001c7b0 con 0x7f29c814abd0 2023-06-23T18:45:12.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.862+0000 7f29c4ff9700 1 -- 172.21.15.52:0/1677668274 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c001cb60 con 0x7f29c814abd0 2023-06-23T18:45:12.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.862+0000 7f29cdf22700 1 -- 172.21.15.52:0/1677668274 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c8149850 con 0x7f29c814abd0 2023-06-23T18:45:12.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.862+0000 7f29cdf22700 1 -- 172.21.15.52:0/1677668274 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c81427d0 con 0x7f29c814abd0 2023-06-23T18:45:12.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.863+0000 7f29cdf22700 1 -- 172.21.15.52:0/1677668274 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c8149e30 con 0x7f29c814abd0 2023-06-23T18:45:12.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.863+0000 7f29c4ff9700 1 -- 172.21.15.52:0/1677668274 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f29c001ccc0 con 0x7f29c814abd0 2023-06-23T18:45:12.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.864+0000 7f29c4ff9700 1 --2- 172.21.15.52:0/1677668274 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f29a806ace0 0x7f29a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:12.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.864+0000 7f29c4ff9700 1 -- 172.21.15.52:0/1677668274 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f29c008b0b0 con 0x7f29c814abd0 2023-06-23T18:45:12.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.864+0000 7f29c77fe700 1 --2- 172.21.15.52:0/1677668274 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f29a806ace0 0x7f29a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:12.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.864+0000 7f29c77fe700 1 --2- 172.21.15.52:0/1677668274 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f29a806ace0 0x7f29a806d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f29b8000f60 tx=0x7f29b8007d90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:12.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:12.868+0000 7f29c4ff9700 1 -- 172.21.15.52:0/1677668274 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f29c00563c0 con 0x7f29c814abd0 2023-06-23T18:45:13.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.059+0000 7f29cdf22700 1 -- 172.21.15.52:0/1677668274 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f29c804e1d0 con 0x7f29c814abd0 2023-06-23T18:45:13.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.060+0000 7f29c4ff9700 1 -- 172.21.15.52:0/1677668274 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f29c00599e0 con 0x7f29c814abd0 2023-06-23T18:45:13.065 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2023-06-23T18:45:13.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.061+0000 7f29cdf22700 1 -- 172.21.15.52:0/1677668274 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f29a806ace0 msgr2=0x7f29a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:13.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.061+0000 7f29cdf22700 1 --2- 172.21.15.52:0/1677668274 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f29a806ace0 0x7f29a806d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f29b8000f60 tx=0x7f29b8007d90 comp rx=0 tx=0).stop 2023-06-23T18:45:13.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.061+0000 7f29cdf22700 1 -- 172.21.15.52:0/1677668274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c814abd0 msgr2=0x7f29c8143130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:13.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.061+0000 7f29cdf22700 1 --2- 172.21.15.52:0/1677668274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c814abd0 0x7f29c8143130 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f29c806f1e0 tx=0x7f29c0004ad0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.062+0000 7f29cdf22700 1 -- 172.21.15.52:0/1677668274 shutdown_connections 2023-06-23T18:45:13.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.062+0000 7f29cdf22700 1 --2- 172.21.15.52:0/1677668274 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f29a806ace0 0x7f29a806d190 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.062+0000 7f29cdf22700 1 --2- 172.21.15.52:0/1677668274 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f29c814abd0 0x7f29c8143130 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.062+0000 7f29cdf22700 1 --2- 172.21.15.52:0/1677668274 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29c806b0e0 0x7f29c80b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.062+0000 7f29cdf22700 1 --2- 172.21.15.52:0/1677668274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29c8070b10 0x7f29c8142bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.062+0000 7f29cdf22700 1 -- 172.21.15.52:0/1677668274 >> 172.21.15.52:0/1677668274 conn(0x7f29c80b95c0 msgr2=0x7f29c80bbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:13.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.062+0000 7f29cdf22700 1 -- 172.21.15.52:0/1677668274 shutdown_connections 2023-06-23T18:45:13.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.062+0000 7f29cdf22700 1 -- 172.21.15.52:0/1677668274 wait complete. 2023-06-23T18:45:13.078 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T18:45:13.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.201+0000 7f9313b3d700 1 Processor -- start 2023-06-23T18:45:13.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.201+0000 7f9313b3d700 1 -- start start 2023-06-23T18:45:13.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.202+0000 7f9313b3d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f930c06b0e0 0x7f930c06fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:13.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.202+0000 7f9313b3d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f930c0afe00 0x7f930c0b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:13.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.202+0000 7f9313b3d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f930c0b6fe0 con 0x7f930c070930 2023-06-23T18:45:13.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.202+0000 7f9313b3d700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f930c071c00 con 0x7f930c06b0e0 2023-06-23T18:45:13.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.202+0000 7f9313b3d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930c0b6a20 con 0x7f930c0afe00 2023-06-23T18:45:13.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.202+0000 7f93118d9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f930c06b0e0 0x7f930c06fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:13.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.202+0000 7f93118d9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f930c06b0e0 0x7f930c06fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38476/0 (socket says 172.21.15.52:38476) 2023-06-23T18:45:13.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.202+0000 7f93118d9700 1 -- 172.21.15.52:0/665114858 learned_addr learned my addr 172.21.15.52:0/665114858 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:13.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.202+0000 7f93120da700 1 --2- 172.21.15.52:0/665114858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f930c0afe00 0x7f930c0b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:13.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.202+0000 7f93118d9700 1 -- 172.21.15.52:0/665114858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f930c0afe00 msgr2=0x7f930c0b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:13.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.202+0000 7f93118d9700 1 --2- 172.21.15.52:0/665114858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f930c0afe00 0x7f930c0b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.202+0000 7f93118d9700 1 -- 172.21.15.52:0/665114858 >> v1:172.21.15.89:6789/0 conn(0x7f930c070930 legacy=0x7f930c0b73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:13.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.202+0000 7f93118d9700 1 -- 172.21.15.52:0/665114858 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930c0b6d00 con 0x7f930c06b0e0 2023-06-23T18:45:13.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.203+0000 7f93118d9700 1 --2- 172.21.15.52:0/665114858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f930c06b0e0 0x7f930c06fab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f92fc0098f0 tx=0x7f92fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95bd5b832ec4e38 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:13.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.203+0000 7f93108d7700 1 -- 172.21.15.52:0/665114858 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc00b8a0 con 0x7f930c06b0e0 2023-06-23T18:45:13.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.203+0000 7f93108d7700 1 -- 172.21.15.52:0/665114858 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92fc00ba00 con 0x7f930c06b0e0 2023-06-23T18:45:13.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.203+0000 7f93108d7700 1 -- 172.21.15.52:0/665114858 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc00bd90 con 0x7f930c06b0e0 2023-06-23T18:45:13.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.203+0000 7f9313b3d700 1 -- 172.21.15.52:0/665114858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f930c06b0e0 msgr2=0x7f930c06fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:13.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.203+0000 7f9313b3d700 1 --2- 172.21.15.52:0/665114858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f930c06b0e0 0x7f930c06fab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f92fc0098f0 tx=0x7f92fc009c00 comp rx=0 tx=0).stop 2023-06-23T18:45:13.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.203+0000 7f9313b3d700 1 -- 172.21.15.52:0/665114858 shutdown_connections 2023-06-23T18:45:13.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.203+0000 7f9313b3d700 1 --2- 172.21.15.52:0/665114858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f930c0afe00 0x7f930c0b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.203+0000 7f9313b3d700 1 --2- 172.21.15.52:0/665114858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f930c06b0e0 0x7f930c06fab0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.203+0000 7f9313b3d700 1 -- 172.21.15.52:0/665114858 >> 172.21.15.52:0/665114858 conn(0x7f930c0b95c0 msgr2=0x7f930c0b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:13.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.203+0000 7f9313b3d700 1 -- 172.21.15.52:0/665114858 shutdown_connections 2023-06-23T18:45:13.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.203+0000 7f9313b3d700 1 -- 172.21.15.52:0/665114858 wait complete. 2023-06-23T18:45:13.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.204+0000 7f9313b3d700 1 Processor -- start 2023-06-23T18:45:13.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.204+0000 7f9313b3d700 1 -- start start 2023-06-23T18:45:13.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.205+0000 7f9313b3d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f930c06b0e0 0x7f930c0af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:13.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.205+0000 7f9313b3d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f930c070930 0x7f930c1496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:13.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.205+0000 7f9313b3d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f930c0afe00 0x7f930c1d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:13.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.205+0000 7f9313b3d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930c0aed90 con 0x7f930c070930 2023-06-23T18:45:13.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.205+0000 7f9313b3d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930c149be0 con 0x7f930c06b0e0 2023-06-23T18:45:13.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.205+0000 7f9313b3d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930c0af5f0 con 0x7f930c0afe00 2023-06-23T18:45:13.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.205+0000 7f93110d8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f930c070930 0x7f930c1496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:13.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.205+0000 7f93110d8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f930c070930 0x7f930c1496a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38482/0 (socket says 172.21.15.52:38482) 2023-06-23T18:45:13.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.205+0000 7f93110d8700 1 -- 172.21.15.52:0/2141726813 learned_addr learned my addr 172.21.15.52:0/2141726813 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:13.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.205+0000 7f93118d9700 1 --2- 172.21.15.52:0/2141726813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f930c06b0e0 0x7f930c0af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:13.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.205+0000 7f93120da700 1 --2- 172.21.15.52:0/2141726813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f930c0afe00 0x7f930c1d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:13.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.205+0000 7f93110d8700 1 -- 172.21.15.52:0/2141726813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f930c0afe00 msgr2=0x7f930c1d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:13.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.205+0000 7f93110d8700 1 --2- 172.21.15.52:0/2141726813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f930c0afe00 0x7f930c1d1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.205+0000 7f93110d8700 1 -- 172.21.15.52:0/2141726813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f930c06b0e0 msgr2=0x7f930c0af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:13.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.205+0000 7f93110d8700 1 --2- 172.21.15.52:0/2141726813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f930c06b0e0 0x7f930c0af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.205+0000 7f93110d8700 1 -- 172.21.15.52:0/2141726813 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92fc009550 con 0x7f930c070930 2023-06-23T18:45:13.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.206+0000 7f93110d8700 1 --2- 172.21.15.52:0/2141726813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f930c070930 0x7f930c1496a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f930800c510 tx=0x7f930800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:13.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.206+0000 7f93027fc700 1 -- 172.21.15.52:0/2141726813 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93080052d0 con 0x7f930c070930 2023-06-23T18:45:13.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.206+0000 7f93027fc700 1 -- 172.21.15.52:0/2141726813 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9308005430 con 0x7f930c070930 2023-06-23T18:45:13.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.206+0000 7f9313b3d700 1 -- 172.21.15.52:0/2141726813 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f930c0af7d0 con 0x7f930c070930 2023-06-23T18:45:13.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.206+0000 7f93027fc700 1 -- 172.21.15.52:0/2141726813 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93080038c0 con 0x7f930c070930 2023-06-23T18:45:13.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.206+0000 7f9313b3d700 1 -- 172.21.15.52:0/2141726813 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f930c0ad160 con 0x7f930c070930 2023-06-23T18:45:13.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.207+0000 7f9313b3d700 1 -- 172.21.15.52:0/2141726813 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f930c0ad9e0 con 0x7f930c070930 2023-06-23T18:45:13.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.207+0000 7f93027fc700 1 -- 172.21.15.52:0/2141726813 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9308003a20 con 0x7f930c070930 2023-06-23T18:45:13.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.208+0000 7f93027fc700 1 --2- 172.21.15.52:0/2141726813 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f92f006ace0 0x7f92f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:13.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.208+0000 7f93027fc700 1 -- 172.21.15.52:0/2141726813 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9308088a30 con 0x7f930c070930 2023-06-23T18:45:13.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.208+0000 7f93118d9700 1 --2- 172.21.15.52:0/2141726813 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f92f006ace0 0x7f92f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:13.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.208+0000 7f93118d9700 1 --2- 172.21.15.52:0/2141726813 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f92f006ace0 0x7f92f006d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f92fc009c40 tx=0x7f92fc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:13.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.212+0000 7f93027fc700 1 -- 172.21.15.52:0/2141726813 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9308053a50 con 0x7f930c070930 2023-06-23T18:45:13.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.406+0000 7f9313b3d700 1 -- 172.21.15.52:0/2141726813 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f930c04e1d0 con 0x7f930c070930 2023-06-23T18:45:13.412 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.407+0000 7f93027fc700 1 -- 172.21.15.52:0/2141726813 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9308017020 con 0x7f930c070930 2023-06-23T18:45:13.412 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-06-23T18:45:13.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.409+0000 7f9313b3d700 1 -- 172.21.15.52:0/2141726813 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f92f006ace0 msgr2=0x7f92f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:13.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.409+0000 7f9313b3d700 1 --2- 172.21.15.52:0/2141726813 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f92f006ace0 0x7f92f006d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f92fc009c40 tx=0x7f92fc008030 comp rx=0 tx=0).stop 2023-06-23T18:45:13.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.409+0000 7f9313b3d700 1 -- 172.21.15.52:0/2141726813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f930c070930 msgr2=0x7f930c1496a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:13.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.409+0000 7f9313b3d700 1 --2- 172.21.15.52:0/2141726813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f930c070930 0x7f930c1496a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f930800c510 tx=0x7f930800c8d0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.409+0000 7f9313b3d700 1 -- 172.21.15.52:0/2141726813 shutdown_connections 2023-06-23T18:45:13.414 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.409+0000 7f9313b3d700 1 --2- 172.21.15.52:0/2141726813 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f92f006ace0 0x7f92f006d190 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.409+0000 7f9313b3d700 1 --2- 172.21.15.52:0/2141726813 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f930c0afe00 0x7f930c1d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.409+0000 7f9313b3d700 1 --2- 172.21.15.52:0/2141726813 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f930c06b0e0 0x7f930c0af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.409+0000 7f9313b3d700 1 --2- 172.21.15.52:0/2141726813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f930c070930 0x7f930c1496a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.409+0000 7f9313b3d700 1 -- 172.21.15.52:0/2141726813 >> 172.21.15.52:0/2141726813 conn(0x7f930c0b95c0 msgr2=0x7f930c1d56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:13.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.409+0000 7f9313b3d700 1 -- 172.21.15.52:0/2141726813 shutdown_connections 2023-06-23T18:45:13.415 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.409+0000 7f9313b3d700 1 -- 172.21.15.52:0/2141726813 wait complete. 2023-06-23T18:45:13.426 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:45:13.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.547+0000 7fa09d949700 1 Processor -- start 2023-06-23T18:45:13.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.547+0000 7fa09d949700 1 -- start start 2023-06-23T18:45:13.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.548+0000 7fa09d949700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0981444a0 0x7fa0980b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:13.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.548+0000 7fa09d949700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0980b7aa0 con 0x7fa0980b5a20 2023-06-23T18:45:13.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.548+0000 7fa09d949700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0980b5f30 con 0x7fa09806a0d0 2023-06-23T18:45:13.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.548+0000 7fa09d949700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0980bcfc0 con 0x7fa0981444a0 2023-06-23T18:45:13.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.548+0000 7fa0977fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa0980b5a20 0x7fa098154da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48136/0 (socket says 172.21.15.52:48136) 2023-06-23T18:45:13.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.548+0000 7fa0977fe700 1 -- 172.21.15.52:0/3228014930 learned_addr learned my addr 172.21.15.52:0/3228014930 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:13.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.548+0000 7fa0967fc700 1 --2- 172.21.15.52:0/3228014930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0981444a0 0x7fa0980b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:13.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.548+0000 7fa095ffb700 1 -- 172.21.15.52:0/3228014930 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1212265612 0 0) 0x7fa0980b7aa0 con 0x7fa0980b5a20 2023-06-23T18:45:13.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.548+0000 7fa095ffb700 1 -- 172.21.15.52:0/3228014930 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0800035b0 con 0x7fa0980b5a20 2023-06-23T18:45:13.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.548+0000 7fa095ffb700 1 -- 172.21.15.52:0/3228014930 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3949702195 0 0) 0x7fa0980b5f30 con 0x7fa09806a0d0 2023-06-23T18:45:13.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.548+0000 7fa095ffb700 1 -- 172.21.15.52:0/3228014930 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0980b7aa0 con 0x7fa09806a0d0 2023-06-23T18:45:13.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.548+0000 7fa095ffb700 1 -- 172.21.15.52:0/3228014930 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4248128573 0 0) 0x7fa0800035b0 con 0x7fa0980b5a20 2023-06-23T18:45:13.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.548+0000 7fa0967fc700 1 -- 172.21.15.52:0/3228014930 >> v1:172.21.15.89:6789/0 conn(0x7fa09806a0d0 legacy=0x7fa0980bc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:13.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.548+0000 7fa0967fc700 1 -- 172.21.15.52:0/3228014930 >> v1:172.21.15.52:6789/0 conn(0x7fa0980b5a20 legacy=0x7fa098154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:13.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.548+0000 7fa0967fc700 1 -- 172.21.15.52:0/3228014930 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0980b6210 con 0x7fa0981444a0 2023-06-23T18:45:13.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.548+0000 7fa0967fc700 1 --2- 172.21.15.52:0/3228014930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0981444a0 0x7fa0980b54e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa088009870 tx=0x7fa088009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38f24325ee6498b2 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:13.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.549+0000 7fa095ffb700 1 -- 172.21.15.52:0/3228014930 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0900019f0 con 0x7fa0981444a0 2023-06-23T18:45:13.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.549+0000 7fa095ffb700 1 -- 172.21.15.52:0/3228014930 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa088004030 con 0x7fa0981444a0 2023-06-23T18:45:13.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.549+0000 7fa095ffb700 1 -- 172.21.15.52:0/3228014930 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0880043a0 con 0x7fa0981444a0 2023-06-23T18:45:13.556 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.549+0000 7fa09d949700 1 -- 172.21.15.52:0/3228014930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0981444a0 msgr2=0x7fa0980b54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:13.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.549+0000 7fa09d949700 1 --2- 172.21.15.52:0/3228014930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0981444a0 0x7fa0980b54e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa088009870 tx=0x7fa088009b80 comp rx=0 tx=0).stop 2023-06-23T18:45:13.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.549+0000 7fa09d949700 1 -- 172.21.15.52:0/3228014930 shutdown_connections 2023-06-23T18:45:13.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.549+0000 7fa09d949700 1 --2- 172.21.15.52:0/3228014930 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0981444a0 0x7fa0980b54e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.549+0000 7fa09d949700 1 -- 172.21.15.52:0/3228014930 >> 172.21.15.52:0/3228014930 conn(0x7fa09806bb90 msgr2=0x7fa09806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:13.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.549+0000 7fa09d949700 1 -- 172.21.15.52:0/3228014930 shutdown_connections 2023-06-23T18:45:13.557 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.549+0000 7fa09d949700 1 -- 172.21.15.52:0/3228014930 wait complete. 2023-06-23T18:45:13.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.550+0000 7fa09d949700 1 Processor -- start 2023-06-23T18:45:13.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.551+0000 7fa09d949700 1 -- start start 2023-06-23T18:45:13.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.551+0000 7fa09d949700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa09806a0d0 0x7fa098147790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:13.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.551+0000 7fa09d949700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0980b5a20 0x7fa0981d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:13.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.551+0000 7fa09d949700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0981444a0 0x7fa0981e2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:13.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.551+0000 7fa09d949700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa098147cd0 con 0x7fa09806a0d0 2023-06-23T18:45:13.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.551+0000 7fa09d949700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0981d2ab0 con 0x7fa0981444a0 2023-06-23T18:45:13.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.551+0000 7fa09d949700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0981d4060 con 0x7fa0980b5a20 2023-06-23T18:45:13.560 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.551+0000 7fa096ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa09806a0d0 0x7fa098147790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:13.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.551+0000 7fa096ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa09806a0d0 0x7fa098147790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38484/0 (socket says 172.21.15.52:38484) 2023-06-23T18:45:13.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.551+0000 7fa096ffd700 1 -- 172.21.15.52:0/404124322 learned_addr learned my addr 172.21.15.52:0/404124322 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:13.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.551+0000 7fa0967fc700 1 --2- 172.21.15.52:0/404124322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0980b5a20 0x7fa0981d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:13.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.551+0000 7fa0977fe700 1 --2- 172.21.15.52:0/404124322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0981444a0 0x7fa0981e2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:13.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.552+0000 7fa096ffd700 1 -- 172.21.15.52:0/404124322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0980b5a20 msgr2=0x7fa0981d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:13.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.552+0000 7fa096ffd700 1 --2- 172.21.15.52:0/404124322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0980b5a20 0x7fa0981d3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.552+0000 7fa096ffd700 1 -- 172.21.15.52:0/404124322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0981444a0 msgr2=0x7fa0981e2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:13.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.552+0000 7fa096ffd700 1 --2- 172.21.15.52:0/404124322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0981444a0 0x7fa0981e2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.552+0000 7fa096ffd700 1 -- 172.21.15.52:0/404124322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0880094a0 con 0x7fa09806a0d0 2023-06-23T18:45:13.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.552+0000 7fa096ffd700 1 --2- 172.21.15.52:0/404124322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa09806a0d0 0x7fa098147790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00c520 tx=0x7fa08c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:13.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.552+0000 7fa07ffff700 1 -- 172.21.15.52:0/404124322 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c0052d0 con 0x7fa09806a0d0 2023-06-23T18:45:13.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.552+0000 7fa07ffff700 1 -- 172.21.15.52:0/404124322 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08c005430 con 0x7fa09806a0d0 2023-06-23T18:45:13.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.552+0000 7fa09d949700 1 -- 172.21.15.52:0/404124322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0981d27d0 con 0x7fa09806a0d0 2023-06-23T18:45:13.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.552+0000 7fa07ffff700 1 -- 172.21.15.52:0/404124322 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c0038c0 con 0x7fa09806a0d0 2023-06-23T18:45:13.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.552+0000 7fa09d949700 1 -- 172.21.15.52:0/404124322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa098145240 con 0x7fa09806a0d0 2023-06-23T18:45:13.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.553+0000 7fa09d949700 1 -- 172.21.15.52:0/404124322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa09804e1d0 con 0x7fa09806a0d0 2023-06-23T18:45:13.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.554+0000 7fa07ffff700 1 -- 172.21.15.52:0/404124322 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa08c003a20 con 0x7fa09806a0d0 2023-06-23T18:45:13.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.554+0000 7fa07ffff700 1 --2- 172.21.15.52:0/404124322 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa08406ace0 0x7fa08406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:13.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.554+0000 7fa07ffff700 1 -- 172.21.15.52:0/404124322 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa08c088850 con 0x7fa09806a0d0 2023-06-23T18:45:13.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.554+0000 7fa0967fc700 1 --2- 172.21.15.52:0/404124322 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa08406ace0 0x7fa08406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:13.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.555+0000 7fa0967fc700 1 --2- 172.21.15.52:0/404124322 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa08406ace0 0x7fa08406d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa0880097c0 tx=0x7fa088008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:13.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.558+0000 7fa07ffff700 1 -- 172.21.15.52:0/404124322 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa08c053990 con 0x7fa09806a0d0 2023-06-23T18:45:13.760 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.756+0000 7fa09d949700 1 -- 172.21.15.52:0/404124322 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0980b6870 con 0x7fa09806a0d0 2023-06-23T18:45:13.761 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.757+0000 7fa07ffff700 1 -- 172.21.15.52:0/404124322 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7fa08c056fb0 con 0x7fa09806a0d0 2023-06-23T18:45:13.762 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:13.762 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","created":"2023-06-23T18:44:31.918434+0000","modified":"2023-06-23T18:44:51.644330+0000","last_up_change":"2023-06-23T18:44:42.169624+0000","last_in_change":"2023-06-23T18:44:34.510501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-23T18:44:43.346578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-23T18:44:43.829719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:44:48.517897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:44:49.621134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c371fb28-1b15-4e43-8d5a-43e402920ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6812","nonce":1066999520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6815","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6818","nonce":1066999520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6829","nonce":1066999520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6823","nonce":1066999520}]},"public_addr":"172.21.15.52:6812/1066999520","cluster_addr":"172.21.15.52:6818/1066999520","heartbeat_back_addr":"172.21.15.52:6829/1066999520","heartbeat_front_addr":"172.21.15.52:6823/1066999520","state":["exists","up"]},{"osd":1,"uuid":"4a142f04-33eb-47ec-9cc5-b08b44d82658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6813","nonce":2360219751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6819","nonce":2360219751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6830","nonce":2360219751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6825","nonce":2360219751}]},"public_addr":"172.21.15.52:6813/2360219751","cluster_addr":"172.21.15.52:6819/2360219751","heartbeat_back_addr":"172.21.15.52:6830/2360219751","heartbeat_front_addr":"172.21.15.52:6825/2360219751","state":["exists","up"]},{"osd":2,"uuid":"d7bb089d-4c55-4370-ba59-7fe88c39512a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6801","nonce":835073005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6803","nonce":835073005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6807","nonce":835073005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6805","nonce":835073005}]},"public_addr":"172.21.15.52:6801/835073005","cluster_addr":"172.21.15.52:6803/835073005","heartbeat_back_addr":"172.21.15.52:6807/835073005","heartbeat_front_addr":"172.21.15.52:6805/835073005","state":["exists","up"]},{"osd":3,"uuid":"4bcdcdc3-6a8f-468e-877e-57f76079ac3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6811","nonce":2852700864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6817","nonce":2852700864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6831","nonce":2852700864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6824","nonce":2852700864}]},"public_addr":"172.21.15.52:6811/2852700864","cluster_addr":"172.21.15.52:6817/2852700864","heartbeat_back_addr":"172.21.15.52:6831/2852700864","heartbeat_front_addr":"172.21.15.52:6824/2852700864","state":["exists","up"]},{"osd":4,"uuid":"cac63000-ae94-4b08-93e6-a99119640b63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6809","nonce":2538664679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6811","nonce":2538664679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6815","nonce":2538664679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6813","nonce":2538664679}]},"public_addr":"172.21.15.89:6809/2538664679","cluster_addr":"172.21.15.89:6811/2538664679","heartbeat_back_addr":"172.21.15.89:6815/2538664679","heartbeat_front_addr":"172.21.15.89:6813/2538664679","state":["exists","up"]},{"osd":5,"uuid":"45c53102-18a6-4fd7-9c25-8ea5e1ef6851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6801","nonce":1683710352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6803","nonce":1683710352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6807","nonce":1683710352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6805","nonce":1683710352}]},"public_addr":"172.21.15.89:6801/1683710352","cluster_addr":"172.21.15.89:6803/1683710352","heartbeat_back_addr":"172.21.15.89:6807/1683710352","heartbeat_front_addr":"172.21.15.89:6805/1683710352","state":["exists","up"]},{"osd":6,"uuid":"abee09d1-8eba-484f-a25c-871c1fe2e843","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6817","nonce":3890899288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6819","nonce":3890899288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6823","nonce":3890899288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6821","nonce":3890899288}]},"public_addr":"172.21.15.89:6817/3890899288","cluster_addr":"172.21.15.89:6819/3890899288","heartbeat_back_addr":"172.21.15.89:6823/3890899288","heartbeat_front_addr":"172.21.15.89:6821/3890899288","state":["exists","up"]},{"osd":7,"uuid":"5acf9e2e-00dd-4f9b-a7d9-3d820f695de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6825","nonce":2989085420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6827","nonce":2989085420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6831","nonce":2989085420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6829","nonce":2989085420}]},"public_addr":"172.21.15.89:6825/2989085420","cluster_addr":"172.21.15.89:6827/2989085420","heartbeat_back_addr":"172.21.15.89:6831/2989085420","heartbeat_front_addr":"172.21.15.89:6829/2989085420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.663866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.710904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.619347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.660102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.686933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.724635+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.669111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.678740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:45:13.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.759+0000 7fa09d949700 1 -- 172.21.15.52:0/404124322 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa08406ace0 msgr2=0x7fa08406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:13.764 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.759+0000 7fa09d949700 1 --2- 172.21.15.52:0/404124322 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa08406ace0 0x7fa08406d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa0880097c0 tx=0x7fa088008030 comp rx=0 tx=0).stop 2023-06-23T18:45:13.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.759+0000 7fa09d949700 1 -- 172.21.15.52:0/404124322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa09806a0d0 msgr2=0x7fa098147790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:13.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.759+0000 7fa09d949700 1 --2- 172.21.15.52:0/404124322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa09806a0d0 0x7fa098147790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00c520 tx=0x7fa08c00c830 comp rx=0 tx=0).stop 2023-06-23T18:45:13.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.759+0000 7fa09d949700 1 -- 172.21.15.52:0/404124322 shutdown_connections 2023-06-23T18:45:13.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.759+0000 7fa09d949700 1 --2- 172.21.15.52:0/404124322 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa08406ace0 0x7fa08406d190 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.759+0000 7fa09d949700 1 --2- 172.21.15.52:0/404124322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0981444a0 0x7fa0981e2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.759+0000 7fa09d949700 1 --2- 172.21.15.52:0/404124322 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa09806a0d0 0x7fa098147790 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.765 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.759+0000 7fa09d949700 1 --2- 172.21.15.52:0/404124322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0980b5a20 0x7fa0981d3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.759+0000 7fa09d949700 1 -- 172.21.15.52:0/404124322 >> 172.21.15.52:0/404124322 conn(0x7fa09806bb90 msgr2=0x7fa0980bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:13.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.759+0000 7fa09d949700 1 -- 172.21.15.52:0/404124322 shutdown_connections 2023-06-23T18:45:13.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.759+0000 7fa09d949700 1 -- 172.21.15.52:0/404124322 wait complete. 2023-06-23T18:45:13.776 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-23T18:44:43.346578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-23T18:44:43.829719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T18:44:48.517897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T18:44:49.621134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-23T18:45:13.777 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T18:45:13.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.903+0000 7f01aeee8700 1 Processor -- start 2023-06-23T18:45:13.908 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.903+0000 7f01aeee8700 1 -- start start 2023-06-23T18:45:13.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.904+0000 7f01aeee8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f01a80b6870 0x7f01a8144480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:13.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.904+0000 7f01aeee8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f01a814a600 0x7f01a81449c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:13.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.904+0000 7f01aeee8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a80b59b0 0x7f01a80bb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:13.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.904+0000 7f01aeee8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a80be040 con 0x7f01a814a600 2023-06-23T18:45:13.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.904+0000 7f01aeee8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a814aae0 con 0x7f01a80b6870 2023-06-23T18:45:13.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.904+0000 7f01aeee8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a814adc0 con 0x7f01a80b59b0 2023-06-23T18:45:13.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.904+0000 7f01a7fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f01a814a600 0x7f01a81449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:13.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.904+0000 7f01a7fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f01a814a600 0x7f01a81449c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38500/0 (socket says 172.21.15.52:38500) 2023-06-23T18:45:13.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.904+0000 7f01a7fff700 1 -- 172.21.15.52:0/384471044 learned_addr learned my addr 172.21.15.52:0/384471044 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:13.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.904+0000 7f01ad485700 1 --2- 172.21.15.52:0/384471044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a80b59b0 0x7f01a80bb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:13.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.904+0000 7f01acc84700 1 --2- 172.21.15.52:0/384471044 >> v2:172.21.15.89:3300/0 conn(0x7f01a80b6870 0x7f01a8144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:13.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.904+0000 7f01a7fff700 1 -- 172.21.15.52:0/384471044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a80b59b0 msgr2=0x7f01a80bb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:13.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.904+0000 7f01a7fff700 1 --2- 172.21.15.52:0/384471044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a80b59b0 0x7f01a80bb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.904+0000 7f01a7fff700 1 -- 172.21.15.52:0/384471044 >> v2:172.21.15.89:3300/0 conn(0x7f01a80b6870 msgr2=0x7f01a8144480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:13.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.904+0000 7f01a7fff700 1 --2- 172.21.15.52:0/384471044 >> v2:172.21.15.89:3300/0 conn(0x7f01a80b6870 0x7f01a8144480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.904+0000 7f01a7fff700 1 -- 172.21.15.52:0/384471044 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a814b0a0 con 0x7f01a814a600 2023-06-23T18:45:13.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.904+0000 7f01ad485700 1 --2- 172.21.15.52:0/384471044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a80b59b0 0x7f01a80bb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:13.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.904+0000 7f01a7fff700 1 --2- 172.21.15.52:0/384471044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a814a600 0x7f01a81449c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f01a808a4f0 tx=0x7f0194009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f6fcfadedcfa71 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:13.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.905+0000 7f01a77fe700 1 -- 172.21.15.52:0/384471044 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0194011830 con 0x7f01a814a600 2023-06-23T18:45:13.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.905+0000 7f01a77fe700 1 -- 172.21.15.52:0/384471044 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0194011990 con 0x7f01a814a600 2023-06-23T18:45:13.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.905+0000 7f01a77fe700 1 -- 172.21.15.52:0/384471044 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0194011d20 con 0x7f01a814a600 2023-06-23T18:45:13.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.905+0000 7f01aeee8700 1 -- 172.21.15.52:0/384471044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a814a600 msgr2=0x7f01a81449c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:13.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.905+0000 7f01aeee8700 1 --2- 172.21.15.52:0/384471044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a814a600 0x7f01a81449c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f01a808a4f0 tx=0x7f0194009bd0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.905+0000 7f01aeee8700 1 -- 172.21.15.52:0/384471044 shutdown_connections 2023-06-23T18:45:13.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.905+0000 7f01aeee8700 1 --2- 172.21.15.52:0/384471044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a80b59b0 0x7f01a80bb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.905+0000 7f01aeee8700 1 --2- 172.21.15.52:0/384471044 >> v2:172.21.15.89:3300/0 conn(0x7f01a80b6870 0x7f01a8144480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.905+0000 7f01aeee8700 1 --2- 172.21.15.52:0/384471044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a814a600 0x7f01a81449c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.905+0000 7f01aeee8700 1 -- 172.21.15.52:0/384471044 >> 172.21.15.52:0/384471044 conn(0x7f01a80bd140 msgr2=0x7f01a80bd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:13.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.905+0000 7f01aeee8700 1 -- 172.21.15.52:0/384471044 shutdown_connections 2023-06-23T18:45:13.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.905+0000 7f01aeee8700 1 -- 172.21.15.52:0/384471044 wait complete. 2023-06-23T18:45:13.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.906+0000 7f01aeee8700 1 Processor -- start 2023-06-23T18:45:13.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.906+0000 7f01aeee8700 1 -- start start 2023-06-23T18:45:13.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.907+0000 7f01aeee8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01a80b59b0 0x7f01a80bfe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:13.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.907+0000 7f01aeee8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a80b6870 0x7f01a8148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:13.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.907+0000 7f01aeee8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a814a600 0x7f01a8149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:13.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.907+0000 7f01aeee8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a80c0370 con 0x7f01a814a600 2023-06-23T18:45:13.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.907+0000 7f01aeee8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a814a450 con 0x7f01a80b59b0 2023-06-23T18:45:13.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.907+0000 7f01aeee8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a8148400 con 0x7f01a80b6870 2023-06-23T18:45:13.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.907+0000 7f01ad485700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a814a600 0x7f01a8149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:13.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.907+0000 7f01ad485700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a814a600 0x7f01a8149130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38502/0 (socket says 172.21.15.52:38502) 2023-06-23T18:45:13.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.907+0000 7f01ad485700 1 -- 172.21.15.52:0/1675572261 learned_addr learned my addr 172.21.15.52:0/1675572261 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:13.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.907+0000 7f01acc84700 1 --2- 172.21.15.52:0/1675572261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01a80b59b0 0x7f01a80bfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:13.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.907+0000 7f01a7fff700 1 --2- 172.21.15.52:0/1675572261 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a80b6870 0x7f01a8148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:13.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.908+0000 7f01ad485700 1 -- 172.21.15.52:0/1675572261 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a80b6870 msgr2=0x7f01a8148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:13.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.908+0000 7f01ad485700 1 --2- 172.21.15.52:0/1675572261 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a80b6870 0x7f01a8148bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.908+0000 7f01ad485700 1 -- 172.21.15.52:0/1675572261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01a80b59b0 msgr2=0x7f01a80bfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:13.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.908+0000 7f01ad485700 1 --2- 172.21.15.52:0/1675572261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01a80b59b0 0x7f01a80bfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:13.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.908+0000 7f01ad485700 1 -- 172.21.15.52:0/1675572261 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0194009550 con 0x7f01a814a600 2023-06-23T18:45:13.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.908+0000 7f01a7fff700 1 --2- 172.21.15.52:0/1675572261 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a80b6870 0x7f01a8148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:13.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.908+0000 7f01ad485700 1 --2- 172.21.15.52:0/1675572261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a814a600 0x7f01a8149130 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f01a0007e10 tx=0x7f01a000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:13.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.908+0000 7f01a57fa700 1 -- 172.21.15.52:0/1675572261 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a000ddd0 con 0x7f01a814a600 2023-06-23T18:45:13.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.908+0000 7f01a57fa700 1 -- 172.21.15.52:0/1675572261 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a000f040 con 0x7f01a814a600 2023-06-23T18:45:13.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.908+0000 7f01aeee8700 1 -- 172.21.15.52:0/1675572261 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a8149bb0 con 0x7f01a814a600 2023-06-23T18:45:13.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.908+0000 7f01a57fa700 1 -- 172.21.15.52:0/1675572261 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0003c60 con 0x7f01a814a600 2023-06-23T18:45:13.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.908+0000 7f01aeee8700 1 -- 172.21.15.52:0/1675572261 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a814a170 con 0x7f01a814a600 2023-06-23T18:45:13.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.909+0000 7f01aeee8700 1 -- 172.21.15.52:0/1675572261 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a804e1d0 con 0x7f01a814a600 2023-06-23T18:45:13.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.909+0000 7f01a57fa700 1 -- 172.21.15.52:0/1675572261 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f01a0004030 con 0x7f01a814a600 2023-06-23T18:45:13.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.910+0000 7f01a57fa700 1 --2- 172.21.15.52:0/1675572261 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f018c06ace0 0x7f018c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:13.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.910+0000 7f01a57fa700 1 -- 172.21.15.52:0/1675572261 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f01a00894c0 con 0x7f01a814a600 2023-06-23T18:45:13.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.910+0000 7f01acc84700 1 --2- 172.21.15.52:0/1675572261 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f018c06ace0 0x7f018c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:13.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.911+0000 7f01acc84700 1 --2- 172.21.15.52:0/1675572261 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f018c06ace0 0x7f018c06d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f019c009be0 tx=0x7f019c009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:13.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:13.914+0000 7f01a57fa700 1 -- 172.21.15.52:0/1675572261 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f01a0054600 con 0x7f01a814a600 2023-06-23T18:45:14.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.108+0000 7f01aeee8700 1 -- 172.21.15.52:0/1675572261 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f01a80b80e0 con 0x7f01a814a600 2023-06-23T18:45:14.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.108+0000 7f01a57fa700 1 -- 172.21.15.52:0/1675572261 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f01a0057c20 con 0x7f01a814a600 2023-06-23T18:45:14.114 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-06-23T18:45:14.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.110+0000 7f01aeee8700 1 -- 172.21.15.52:0/1675572261 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f018c06ace0 msgr2=0x7f018c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:14.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.110+0000 7f01aeee8700 1 --2- 172.21.15.52:0/1675572261 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f018c06ace0 0x7f018c06d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f019c009be0 tx=0x7f019c009210 comp rx=0 tx=0).stop 2023-06-23T18:45:14.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.110+0000 7f01aeee8700 1 -- 172.21.15.52:0/1675572261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a814a600 msgr2=0x7f01a8149130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:14.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.110+0000 7f01aeee8700 1 --2- 172.21.15.52:0/1675572261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a814a600 0x7f01a8149130 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f01a0007e10 tx=0x7f01a000d3b0 comp rx=0 tx=0).stop 2023-06-23T18:45:14.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.110+0000 7f01aeee8700 1 -- 172.21.15.52:0/1675572261 shutdown_connections 2023-06-23T18:45:14.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.110+0000 7f01aeee8700 1 --2- 172.21.15.52:0/1675572261 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f018c06ace0 0x7f018c06d190 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:14.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.110+0000 7f01aeee8700 1 --2- 172.21.15.52:0/1675572261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f01a814a600 0x7f01a8149130 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:14.117 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.111+0000 7f01aeee8700 1 --2- 172.21.15.52:0/1675572261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01a80b59b0 0x7f01a80bfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:14.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.111+0000 7f01aeee8700 1 --2- 172.21.15.52:0/1675572261 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01a80b6870 0x7f01a8148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:14.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.111+0000 7f01aeee8700 1 -- 172.21.15.52:0/1675572261 >> 172.21.15.52:0/1675572261 conn(0x7f01a80bd140 msgr2=0x7f01a813ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:14.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.111+0000 7f01aeee8700 1 -- 172.21.15.52:0/1675572261 shutdown_connections 2023-06-23T18:45:14.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.111+0000 7f01aeee8700 1 -- 172.21.15.52:0/1675572261 wait complete. 2023-06-23T18:45:14.127 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T18:45:14.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.252+0000 7f8d75eda700 1 Processor -- start 2023-06-23T18:45:14.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.252+0000 7f8d75eda700 1 -- start start 2023-06-23T18:45:14.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.253+0000 7f8d75eda700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8d7006b0e0 0x7f8d700702e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:14.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.253+0000 7f8d75eda700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d700b93d0 con 0x7f8d700b8820 2023-06-23T18:45:14.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.253+0000 7f8d75eda700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d70071c70 con 0x7f8d7014ed90 2023-06-23T18:45:14.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.253+0000 7f8d75eda700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d70070820 con 0x7f8d7006b0e0 2023-06-23T18:45:14.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.253+0000 7f8d6f7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8d7006b0e0 0x7f8d700702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:14.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.253+0000 7f8d6ffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8d700b8820 0x7f8d700b8cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:48144/0 (socket says 172.21.15.52:48144) 2023-06-23T18:45:14.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.253+0000 7f8d6ffff700 1 -- 172.21.15.52:0/734713213 learned_addr learned my addr 172.21.15.52:0/734713213 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:14.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.254+0000 7f8d6f7fe700 1 -- 172.21.15.52:0/734713213 >> v1:172.21.15.89:6789/0 conn(0x7f8d7014ed90 legacy=0x7f8d7014f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:14.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.254+0000 7f8d6f7fe700 1 -- 172.21.15.52:0/734713213 >> v1:172.21.15.52:6789/0 conn(0x7f8d700b8820 legacy=0x7f8d700b8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:14.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.254+0000 7f8d6f7fe700 1 -- 172.21.15.52:0/734713213 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d70070a30 con 0x7f8d7006b0e0 2023-06-23T18:45:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.254+0000 7f8d6f7fe700 1 --2- 172.21.15.52:0/734713213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d7006b0e0 0x7f8d700702e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009840 tx=0x7f8d60009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a35484657645b02 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.254+0000 7f8d6e7fc700 1 -- 172.21.15.52:0/734713213 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d60004230 con 0x7f8d7006b0e0 2023-06-23T18:45:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.254+0000 7f8d6e7fc700 1 -- 172.21.15.52:0/734713213 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d60004390 con 0x7f8d7006b0e0 2023-06-23T18:45:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.254+0000 7f8d6e7fc700 1 -- 172.21.15.52:0/734713213 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d600036a0 con 0x7f8d7006b0e0 2023-06-23T18:45:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.255+0000 7f8d75eda700 1 -- 172.21.15.52:0/734713213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d7006b0e0 msgr2=0x7f8d700702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.255+0000 7f8d75eda700 1 --2- 172.21.15.52:0/734713213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d7006b0e0 0x7f8d700702e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009840 tx=0x7f8d60009b50 comp rx=0 tx=0).stop 2023-06-23T18:45:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.255+0000 7f8d75eda700 1 -- 172.21.15.52:0/734713213 shutdown_connections 2023-06-23T18:45:14.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.255+0000 7f8d75eda700 1 --2- 172.21.15.52:0/734713213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d7006b0e0 0x7f8d700702e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:14.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.255+0000 7f8d75eda700 1 -- 172.21.15.52:0/734713213 >> 172.21.15.52:0/734713213 conn(0x7f8d700b95c0 msgr2=0x7f8d700b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:14.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.255+0000 7f8d75eda700 1 -- 172.21.15.52:0/734713213 shutdown_connections 2023-06-23T18:45:14.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.255+0000 7f8d75eda700 1 -- 172.21.15.52:0/734713213 wait complete. 2023-06-23T18:45:14.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.256+0000 7f8d75eda700 1 Processor -- start 2023-06-23T18:45:14.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.256+0000 7f8d75eda700 1 -- start start 2023-06-23T18:45:14.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.257+0000 7f8d75eda700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d7006b0e0 0x7f8d70146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:14.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.257+0000 7f8d75eda700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d700b8820 0x7f8d7014a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:14.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.257+0000 7f8d75eda700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d7014ed90 0x7f8d7014bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:14.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.257+0000 7f8d75eda700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d70147100 con 0x7f8d7014ed90 2023-06-23T18:45:14.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.257+0000 7f8d75eda700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d701498d0 con 0x7f8d700b8820 2023-06-23T18:45:14.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.257+0000 7f8d75eda700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d70149bb0 con 0x7f8d7006b0e0 2023-06-23T18:45:14.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.257+0000 7f8d6ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d7014ed90 0x7f8d7014bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:14.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.257+0000 7f8d6ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d7014ed90 0x7f8d7014bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38516/0 (socket says 172.21.15.52:38516) 2023-06-23T18:45:14.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.257+0000 7f8d6ffff700 1 -- 172.21.15.52:0/3213024538 learned_addr learned my addr 172.21.15.52:0/3213024538 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:14.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.258+0000 7f8d6effd700 1 --2- 172.21.15.52:0/3213024538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d700b8820 0x7f8d7014a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:14.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.258+0000 7f8d6f7fe700 1 --2- 172.21.15.52:0/3213024538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d7006b0e0 0x7f8d70146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:14.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.258+0000 7f8d6ffff700 1 -- 172.21.15.52:0/3213024538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d7006b0e0 msgr2=0x7f8d70146bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:14.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.258+0000 7f8d6ffff700 1 --2- 172.21.15.52:0/3213024538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d7006b0e0 0x7f8d70146bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:14.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.258+0000 7f8d6ffff700 1 -- 172.21.15.52:0/3213024538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d700b8820 msgr2=0x7f8d7014a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:14.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.258+0000 7f8d6ffff700 1 --2- 172.21.15.52:0/3213024538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d700b8820 0x7f8d7014a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:14.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.258+0000 7f8d6ffff700 1 -- 172.21.15.52:0/3213024538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d600094a0 con 0x7f8d7014ed90 2023-06-23T18:45:14.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.258+0000 7f8d6ffff700 1 --2- 172.21.15.52:0/3213024538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d7014ed90 0x7f8d7014bb40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800cbc0 tx=0x7f8d6800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:14.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.258+0000 7f8d57fff700 1 -- 172.21.15.52:0/3213024538 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6800ab50 con 0x7f8d7014ed90 2023-06-23T18:45:14.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.258+0000 7f8d57fff700 1 -- 172.21.15.52:0/3213024538 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6800acb0 con 0x7f8d7014ed90 2023-06-23T18:45:14.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.258+0000 7f8d75eda700 1 -- 172.21.15.52:0/3213024538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d70149e90 con 0x7f8d7014ed90 2023-06-23T18:45:14.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.258+0000 7f8d57fff700 1 -- 172.21.15.52:0/3213024538 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d68012600 con 0x7f8d7014ed90 2023-06-23T18:45:14.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.258+0000 7f8d75eda700 1 -- 172.21.15.52:0/3213024538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d701dbce0 con 0x7f8d7014ed90 2023-06-23T18:45:14.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.259+0000 7f8d75eda700 1 -- 172.21.15.52:0/3213024538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d7014b7b0 con 0x7f8d7014ed90 2023-06-23T18:45:14.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.259+0000 7f8d57fff700 1 -- 172.21.15.52:0/3213024538 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8d6801b3b0 con 0x7f8d7014ed90 2023-06-23T18:45:14.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.260+0000 7f8d57fff700 1 --2- 172.21.15.52:0/3213024538 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f8d5c06ad10 0x7f8d5c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:14.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.260+0000 7f8d57fff700 1 -- 172.21.15.52:0/3213024538 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8d68088ef0 con 0x7f8d7014ed90 2023-06-23T18:45:14.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.260+0000 7f8d6f7fe700 1 --2- 172.21.15.52:0/3213024538 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f8d5c06ad10 0x7f8d5c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:14.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.261+0000 7f8d6f7fe700 1 --2- 172.21.15.52:0/3213024538 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f8d5c06ad10 0x7f8d5c06d1c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8d600090b0 tx=0x7f8d60008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:14.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.264+0000 7f8d57fff700 1 -- 172.21.15.52:0/3213024538 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8d68054050 con 0x7f8d7014ed90 2023-06-23T18:45:14.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.458+0000 7f8d75eda700 1 -- 172.21.15.52:0/3213024538 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8d700b93d0 con 0x7f8d7014ed90 2023-06-23T18:45:14.463 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.458+0000 7f8d57fff700 1 -- 172.21.15.52:0/3213024538 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8d68017020 con 0x7f8d7014ed90 2023-06-23T18:45:14.464 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-06-23T18:45:14.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.460+0000 7f8d75eda700 1 -- 172.21.15.52:0/3213024538 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f8d5c06ad10 msgr2=0x7f8d5c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:14.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.461+0000 7f8d75eda700 1 --2- 172.21.15.52:0/3213024538 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f8d5c06ad10 0x7f8d5c06d1c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8d600090b0 tx=0x7f8d60008030 comp rx=0 tx=0).stop 2023-06-23T18:45:14.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.461+0000 7f8d75eda700 1 -- 172.21.15.52:0/3213024538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d7014ed90 msgr2=0x7f8d7014bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:14.466 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.461+0000 7f8d75eda700 1 --2- 172.21.15.52:0/3213024538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d7014ed90 0x7f8d7014bb40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8d6800cbc0 tx=0x7f8d6800cf80 comp rx=0 tx=0).stop 2023-06-23T18:45:14.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.461+0000 7f8d75eda700 1 -- 172.21.15.52:0/3213024538 shutdown_connections 2023-06-23T18:45:14.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.461+0000 7f8d75eda700 1 --2- 172.21.15.52:0/3213024538 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f8d5c06ad10 0x7f8d5c06d1c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:14.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.461+0000 7f8d75eda700 1 --2- 172.21.15.52:0/3213024538 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d7014ed90 0x7f8d7014bb40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:14.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.461+0000 7f8d75eda700 1 --2- 172.21.15.52:0/3213024538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d7006b0e0 0x7f8d70146bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:14.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.461+0000 7f8d75eda700 1 --2- 172.21.15.52:0/3213024538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d700b8820 0x7f8d7014a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:14.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.461+0000 7f8d75eda700 1 -- 172.21.15.52:0/3213024538 >> 172.21.15.52:0/3213024538 conn(0x7f8d700b95c0 msgr2=0x7f8d700bb880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:14.467 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.461+0000 7f8d75eda700 1 -- 172.21.15.52:0/3213024538 shutdown_connections 2023-06-23T18:45:14.468 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.461+0000 7f8d75eda700 1 -- 172.21.15.52:0/3213024538 wait complete. 2023-06-23T18:45:14.477 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T18:45:14.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.601+0000 7f3e8c42f700 1 Processor -- start 2023-06-23T18:45:14.606 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.601+0000 7f3e8c42f700 1 -- start start 2023-06-23T18:45:14.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.602+0000 7f3e8c42f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3e840b8c80 0x7f3e84071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:14.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.602+0000 7f3e8c42f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3e841479f0 0x7f3e84151a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:14.608 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.602+0000 7f3e8c42f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e840b8360 con 0x7f3e84141220 2023-06-23T18:45:14.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.602+0000 7f3e8c42f700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e840b4bb0 con 0x7f3e841479f0 2023-06-23T18:45:14.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.602+0000 7f3e8c42f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e840b7da0 con 0x7f3e840b8c80 2023-06-23T18:45:14.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.602+0000 7f3e8a9cc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3e841479f0 0x7f3e84151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:14.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.602+0000 7f3e8a9cc700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3e841479f0 0x7f3e84151a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38530/0 (socket says 172.21.15.52:38530) 2023-06-23T18:45:14.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.602+0000 7f3e8a9cc700 1 -- 172.21.15.52:0/352736337 learned_addr learned my addr 172.21.15.52:0/352736337 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:14.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.602+0000 7f3e8a1cb700 1 --2- 172.21.15.52:0/352736337 >> v2:172.21.15.89:3300/0 conn(0x7f3e840b8c80 0x7f3e84071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:14.609 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.602+0000 7f3e8a9cc700 1 -- 172.21.15.52:0/352736337 >> v2:172.21.15.89:3300/0 conn(0x7f3e840b8c80 msgr2=0x7f3e84071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:14.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.602+0000 7f3e8a9cc700 1 --2- 172.21.15.52:0/352736337 >> v2:172.21.15.89:3300/0 conn(0x7f3e840b8c80 0x7f3e84071240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:14.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.602+0000 7f3e8a9cc700 1 -- 172.21.15.52:0/352736337 >> v1:172.21.15.89:6789/0 conn(0x7f3e84141220 legacy=0x7f3e841472e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:14.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.602+0000 7f3e8a9cc700 1 -- 172.21.15.52:0/352736337 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e840b8080 con 0x7f3e841479f0 2023-06-23T18:45:14.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.603+0000 7f3e8a9cc700 1 --2- 172.21.15.52:0/352736337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e841479f0 0x7f3e84151a80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3e840b9470 tx=0x7f3e7c00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f38a5f18385a78 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:14.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.603+0000 7f3e891c9700 1 -- 172.21.15.52:0/352736337 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c010070 con 0x7f3e841479f0 2023-06-23T18:45:14.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.603+0000 7f3e891c9700 1 -- 172.21.15.52:0/352736337 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c00dd90 con 0x7f3e841479f0 2023-06-23T18:45:14.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.603+0000 7f3e891c9700 1 -- 172.21.15.52:0/352736337 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c00b310 con 0x7f3e841479f0 2023-06-23T18:45:14.610 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.603+0000 7f3e8c42f700 1 -- 172.21.15.52:0/352736337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e841479f0 msgr2=0x7f3e84151a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:14.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.603+0000 7f3e8c42f700 1 --2- 172.21.15.52:0/352736337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e841479f0 0x7f3e84151a80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3e840b9470 tx=0x7f3e7c00d430 comp rx=0 tx=0).stop 2023-06-23T18:45:14.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.603+0000 7f3e8c42f700 1 -- 172.21.15.52:0/352736337 shutdown_connections 2023-06-23T18:45:14.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.603+0000 7f3e8c42f700 1 --2- 172.21.15.52:0/352736337 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e841479f0 0x7f3e84151a80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:14.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.603+0000 7f3e8c42f700 1 --2- 172.21.15.52:0/352736337 >> v2:172.21.15.89:3300/0 conn(0x7f3e840b8c80 0x7f3e84071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:14.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.603+0000 7f3e8c42f700 1 -- 172.21.15.52:0/352736337 >> 172.21.15.52:0/352736337 conn(0x7f3e840bd420 msgr2=0x7f3e840bd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:14.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.604+0000 7f3e8c42f700 1 -- 172.21.15.52:0/352736337 shutdown_connections 2023-06-23T18:45:14.611 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.604+0000 7f3e8c42f700 1 -- 172.21.15.52:0/352736337 wait complete. 2023-06-23T18:45:14.613 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.605+0000 7f3e8c42f700 1 Processor -- start 2023-06-23T18:45:14.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.605+0000 7f3e8c42f700 1 -- start start 2023-06-23T18:45:14.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.605+0000 7f3e8c42f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e840b8c80 0x7f3e841d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:14.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.605+0000 7f3e8c42f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e84141220 0x7f3e8413d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:14.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.605+0000 7f3e8c42f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e841479f0 0x7f3e841df6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:14.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.605+0000 7f3e8c42f700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e841d1e20 con 0x7f3e840b8c80 2023-06-23T18:45:14.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.605+0000 7f3e8c42f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e841df360 con 0x7f3e84141220 2023-06-23T18:45:14.614 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.605+0000 7f3e8c42f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8413e490 con 0x7f3e841479f0 2023-06-23T18:45:14.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.605+0000 7f3e8a1cb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e840b8c80 0x7f3e841d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:14.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.605+0000 7f3e8a1cb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e840b8c80 0x7f3e841d18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38534/0 (socket says 172.21.15.52:38534) 2023-06-23T18:45:14.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.605+0000 7f3e8a1cb700 1 -- 172.21.15.52:0/27332310 learned_addr learned my addr 172.21.15.52:0/27332310 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:14.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.605+0000 7f3e899ca700 1 --2- 172.21.15.52:0/27332310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e84141220 0x7f3e8413d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:14.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.605+0000 7f3e8a9cc700 1 --2- 172.21.15.52:0/27332310 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e841479f0 0x7f3e841df6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:14.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.606+0000 7f3e8a1cb700 1 -- 172.21.15.52:0/27332310 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e841479f0 msgr2=0x7f3e841df6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:14.615 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.606+0000 7f3e8a1cb700 1 --2- 172.21.15.52:0/27332310 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e841479f0 0x7f3e841df6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:14.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.606+0000 7f3e8a1cb700 1 -- 172.21.15.52:0/27332310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e84141220 msgr2=0x7f3e8413d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:14.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.606+0000 7f3e8a1cb700 1 --2- 172.21.15.52:0/27332310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e84141220 0x7f3e8413d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:14.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.606+0000 7f3e8a1cb700 1 -- 172.21.15.52:0/27332310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7c00bd40 con 0x7f3e840b8c80 2023-06-23T18:45:14.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.606+0000 7f3e8a1cb700 1 --2- 172.21.15.52:0/27332310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e840b8c80 0x7f3e841d18e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3e7400e810 tx=0x7f3e7400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:14.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.606+0000 7f3e7affd700 1 -- 172.21.15.52:0/27332310 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7400c070 con 0x7f3e840b8c80 2023-06-23T18:45:14.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.606+0000 7f3e7affd700 1 -- 172.21.15.52:0/27332310 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e74013610 con 0x7f3e840b8c80 2023-06-23T18:45:14.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.606+0000 7f3e8c42f700 1 -- 172.21.15.52:0/27332310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e8413b710 con 0x7f3e840b8c80 2023-06-23T18:45:14.616 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.606+0000 7f3e7affd700 1 -- 172.21.15.52:0/27332310 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e740139c0 con 0x7f3e840b8c80 2023-06-23T18:45:14.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.606+0000 7f3e8c42f700 1 -- 172.21.15.52:0/27332310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e840bcf20 con 0x7f3e840b8c80 2023-06-23T18:45:14.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.607+0000 7f3e8c42f700 1 -- 172.21.15.52:0/27332310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e8404e1d0 con 0x7f3e840b8c80 2023-06-23T18:45:14.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.607+0000 7f3e7affd700 1 -- 172.21.15.52:0/27332310 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3e74013b20 con 0x7f3e840b8c80 2023-06-23T18:45:14.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.608+0000 7f3e7affd700 1 --2- 172.21.15.52:0/27332310 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3e6806ace0 0x7f3e6806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:14.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.608+0000 7f3e7affd700 1 -- 172.21.15.52:0/27332310 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3e740891b0 con 0x7f3e840b8c80 2023-06-23T18:45:14.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.608+0000 7f3e899ca700 1 --2- 172.21.15.52:0/27332310 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3e6806ace0 0x7f3e6806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:14.617 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.608+0000 7f3e899ca700 1 --2- 172.21.15.52:0/27332310 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3e6806ace0 0x7f3e6806d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3e8413eea0 tx=0x7f3e80009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:14.618 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.612+0000 7f3e7affd700 1 -- 172.21.15.52:0/27332310 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3e74057d00 con 0x7f3e840b8c80 2023-06-23T18:45:14.815 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.811+0000 7f3e8c42f700 1 -- 172.21.15.52:0/27332310 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3e84142870 con 0x7f3e840b8c80 2023-06-23T18:45:14.816 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.811+0000 7f3e7affd700 1 -- 172.21.15.52:0/27332310 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3e74057890 con 0x7f3e840b8c80 2023-06-23T18:45:14.816 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2023-06-23T18:45:14.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.813+0000 7f3e8c42f700 1 -- 172.21.15.52:0/27332310 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3e6806ace0 msgr2=0x7f3e6806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:14.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.813+0000 7f3e8c42f700 1 --2- 172.21.15.52:0/27332310 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3e6806ace0 0x7f3e6806d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3e8413eea0 tx=0x7f3e80009040 comp rx=0 tx=0).stop 2023-06-23T18:45:14.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.813+0000 7f3e8c42f700 1 -- 172.21.15.52:0/27332310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e840b8c80 msgr2=0x7f3e841d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:14.819 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.813+0000 7f3e8c42f700 1 --2- 172.21.15.52:0/27332310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e840b8c80 0x7f3e841d18e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3e7400e810 tx=0x7f3e7400eb20 comp rx=0 tx=0).stop 2023-06-23T18:45:14.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.813+0000 7f3e8c42f700 1 -- 172.21.15.52:0/27332310 shutdown_connections 2023-06-23T18:45:14.820 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.813+0000 7f3e8c42f700 1 --2- 172.21.15.52:0/27332310 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3e6806ace0 0x7f3e6806d190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:14.821 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.813+0000 7f3e8c42f700 1 --2- 172.21.15.52:0/27332310 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3e841479f0 0x7f3e841df6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:14.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.813+0000 7f3e8c42f700 1 --2- 172.21.15.52:0/27332310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e840b8c80 0x7f3e841d18e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:14.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.813+0000 7f3e8c42f700 1 --2- 172.21.15.52:0/27332310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e84141220 0x7f3e8413d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:14.822 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.813+0000 7f3e8c42f700 1 -- 172.21.15.52:0/27332310 >> 172.21.15.52:0/27332310 conn(0x7f3e840bd420 msgr2=0x7f3e840b60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:14.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.813+0000 7f3e8c42f700 1 -- 172.21.15.52:0/27332310 shutdown_connections 2023-06-23T18:45:14.823 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.813+0000 7f3e8c42f700 1 -- 172.21.15.52:0/27332310 wait complete. 2023-06-23T18:45:14.830 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T18:45:14.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.954+0000 7f07d4207700 1 Processor -- start 2023-06-23T18:45:14.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.954+0000 7f07d4207700 1 -- start start 2023-06-23T18:45:14.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.955+0000 7f07d4207700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f07cc14b170 0x7f07cc0ba4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:14.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.955+0000 7f07d4207700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f07cc152f40 0x7f07cc155320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:14.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.955+0000 7f07d4207700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07cc0b8880 con 0x7f07cc0a5bf0 2023-06-23T18:45:14.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.955+0000 7f07d4207700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07cc069ef0 con 0x7f07cc152f40 2023-06-23T18:45:14.961 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.955+0000 7f07d4207700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07cc06a1d0 con 0x7f07cc14b170 2023-06-23T18:45:14.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.955+0000 7f07d27a4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f07cc152f40 0x7f07cc155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:14.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.955+0000 7f07d27a4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f07cc152f40 0x7f07cc155320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38538/0 (socket says 172.21.15.52:38538) 2023-06-23T18:45:14.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.955+0000 7f07d27a4700 1 -- 172.21.15.52:0/94670760 learned_addr learned my addr 172.21.15.52:0/94670760 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:14.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.955+0000 7f07d1fa3700 1 --2- 172.21.15.52:0/94670760 >> v2:172.21.15.89:3300/0 conn(0x7f07cc14b170 0x7f07cc0ba4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:14.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.955+0000 7f07d27a4700 1 -- 172.21.15.52:0/94670760 >> v2:172.21.15.89:3300/0 conn(0x7f07cc14b170 msgr2=0x7f07cc0ba4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:14.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.955+0000 7f07d27a4700 1 --2- 172.21.15.52:0/94670760 >> v2:172.21.15.89:3300/0 conn(0x7f07cc14b170 0x7f07cc0ba4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:14.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.955+0000 7f07d27a4700 1 -- 172.21.15.52:0/94670760 >> v1:172.21.15.89:6789/0 conn(0x7f07cc0a5bf0 legacy=0x7f07cc0b8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:14.962 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.955+0000 7f07d27a4700 1 -- 172.21.15.52:0/94670760 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07cc06a4b0 con 0x7f07cc152f40 2023-06-23T18:45:14.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.955+0000 7f07d27a4700 1 --2- 172.21.15.52:0/94670760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07cc152f40 0x7f07cc155320 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f07cc0c17f0 tx=0x7f07c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c312e2fd8da0ae5d server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:14.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.955+0000 7f07d0fa1700 1 -- 172.21.15.52:0/94670760 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c400e070 con 0x7f07cc152f40 2023-06-23T18:45:14.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.956+0000 7f07d0fa1700 1 -- 172.21.15.52:0/94670760 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c400b910 con 0x7f07cc152f40 2023-06-23T18:45:14.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.956+0000 7f07d0fa1700 1 -- 172.21.15.52:0/94670760 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c400bcc0 con 0x7f07cc152f40 2023-06-23T18:45:14.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.956+0000 7f07d4207700 1 -- 172.21.15.52:0/94670760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07cc152f40 msgr2=0x7f07cc155320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:14.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.956+0000 7f07d4207700 1 --2- 172.21.15.52:0/94670760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07cc152f40 0x7f07cc155320 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f07cc0c17f0 tx=0x7f07c400b330 comp rx=0 tx=0).stop 2023-06-23T18:45:14.963 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.956+0000 7f07d4207700 1 -- 172.21.15.52:0/94670760 shutdown_connections 2023-06-23T18:45:14.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.956+0000 7f07d4207700 1 --2- 172.21.15.52:0/94670760 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07cc152f40 0x7f07cc155320 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:14.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.956+0000 7f07d4207700 1 --2- 172.21.15.52:0/94670760 >> v2:172.21.15.89:3300/0 conn(0x7f07cc14b170 0x7f07cc0ba4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:14.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.956+0000 7f07d4207700 1 -- 172.21.15.52:0/94670760 >> 172.21.15.52:0/94670760 conn(0x7f07cc0c06f0 msgr2=0x7f07cc0c0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:14.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.956+0000 7f07d4207700 1 -- 172.21.15.52:0/94670760 shutdown_connections 2023-06-23T18:45:14.964 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.956+0000 7f07d4207700 1 -- 172.21.15.52:0/94670760 wait complete. 2023-06-23T18:45:14.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.957+0000 7f07d4207700 1 Processor -- start 2023-06-23T18:45:14.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.957+0000 7f07d4207700 1 -- start start 2023-06-23T18:45:14.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.958+0000 7f07d4207700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07cc0a5bf0 0x7f07cc0b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:14.966 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.958+0000 7f07d4207700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07cc14b170 0x7f07cc1e0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:14.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.958+0000 7f07d4207700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07cc152f40 0x7f07cc14c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:14.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.958+0000 7f07d4207700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc14d310 con 0x7f07cc0a5bf0 2023-06-23T18:45:14.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.958+0000 7f07d4207700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc152b20 con 0x7f07cc152f40 2023-06-23T18:45:14.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.958+0000 7f07d4207700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc1df890 con 0x7f07cc14b170 2023-06-23T18:45:14.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.958+0000 7f07d1fa3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07cc0a5bf0 0x7f07cc0b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:14.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.958+0000 7f07d1fa3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07cc0a5bf0 0x7f07cc0b36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:38540/0 (socket says 172.21.15.52:38540) 2023-06-23T18:45:14.967 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.958+0000 7f07d1fa3700 1 -- 172.21.15.52:0/155278258 learned_addr learned my addr 172.21.15.52:0/155278258 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:14.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.958+0000 7f07d27a4700 1 --2- 172.21.15.52:0/155278258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07cc152f40 0x7f07cc14c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:14.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.958+0000 7f07d17a2700 1 --2- 172.21.15.52:0/155278258 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07cc14b170 0x7f07cc1e0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:14.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.958+0000 7f07d1fa3700 1 -- 172.21.15.52:0/155278258 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07cc14b170 msgr2=0x7f07cc1e0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:14.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.958+0000 7f07d1fa3700 1 --2- 172.21.15.52:0/155278258 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07cc14b170 0x7f07cc1e0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:14.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.958+0000 7f07d1fa3700 1 -- 172.21.15.52:0/155278258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07cc152f40 msgr2=0x7f07cc14c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:14.968 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.958+0000 7f07d1fa3700 1 --2- 172.21.15.52:0/155278258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07cc152f40 0x7f07cc14c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:14.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.958+0000 7f07d1fa3700 1 -- 172.21.15.52:0/155278258 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c4009b30 con 0x7f07cc0a5bf0 2023-06-23T18:45:14.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.958+0000 7f07d1fa3700 1 --2- 172.21.15.52:0/155278258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07cc0a5bf0 0x7f07cc0b36f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f07bc00e9b0 tx=0x7f07bc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:14.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.959+0000 7f07c27fc700 1 -- 172.21.15.52:0/155278258 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc009710 con 0x7f07cc0a5bf0 2023-06-23T18:45:14.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.959+0000 7f07c27fc700 1 -- 172.21.15.52:0/155278258 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07bc00ee50 con 0x7f07cc0a5bf0 2023-06-23T18:45:14.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.959+0000 7f07d4207700 1 -- 172.21.15.52:0/155278258 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07cc1dfb70 con 0x7f07cc0a5bf0 2023-06-23T18:45:14.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.959+0000 7f07c27fc700 1 -- 172.21.15.52:0/155278258 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc00ca50 con 0x7f07cc0a5bf0 2023-06-23T18:45:14.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.959+0000 7f07d4207700 1 -- 172.21.15.52:0/155278258 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07cc14bcc0 con 0x7f07cc0a5bf0 2023-06-23T18:45:14.969 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.960+0000 7f07d4207700 1 -- 172.21.15.52:0/155278258 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07cc1dfd00 con 0x7f07cc0a5bf0 2023-06-23T18:45:14.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.960+0000 7f07c27fc700 1 -- 172.21.15.52:0/155278258 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f07bc00cbb0 con 0x7f07cc0a5bf0 2023-06-23T18:45:14.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.960+0000 7f07c27fc700 1 --2- 172.21.15.52:0/155278258 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f07b006ace0 0x7f07b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:14.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.961+0000 7f07c27fc700 1 -- 172.21.15.52:0/155278258 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f07bc089470 con 0x7f07cc0a5bf0 2023-06-23T18:45:14.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.961+0000 7f07d17a2700 1 --2- 172.21.15.52:0/155278258 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f07b006ace0 0x7f07b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:14.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.961+0000 7f07d17a2700 1 --2- 172.21.15.52:0/155278258 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f07b006ace0 0x7f07b006d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f07cc144ce0 tx=0x7f07c8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:14.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:14.965+0000 7f07c27fc700 1 -- 172.21.15.52:0/155278258 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f07bc057fa0 con 0x7f07cc0a5bf0 2023-06-23T18:45:15.163 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.159+0000 7f07d4207700 1 -- 172.21.15.52:0/155278258 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f07cc04e1d0 con 0x7f07cc0a5bf0 2023-06-23T18:45:15.164 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.159+0000 7f07c27fc700 1 -- 172.21.15.52:0/155278258 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f07bc00ce60 con 0x7f07cc0a5bf0 2023-06-23T18:45:15.164 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-06-23T18:45:15.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.161+0000 7f07d4207700 1 -- 172.21.15.52:0/155278258 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f07b006ace0 msgr2=0x7f07b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:15.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.161+0000 7f07d4207700 1 --2- 172.21.15.52:0/155278258 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f07b006ace0 0x7f07b006d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f07cc144ce0 tx=0x7f07c8009040 comp rx=0 tx=0).stop 2023-06-23T18:45:15.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.161+0000 7f07d4207700 1 -- 172.21.15.52:0/155278258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07cc0a5bf0 msgr2=0x7f07cc0b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:15.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.161+0000 7f07d4207700 1 --2- 172.21.15.52:0/155278258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07cc0a5bf0 0x7f07cc0b36f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f07bc00e9b0 tx=0x7f07bc00ecc0 comp rx=0 tx=0).stop 2023-06-23T18:45:15.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.161+0000 7f07d4207700 1 -- 172.21.15.52:0/155278258 shutdown_connections 2023-06-23T18:45:15.166 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.161+0000 7f07d4207700 1 --2- 172.21.15.52:0/155278258 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f07b006ace0 0x7f07b006d190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:15.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.161+0000 7f07d4207700 1 --2- 172.21.15.52:0/155278258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07cc152f40 0x7f07cc14c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:15.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.161+0000 7f07d4207700 1 --2- 172.21.15.52:0/155278258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07cc0a5bf0 0x7f07cc0b36f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:15.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.161+0000 7f07d4207700 1 --2- 172.21.15.52:0/155278258 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07cc14b170 0x7f07cc1e0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:15.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.161+0000 7f07d4207700 1 -- 172.21.15.52:0/155278258 >> 172.21.15.52:0/155278258 conn(0x7f07cc0c06f0 msgr2=0x7f07cc143070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:15.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.161+0000 7f07d4207700 1 -- 172.21.15.52:0/155278258 shutdown_connections 2023-06-23T18:45:15.167 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.161+0000 7f07d4207700 1 -- 172.21.15.52:0/155278258 wait complete. 2023-06-23T18:45:15.178 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:45:15.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.298+0000 7f3fc8990700 1 Processor -- start 2023-06-23T18:45:15.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.298+0000 7f3fc8990700 1 -- start start 2023-06-23T18:45:15.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.299+0000 7f3fc8990700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fc41426a0 0x7f3fc4071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:15.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.299+0000 7f3fc8990700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3fc4148b90 0x7f3fc4152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:15.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.299+0000 7f3fc8990700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc40b53b0 con 0x7f3fc40b8c70 2023-06-23T18:45:15.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.299+0000 7f3fc8990700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc40b4750 con 0x7f3fc4148b90 2023-06-23T18:45:15.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.299+0000 7f3fc8990700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc4142a70 con 0x7f3fc41426a0 2023-06-23T18:45:15.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.299+0000 7f3fc259c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fc41426a0 0x7f3fc4071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:15.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.299+0000 7f3fc2d9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3fc4148b90 0x7f3fc4152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:15.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.299+0000 7f3fc259c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fc41426a0 0x7f3fc4071be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.52:51818/0 (socket says 172.21.15.52:51818) 2023-06-23T18:45:15.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.299+0000 7f3fc259c700 1 -- 172.21.15.52:0/39273408 learned_addr learned my addr 172.21.15.52:0/39273408 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:15.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.300+0000 7f3fc259c700 1 -- 172.21.15.52:0/39273408 >> v2:172.21.15.89:3300/0 conn(0x7f3fc4148b90 msgr2=0x7f3fc4152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:15.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.300+0000 7f3fc259c700 1 --2- 172.21.15.52:0/39273408 >> v2:172.21.15.89:3300/0 conn(0x7f3fc4148b90 0x7f3fc4152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:15.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.300+0000 7f3fc259c700 1 -- 172.21.15.52:0/39273408 >> v1:172.21.15.89:6789/0 conn(0x7f3fc40b8c70 legacy=0x7f3fc4148480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:15.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.300+0000 7f3fc259c700 1 -- 172.21.15.52:0/39273408 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc40b9c30 con 0x7f3fc41426a0 2023-06-23T18:45:15.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.300+0000 7f3fc259c700 1 --2- 172.21.15.52:0/39273408 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fc41426a0 0x7f3fc4071be0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3fb40098f0 tx=0x7f3fb4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77ae05aaa535e770 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:15.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.300+0000 7f3fc159a700 1 -- 172.21.15.52:0/39273408 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4011830 con 0x7f3fc41426a0 2023-06-23T18:45:15.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.300+0000 7f3fc159a700 1 -- 172.21.15.52:0/39273408 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb4011990 con 0x7f3fc41426a0 2023-06-23T18:45:15.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.300+0000 7f3fc159a700 1 -- 172.21.15.52:0/39273408 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4011d20 con 0x7f3fc41426a0 2023-06-23T18:45:15.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.301+0000 7f3fc8990700 1 -- 172.21.15.52:0/39273408 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fc41426a0 msgr2=0x7f3fc4071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:15.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.301+0000 7f3fc8990700 1 --2- 172.21.15.52:0/39273408 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fc41426a0 0x7f3fc4071be0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3fb40098f0 tx=0x7f3fb4009c00 comp rx=0 tx=0).stop 2023-06-23T18:45:15.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.301+0000 7f3fc8990700 1 -- 172.21.15.52:0/39273408 shutdown_connections 2023-06-23T18:45:15.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.301+0000 7f3fc8990700 1 --2- 172.21.15.52:0/39273408 >> v2:172.21.15.89:3300/0 conn(0x7f3fc4148b90 0x7f3fc4152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:15.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.301+0000 7f3fc8990700 1 --2- 172.21.15.52:0/39273408 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fc41426a0 0x7f3fc4071be0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:15.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.301+0000 7f3fc8990700 1 -- 172.21.15.52:0/39273408 >> 172.21.15.52:0/39273408 conn(0x7f3fc40bd690 msgr2=0x7f3fc40b9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:15.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.301+0000 7f3fc8990700 1 -- 172.21.15.52:0/39273408 shutdown_connections 2023-06-23T18:45:15.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.301+0000 7f3fc8990700 1 -- 172.21.15.52:0/39273408 wait complete. 2023-06-23T18:45:15.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.302+0000 7f3fc8990700 1 Processor -- start 2023-06-23T18:45:15.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.302+0000 7f3fc8990700 1 -- start start 2023-06-23T18:45:15.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.303+0000 7f3fc8990700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc40b8c70 0x7f3fc40bbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:15.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.303+0000 7f3fc8990700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fc41426a0 0x7f3fc4142e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:15.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.303+0000 7f3fc8990700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fc4148b90 0x7f3fc4147330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:15.310 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.303+0000 7f3fc8990700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc4146640 con 0x7f3fc4148b90 2023-06-23T18:45:15.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.303+0000 7f3fc8990700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc40bc080 con 0x7f3fc40b8c70 2023-06-23T18:45:15.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.303+0000 7f3fc8990700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc4141f50 con 0x7f3fc41426a0 2023-06-23T18:45:15.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.303+0000 7f3fc2d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fc4148b90 0x7f3fc4147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:15.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.303+0000 7f3fc2d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fc4148b90 0x7f3fc4147330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56726/0 (socket says 172.21.15.52:56726) 2023-06-23T18:45:15.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.303+0000 7f3fc2d9d700 1 -- 172.21.15.52:0/751472548 learned_addr learned my addr 172.21.15.52:0/751472548 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:15.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.303+0000 7f3fc1d9b700 1 --2- 172.21.15.52:0/751472548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fc41426a0 0x7f3fc4142e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:15.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.303+0000 7f3fc259c700 1 --2- 172.21.15.52:0/751472548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc40b8c70 0x7f3fc40bbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:15.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.303+0000 7f3fc2d9d700 1 -- 172.21.15.52:0/751472548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fc41426a0 msgr2=0x7f3fc4142e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:15.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.303+0000 7f3fc2d9d700 1 --2- 172.21.15.52:0/751472548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fc41426a0 0x7f3fc4142e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:15.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.303+0000 7f3fc2d9d700 1 -- 172.21.15.52:0/751472548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc40b8c70 msgr2=0x7f3fc40bbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:15.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.303+0000 7f3fc2d9d700 1 --2- 172.21.15.52:0/751472548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc40b8c70 0x7f3fc40bbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:15.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.303+0000 7f3fc2d9d700 1 -- 172.21.15.52:0/751472548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb4009550 con 0x7f3fc4148b90 2023-06-23T18:45:15.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.303+0000 7f3fc2d9d700 1 --2- 172.21.15.52:0/751472548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fc4148b90 0x7f3fc4147330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00efc0 tx=0x7f3fbc00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:15.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.303+0000 7f3fbaffd700 1 -- 172.21.15.52:0/751472548 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc00cad0 con 0x7f3fc4148b90 2023-06-23T18:45:15.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.303+0000 7f3fbaffd700 1 -- 172.21.15.52:0/751472548 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fbc00f040 con 0x7f3fc4148b90 2023-06-23T18:45:15.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.303+0000 7f3fc8990700 1 -- 172.21.15.52:0/751472548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc4146eb0 con 0x7f3fc4148b90 2023-06-23T18:45:15.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.304+0000 7f3fbaffd700 1 -- 172.21.15.52:0/751472548 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc00ce70 con 0x7f3fc4148b90 2023-06-23T18:45:15.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.304+0000 7f3fc8990700 1 -- 172.21.15.52:0/751472548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc4146b10 con 0x7f3fc4148b90 2023-06-23T18:45:15.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.305+0000 7f3fc8990700 1 -- 172.21.15.52:0/751472548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc404e1d0 con 0x7f3fc4148b90 2023-06-23T18:45:15.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.305+0000 7f3fbaffd700 1 -- 172.21.15.52:0/751472548 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3fbc014480 con 0x7f3fc4148b90 2023-06-23T18:45:15.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.305+0000 7f3fbaffd700 1 --2- 172.21.15.52:0/751472548 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3fa406ace0 0x7f3fa406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:15.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.306+0000 7f3fbaffd700 1 -- 172.21.15.52:0/751472548 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3fbc089a80 con 0x7f3fc4148b90 2023-06-23T18:45:15.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.306+0000 7f3fc259c700 1 --2- 172.21.15.52:0/751472548 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3fa406ace0 0x7f3fa406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:15.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.306+0000 7f3fc259c700 1 --2- 172.21.15.52:0/751472548 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3fa406ace0 0x7f3fa406d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4009c40 tx=0x7f3fb4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:15.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.310+0000 7f3fbaffd700 1 -- 172.21.15.52:0/751472548 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3fbc054b30 con 0x7f3fc4148b90 2023-06-23T18:45:15.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.508+0000 7f3fc8990700 1 -- 172.21.15.52:0/751472548 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fc406b520 con 0x7f3fc4148b90 2023-06-23T18:45:15.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.509+0000 7f3fbaffd700 1 -- 172.21.15.52:0/751472548 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7f3fbc058150 con 0x7f3fc4148b90 2023-06-23T18:45:15.514 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:15.514 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","created":"2023-06-23T18:44:31.918434+0000","modified":"2023-06-23T18:44:51.644330+0000","last_up_change":"2023-06-23T18:44:42.169624+0000","last_in_change":"2023-06-23T18:44:34.510501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-23T18:44:43.346578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-23T18:44:43.829719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:44:48.517897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:44:49.621134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c371fb28-1b15-4e43-8d5a-43e402920ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6812","nonce":1066999520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6815","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6818","nonce":1066999520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6829","nonce":1066999520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6823","nonce":1066999520}]},"public_addr":"172.21.15.52:6812/1066999520","cluster_addr":"172.21.15.52:6818/1066999520","heartbeat_back_addr":"172.21.15.52:6829/1066999520","heartbeat_front_addr":"172.21.15.52:6823/1066999520","state":["exists","up"]},{"osd":1,"uuid":"4a142f04-33eb-47ec-9cc5-b08b44d82658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6813","nonce":2360219751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6819","nonce":2360219751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6830","nonce":2360219751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6825","nonce":2360219751}]},"public_addr":"172.21.15.52:6813/2360219751","cluster_addr":"172.21.15.52:6819/2360219751","heartbeat_back_addr":"172.21.15.52:6830/2360219751","heartbeat_front_addr":"172.21.15.52:6825/2360219751","state":["exists","up"]},{"osd":2,"uuid":"d7bb089d-4c55-4370-ba59-7fe88c39512a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6801","nonce":835073005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6803","nonce":835073005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6807","nonce":835073005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6805","nonce":835073005}]},"public_addr":"172.21.15.52:6801/835073005","cluster_addr":"172.21.15.52:6803/835073005","heartbeat_back_addr":"172.21.15.52:6807/835073005","heartbeat_front_addr":"172.21.15.52:6805/835073005","state":["exists","up"]},{"osd":3,"uuid":"4bcdcdc3-6a8f-468e-877e-57f76079ac3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6811","nonce":2852700864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6817","nonce":2852700864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6831","nonce":2852700864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6824","nonce":2852700864}]},"public_addr":"172.21.15.52:6811/2852700864","cluster_addr":"172.21.15.52:6817/2852700864","heartbeat_back_addr":"172.21.15.52:6831/2852700864","heartbeat_front_addr":"172.21.15.52:6824/2852700864","state":["exists","up"]},{"osd":4,"uuid":"cac63000-ae94-4b08-93e6-a99119640b63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6809","nonce":2538664679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6811","nonce":2538664679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6815","nonce":2538664679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6813","nonce":2538664679}]},"public_addr":"172.21.15.89:6809/2538664679","cluster_addr":"172.21.15.89:6811/2538664679","heartbeat_back_addr":"172.21.15.89:6815/2538664679","heartbeat_front_addr":"172.21.15.89:6813/2538664679","state":["exists","up"]},{"osd":5,"uuid":"45c53102-18a6-4fd7-9c25-8ea5e1ef6851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6801","nonce":1683710352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6803","nonce":1683710352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6807","nonce":1683710352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6805","nonce":1683710352}]},"public_addr":"172.21.15.89:6801/1683710352","cluster_addr":"172.21.15.89:6803/1683710352","heartbeat_back_addr":"172.21.15.89:6807/1683710352","heartbeat_front_addr":"172.21.15.89:6805/1683710352","state":["exists","up"]},{"osd":6,"uuid":"abee09d1-8eba-484f-a25c-871c1fe2e843","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6817","nonce":3890899288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6819","nonce":3890899288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6823","nonce":3890899288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6821","nonce":3890899288}]},"public_addr":"172.21.15.89:6817/3890899288","cluster_addr":"172.21.15.89:6819/3890899288","heartbeat_back_addr":"172.21.15.89:6823/3890899288","heartbeat_front_addr":"172.21.15.89:6821/3890899288","state":["exists","up"]},{"osd":7,"uuid":"5acf9e2e-00dd-4f9b-a7d9-3d820f695de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6825","nonce":2989085420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6827","nonce":2989085420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6831","nonce":2989085420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6829","nonce":2989085420}]},"public_addr":"172.21.15.89:6825/2989085420","cluster_addr":"172.21.15.89:6827/2989085420","heartbeat_back_addr":"172.21.15.89:6831/2989085420","heartbeat_front_addr":"172.21.15.89:6829/2989085420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.663866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.710904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.619347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.660102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.686933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.724635+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.669111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.678740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:45:15.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.511+0000 7f3fc8990700 1 -- 172.21.15.52:0/751472548 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3fa406ace0 msgr2=0x7f3fa406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:15.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.511+0000 7f3fc8990700 1 --2- 172.21.15.52:0/751472548 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3fa406ace0 0x7f3fa406d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4009c40 tx=0x7f3fb4008030 comp rx=0 tx=0).stop 2023-06-23T18:45:15.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.511+0000 7f3fc8990700 1 -- 172.21.15.52:0/751472548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fc4148b90 msgr2=0x7f3fc4147330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:15.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.511+0000 7f3fc8990700 1 --2- 172.21.15.52:0/751472548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fc4148b90 0x7f3fc4147330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00efc0 tx=0x7f3fbc00c0c0 comp rx=0 tx=0).stop 2023-06-23T18:45:15.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.511+0000 7f3fc8990700 1 -- 172.21.15.52:0/751472548 shutdown_connections 2023-06-23T18:45:15.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.511+0000 7f3fc8990700 1 --2- 172.21.15.52:0/751472548 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3fa406ace0 0x7f3fa406d190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:15.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.511+0000 7f3fc8990700 1 --2- 172.21.15.52:0/751472548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fc4148b90 0x7f3fc4147330 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:15.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.511+0000 7f3fc8990700 1 --2- 172.21.15.52:0/751472548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3fc40b8c70 0x7f3fc40bbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:15.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.511+0000 7f3fc8990700 1 --2- 172.21.15.52:0/751472548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3fc41426a0 0x7f3fc4142e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:15.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.511+0000 7f3fc8990700 1 -- 172.21.15.52:0/751472548 >> 172.21.15.52:0/751472548 conn(0x7f3fc40bd690 msgr2=0x7f3fc40b5760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:15.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.511+0000 7f3fc8990700 1 -- 172.21.15.52:0/751472548 shutdown_connections 2023-06-23T18:45:15.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.511+0000 7f3fc8990700 1 -- 172.21.15.52:0/751472548 wait complete. 2023-06-23T18:45:15.528 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-23T18:44:43.346578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-23T18:44:43.829719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T18:44:48.517897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T18:44:49.621134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-23T18:45:15.529 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T18:45:15.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.652+0000 7f9a6dda1700 1 Processor -- start 2023-06-23T18:45:15.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.652+0000 7f9a6dda1700 1 -- start start 2023-06-23T18:45:15.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.653+0000 7f9a6dda1700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9a6814b170 0x7f9a680ba4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:15.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.653+0000 7f9a6dda1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a680a5bf0 0x7f9a680b8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:15.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.653+0000 7f9a6dda1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a68069ef0 con 0x7f9a6814dc20 2023-06-23T18:45:15.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.653+0000 7f9a6dda1700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a6806a1d0 con 0x7f9a6814b170 2023-06-23T18:45:15.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.653+0000 7f9a6dda1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6806a4b0 con 0x7f9a680a5bf0 2023-06-23T18:45:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.653+0000 7f9a677fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f9a6814b170 0x7f9a680ba4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.653+0000 7f9a67fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f9a6814dc20 0x7f9a6814e0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37864/0 (socket says 172.21.15.52:37864) 2023-06-23T18:45:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.653+0000 7f9a67fff700 1 -- 172.21.15.52:0/708757237 learned_addr learned my addr 172.21.15.52:0/708757237 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.653+0000 7f9a66ffd700 1 --2- 172.21.15.52:0/708757237 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a680a5bf0 0x7f9a680b8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.653+0000 7f9a677fe700 1 -- 172.21.15.52:0/708757237 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a680a5bf0 msgr2=0x7f9a680b8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.653+0000 7f9a677fe700 1 --2- 172.21.15.52:0/708757237 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a680a5bf0 0x7f9a680b8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:15.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.653+0000 7f9a677fe700 1 -- 172.21.15.52:0/708757237 >> v1:172.21.15.52:6789/0 conn(0x7f9a6814dc20 legacy=0x7f9a6814e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:15.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.653+0000 7f9a677fe700 1 -- 172.21.15.52:0/708757237 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6806a790 con 0x7f9a6814b170 2023-06-23T18:45:15.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.654+0000 7f9a677fe700 1 --2- 172.21.15.52:0/708757237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6814b170 0x7f9a680ba4b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9a58009840 tx=0x7f9a58009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df808b11625b834 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:15.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.654+0000 7f9a667fc700 1 -- 172.21.15.52:0/708757237 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a58004230 con 0x7f9a6814b170 2023-06-23T18:45:15.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.654+0000 7f9a667fc700 1 -- 172.21.15.52:0/708757237 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a58004390 con 0x7f9a6814b170 2023-06-23T18:45:15.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.654+0000 7f9a667fc700 1 -- 172.21.15.52:0/708757237 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a580036a0 con 0x7f9a6814b170 2023-06-23T18:45:15.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.654+0000 7f9a6dda1700 1 -- 172.21.15.52:0/708757237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6814b170 msgr2=0x7f9a680ba4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:15.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.654+0000 7f9a6dda1700 1 --2- 172.21.15.52:0/708757237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6814b170 0x7f9a680ba4b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9a58009840 tx=0x7f9a58009b50 comp rx=0 tx=0).stop 2023-06-23T18:45:15.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.654+0000 7f9a6dda1700 1 -- 172.21.15.52:0/708757237 shutdown_connections 2023-06-23T18:45:15.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.654+0000 7f9a6dda1700 1 --2- 172.21.15.52:0/708757237 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6814b170 0x7f9a680ba4b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:15.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.654+0000 7f9a6dda1700 1 --2- 172.21.15.52:0/708757237 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a680a5bf0 0x7f9a680b8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:15.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.654+0000 7f9a6dda1700 1 -- 172.21.15.52:0/708757237 >> 172.21.15.52:0/708757237 conn(0x7f9a680c06f0 msgr2=0x7f9a680c0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:15.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.654+0000 7f9a6dda1700 1 -- 172.21.15.52:0/708757237 shutdown_connections 2023-06-23T18:45:15.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.654+0000 7f9a6dda1700 1 -- 172.21.15.52:0/708757237 wait complete. 2023-06-23T18:45:15.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.656+0000 7f9a6dda1700 1 Processor -- start 2023-06-23T18:45:15.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.656+0000 7f9a6dda1700 1 -- start start 2023-06-23T18:45:15.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.656+0000 7f9a6dda1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a680a5bf0 0x7f9a680b5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:15.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.656+0000 7f9a6dda1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a6814b170 0x7f9a68147780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:15.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.656+0000 7f9a6dda1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6814dc20 0x7f9a681443c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:15.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.656+0000 7f9a6dda1700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a680b5bd0 con 0x7f9a6814dc20 2023-06-23T18:45:15.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.656+0000 7f9a6dda1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a680b4de0 con 0x7f9a680a5bf0 2023-06-23T18:45:15.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.656+0000 7f9a6dda1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a680b6ab0 con 0x7f9a6814b170 2023-06-23T18:45:15.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.656+0000 7f9a67fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6814dc20 0x7f9a681443c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:15.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.657+0000 7f9a67fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6814dc20 0x7f9a681443c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56740/0 (socket says 172.21.15.52:56740) 2023-06-23T18:45:15.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.657+0000 7f9a67fff700 1 -- 172.21.15.52:0/4054050981 learned_addr learned my addr 172.21.15.52:0/4054050981 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:15.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.657+0000 7f9a66ffd700 1 --2- 172.21.15.52:0/4054050981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a6814b170 0x7f9a68147780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:15.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.657+0000 7f9a677fe700 1 --2- 172.21.15.52:0/4054050981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a680a5bf0 0x7f9a680b5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:15.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.657+0000 7f9a67fff700 1 -- 172.21.15.52:0/4054050981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a6814b170 msgr2=0x7f9a68147780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:15.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.657+0000 7f9a67fff700 1 --2- 172.21.15.52:0/4054050981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a6814b170 0x7f9a68147780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:15.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.657+0000 7f9a67fff700 1 -- 172.21.15.52:0/4054050981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a680a5bf0 msgr2=0x7f9a680b5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:15.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.657+0000 7f9a67fff700 1 --2- 172.21.15.52:0/4054050981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a680a5bf0 0x7f9a680b5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:15.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.657+0000 7f9a67fff700 1 -- 172.21.15.52:0/4054050981 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a580094a0 con 0x7f9a6814dc20 2023-06-23T18:45:15.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.657+0000 7f9a677fe700 1 --2- 172.21.15.52:0/4054050981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a680a5bf0 0x7f9a680b5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:45:15.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.657+0000 7f9a67fff700 1 --2- 172.21.15.52:0/4054050981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6814dc20 0x7f9a681443c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000cca0 tx=0x7f9a6000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:15.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.657+0000 7f9a5ffff700 1 -- 172.21.15.52:0/4054050981 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6000cea0 con 0x7f9a6814dc20 2023-06-23T18:45:15.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.657+0000 7f9a5ffff700 1 -- 172.21.15.52:0/4054050981 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6000ada0 con 0x7f9a6814dc20 2023-06-23T18:45:15.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.657+0000 7f9a6dda1700 1 -- 172.21.15.52:0/4054050981 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a680b6d20 con 0x7f9a6814dc20 2023-06-23T18:45:15.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.657+0000 7f9a5ffff700 1 -- 172.21.15.52:0/4054050981 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60007310 con 0x7f9a6814dc20 2023-06-23T18:45:15.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.657+0000 7f9a6dda1700 1 -- 172.21.15.52:0/4054050981 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a680b7490 con 0x7f9a6814dc20 2023-06-23T18:45:15.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.658+0000 7f9a6dda1700 1 -- 172.21.15.52:0/4054050981 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a6804e1d0 con 0x7f9a6814dc20 2023-06-23T18:45:15.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.658+0000 7f9a5ffff700 1 -- 172.21.15.52:0/4054050981 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9a60007470 con 0x7f9a6814dc20 2023-06-23T18:45:15.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.659+0000 7f9a5ffff700 1 --2- 172.21.15.52:0/4054050981 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9a4806ad10 0x7f9a4806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:15.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.659+0000 7f9a5ffff700 1 -- 172.21.15.52:0/4054050981 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9a60089060 con 0x7f9a6814dc20 2023-06-23T18:45:15.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.659+0000 7f9a677fe700 1 --2- 172.21.15.52:0/4054050981 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9a4806ad10 0x7f9a4806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:15.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.660+0000 7f9a677fe700 1 --2- 172.21.15.52:0/4054050981 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9a4806ad10 0x7f9a4806d1c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9a580090b0 tx=0x7f9a58008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:15.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.663+0000 7f9a5ffff700 1 -- 172.21.15.52:0/4054050981 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9a60054090 con 0x7f9a6814dc20 2023-06-23T18:45:15.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.859+0000 7f9a6dda1700 1 -- 172.21.15.52:0/4054050981 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9a681d5cd0 con 0x7f9a6814dc20 2023-06-23T18:45:15.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.859+0000 7f9a5ffff700 1 -- 172.21.15.52:0/4054050981 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9a600576b0 con 0x7f9a6814dc20 2023-06-23T18:45:15.864 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-06-23T18:45:15.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.861+0000 7f9a6dda1700 1 -- 172.21.15.52:0/4054050981 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9a4806ad10 msgr2=0x7f9a4806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:15.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.861+0000 7f9a6dda1700 1 --2- 172.21.15.52:0/4054050981 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9a4806ad10 0x7f9a4806d1c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9a580090b0 tx=0x7f9a58008030 comp rx=0 tx=0).stop 2023-06-23T18:45:15.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.861+0000 7f9a6dda1700 1 -- 172.21.15.52:0/4054050981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6814dc20 msgr2=0x7f9a681443c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:15.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.861+0000 7f9a6dda1700 1 --2- 172.21.15.52:0/4054050981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6814dc20 0x7f9a681443c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000cca0 tx=0x7f9a6000a340 comp rx=0 tx=0).stop 2023-06-23T18:45:15.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.861+0000 7f9a6dda1700 1 -- 172.21.15.52:0/4054050981 shutdown_connections 2023-06-23T18:45:15.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.861+0000 7f9a6dda1700 1 --2- 172.21.15.52:0/4054050981 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f9a4806ad10 0x7f9a4806d1c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:15.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.861+0000 7f9a6dda1700 1 --2- 172.21.15.52:0/4054050981 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9a6814dc20 0x7f9a681443c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:15.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.861+0000 7f9a6dda1700 1 --2- 172.21.15.52:0/4054050981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a680a5bf0 0x7f9a680b5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:15.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.861+0000 7f9a6dda1700 1 --2- 172.21.15.52:0/4054050981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a6814b170 0x7f9a68147780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:15.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.862+0000 7f9a6dda1700 1 -- 172.21.15.52:0/4054050981 >> 172.21.15.52:0/4054050981 conn(0x7f9a680c06f0 msgr2=0x7f9a681d4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:15.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.862+0000 7f9a6dda1700 1 -- 172.21.15.52:0/4054050981 shutdown_connections 2023-06-23T18:45:15.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:15.862+0000 7f9a6dda1700 1 -- 172.21.15.52:0/4054050981 wait complete. 2023-06-23T18:45:15.878 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T18:45:16.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.002+0000 7fa45ab0a700 1 Processor -- start 2023-06-23T18:45:16.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.002+0000 7fa45ab0a700 1 -- start start 2023-06-23T18:45:16.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.003+0000 7fa45ab0a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4540be840 0x7fa454155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:16.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.003+0000 7fa45ab0a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa45414a680 con 0x7fa4540b9170 2023-06-23T18:45:16.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.003+0000 7fa45ab0a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa45406b3e0 con 0x7fa4540be470 2023-06-23T18:45:16.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.003+0000 7fa45ab0a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45406b6c0 con 0x7fa4540be840 2023-06-23T18:45:16.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.003+0000 7fa453fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fa4540b9170 0x7fa45406cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37866/0 (socket says 172.21.15.52:37866) 2023-06-23T18:45:16.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.003+0000 7fa453fff700 1 -- 172.21.15.52:0/791291143 learned_addr learned my addr 172.21.15.52:0/791291143 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:16.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.003+0000 7fa4590a7700 1 --2- 172.21.15.52:0/791291143 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4540be840 0x7fa454155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:16.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.004+0000 7fa4537fe700 1 -- 172.21.15.52:0/791291143 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156495084 0 0) 0x7fa45414a680 con 0x7fa4540b9170 2023-06-23T18:45:16.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.004+0000 7fa4537fe700 1 -- 172.21.15.52:0/791291143 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4440035b0 con 0x7fa4540b9170 2023-06-23T18:45:16.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.004+0000 7fa4537fe700 1 -- 172.21.15.52:0/791291143 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 329991534 0 0) 0x7fa4440035b0 con 0x7fa4540b9170 2023-06-23T18:45:16.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.004+0000 7fa4537fe700 1 -- 172.21.15.52:0/791291143 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4540be840 msgr2=0x7fa454155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:16.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.004+0000 7fa4537fe700 1 --2- 172.21.15.52:0/791291143 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4540be840 0x7fa454155ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.004+0000 7fa4537fe700 1 -- 172.21.15.52:0/791291143 >> v1:172.21.15.89:6789/0 conn(0x7fa4540be470 legacy=0x7fa45414b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:16.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.004+0000 7fa4537fe700 1 -- 172.21.15.52:0/791291143 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45414a8e0 con 0x7fa4540b9170 2023-06-23T18:45:16.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.004+0000 7fa4537fe700 1 -- 172.21.15.52:0/791291143 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7fa440001670 con 0x7fa4540b9170 2023-06-23T18:45:16.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.004+0000 7fa4537fe700 1 -- 172.21.15.52:0/791291143 >> v1:172.21.15.52:6789/0 conn(0x7fa4540b9170 legacy=0x7fa45406cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:16.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.004+0000 7fa4537fe700 1 --2- 172.21.15.52:0/791291143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa444003a30 0x7fa444003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:16.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.004+0000 7fa4537fe700 1 --2- 172.21.15.52:0/791291143 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4540be840 0x7fa444004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:16.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.004+0000 7fa4537fe700 1 --2- 172.21.15.52:0/791291143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa444004d90 0x7fa444005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:16.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.004+0000 7fa4537fe700 1 -- 172.21.15.52:0/791291143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45406b6c0 con 0x7fa444003a30 2023-06-23T18:45:16.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.004+0000 7fa4537fe700 1 -- 172.21.15.52:0/791291143 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa44400ba10 con 0x7fa444004d90 2023-06-23T18:45:16.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.004+0000 7fa4537fe700 1 -- 172.21.15.52:0/791291143 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44400bbd0 con 0x7fa4540be840 2023-06-23T18:45:16.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.004+0000 7fa4588a6700 1 --2- 172.21.15.52:0/791291143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa444003a30 0x7fa444003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:16.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.004+0000 7fa453fff700 1 --2- 172.21.15.52:0/791291143 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4540be840 0x7fa444004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:16.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.004+0000 7fa4590a7700 1 --2- 172.21.15.52:0/791291143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa444004d90 0x7fa444005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:16.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.004+0000 7fa4588a6700 1 -- 172.21.15.52:0/791291143 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4540be840 msgr2=0x7fa444004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:16.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.004+0000 7fa4588a6700 1 --2- 172.21.15.52:0/791291143 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa4540be840 0x7fa444004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.004+0000 7fa4588a6700 1 -- 172.21.15.52:0/791291143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa444004d90 msgr2=0x7fa444005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:16.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.004+0000 7fa4588a6700 1 --2- 172.21.15.52:0/791291143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa444004d90 0x7fa444005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.004+0000 7fa4588a6700 1 -- 172.21.15.52:0/791291143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4440035b0 con 0x7fa444003a30 2023-06-23T18:45:16.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.004+0000 7fa4590a7700 1 --2- 172.21.15.52:0/791291143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa444004d90 0x7fa444005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:16.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.004+0000 7fa4588a6700 1 --2- 172.21.15.52:0/791291143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa444003a30 0x7fa444003e00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa4480018b0 tx=0x7fa444005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ebc2e62ee4c1eb server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:16.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.005+0000 7fa4537fe700 1 -- 172.21.15.52:0/791291143 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa448001370 con 0x7fa444003a30 2023-06-23T18:45:16.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.005+0000 7fa4537fe700 1 -- 172.21.15.52:0/791291143 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44800c6b0 con 0x7fa444003a30 2023-06-23T18:45:16.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.005+0000 7fa4537fe700 1 -- 172.21.15.52:0/791291143 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44800ca60 con 0x7fa444003a30 2023-06-23T18:45:16.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.005+0000 7fa45ab0a700 1 -- 172.21.15.52:0/791291143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa444003a30 msgr2=0x7fa444003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:16.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.005+0000 7fa45ab0a700 1 --2- 172.21.15.52:0/791291143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa444003a30 0x7fa444003e00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa4480018b0 tx=0x7fa444005880 comp rx=0 tx=0).stop 2023-06-23T18:45:16.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.005+0000 7fa4590a7700 1 -- 172.21.15.52:0/791291143 reap_dead start 2023-06-23T18:45:16.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.005+0000 7fa45ab0a700 1 -- 172.21.15.52:0/791291143 shutdown_connections 2023-06-23T18:45:16.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.005+0000 7fa45ab0a700 1 -- 172.21.15.52:0/791291143 >> 172.21.15.52:0/791291143 conn(0x7fa454071410 msgr2=0x7fa454071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:16.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.005+0000 7fa45ab0a700 1 -- 172.21.15.52:0/791291143 shutdown_connections 2023-06-23T18:45:16.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.005+0000 7fa45ab0a700 1 -- 172.21.15.52:0/791291143 wait complete. 2023-06-23T18:45:16.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.006+0000 7fa45ab0a700 1 Processor -- start 2023-06-23T18:45:16.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.006+0000 7fa45ab0a700 1 -- start start 2023-06-23T18:45:16.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.007+0000 7fa45ab0a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa444003a30 0x7fa454147390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:16.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.007+0000 7fa45ab0a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4541461b0 0x7fa454145310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:16.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.007+0000 7fa45ab0a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa454145850 0x7fa4541e04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:16.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.007+0000 7fa45ab0a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4541414c0 con 0x7fa4541461b0 2023-06-23T18:45:16.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.007+0000 7fa45ab0a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4541dfed0 con 0x7fa454145850 2023-06-23T18:45:16.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.007+0000 7fa45ab0a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4540ad790 con 0x7fa444003a30 2023-06-23T18:45:16.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.007+0000 7fa453fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4541461b0 0x7fa454145310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:16.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.007+0000 7fa453fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4541461b0 0x7fa454145310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56766/0 (socket says 172.21.15.52:56766) 2023-06-23T18:45:16.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.007+0000 7fa453fff700 1 -- 172.21.15.52:0/1647879859 learned_addr learned my addr 172.21.15.52:0/1647879859 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:16.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.007+0000 7fa4588a6700 1 --2- 172.21.15.52:0/1647879859 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa444003a30 0x7fa454147390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:16.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.007+0000 7fa4590a7700 1 --2- 172.21.15.52:0/1647879859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa454145850 0x7fa4541e04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:16.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.007+0000 7fa453fff700 1 -- 172.21.15.52:0/1647879859 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa444003a30 msgr2=0x7fa454147390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:16.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.008+0000 7fa453fff700 1 --2- 172.21.15.52:0/1647879859 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa444003a30 0x7fa454147390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.008+0000 7fa453fff700 1 -- 172.21.15.52:0/1647879859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa454145850 msgr2=0x7fa4541e04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:16.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.008+0000 7fa453fff700 1 --2- 172.21.15.52:0/1647879859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa454145850 0x7fa4541e04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.008+0000 7fa453fff700 1 -- 172.21.15.52:0/1647879859 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa454144e60 con 0x7fa4541461b0 2023-06-23T18:45:16.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.008+0000 7fa4590a7700 1 --2- 172.21.15.52:0/1647879859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa454145850 0x7fa4541e04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:45:16.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.008+0000 7fa453fff700 1 --2- 172.21.15.52:0/1647879859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4541461b0 0x7fa454145310 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa4400017a0 tx=0x7fa440007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:16.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.008+0000 7fa4517fa700 1 -- 172.21.15.52:0/1647879859 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44000f6c0 con 0x7fa4541461b0 2023-06-23T18:45:16.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.008+0000 7fa4517fa700 1 -- 172.21.15.52:0/1647879859 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44000f820 con 0x7fa4541461b0 2023-06-23T18:45:16.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.008+0000 7fa4517fa700 1 -- 172.21.15.52:0/1647879859 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44000fbd0 con 0x7fa4541461b0 2023-06-23T18:45:16.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.008+0000 7fa45ab0a700 1 -- 172.21.15.52:0/1647879859 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4540ae460 con 0x7fa4541461b0 2023-06-23T18:45:16.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.008+0000 7fa45ab0a700 1 -- 172.21.15.52:0/1647879859 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa454147ba0 con 0x7fa4541461b0 2023-06-23T18:45:16.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.009+0000 7fa45ab0a700 1 -- 172.21.15.52:0/1647879859 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa45404e1d0 con 0x7fa4541461b0 2023-06-23T18:45:16.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.010+0000 7fa4517fa700 1 -- 172.21.15.52:0/1647879859 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa44000fd30 con 0x7fa4541461b0 2023-06-23T18:45:16.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.010+0000 7fa4517fa700 1 --2- 172.21.15.52:0/1647879859 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa43806ace0 0x7fa43806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:16.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.010+0000 7fa4517fa700 1 -- 172.21.15.52:0/1647879859 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa4400894a0 con 0x7fa4541461b0 2023-06-23T18:45:16.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.010+0000 7fa4588a6700 1 --2- 172.21.15.52:0/1647879859 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa43806ace0 0x7fa43806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:16.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.011+0000 7fa4588a6700 1 --2- 172.21.15.52:0/1647879859 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa43806ace0 0x7fa43806d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa4480018b0 tx=0x7fa448005040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:16.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.015+0000 7fa4517fa700 1 -- 172.21.15.52:0/1647879859 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa440058070 con 0x7fa4541461b0 2023-06-23T18:45:16.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.208+0000 7fa45ab0a700 1 -- 172.21.15.52:0/1647879859 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa454144ff0 con 0x7fa4541461b0 2023-06-23T18:45:16.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.209+0000 7fa4517fa700 1 -- 172.21.15.52:0/1647879859 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa440057c00 con 0x7fa4541461b0 2023-06-23T18:45:16.214 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-06-23T18:45:16.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.211+0000 7fa45ab0a700 1 -- 172.21.15.52:0/1647879859 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa43806ace0 msgr2=0x7fa43806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.211+0000 7fa45ab0a700 1 --2- 172.21.15.52:0/1647879859 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa43806ace0 0x7fa43806d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa4480018b0 tx=0x7fa448005040 comp rx=0 tx=0).stop 2023-06-23T18:45:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.211+0000 7fa45ab0a700 1 -- 172.21.15.52:0/1647879859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4541461b0 msgr2=0x7fa454145310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.211+0000 7fa45ab0a700 1 --2- 172.21.15.52:0/1647879859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4541461b0 0x7fa454145310 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa4400017a0 tx=0x7fa440007620 comp rx=0 tx=0).stop 2023-06-23T18:45:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.211+0000 7fa45ab0a700 1 -- 172.21.15.52:0/1647879859 shutdown_connections 2023-06-23T18:45:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.211+0000 7fa45ab0a700 1 --2- 172.21.15.52:0/1647879859 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa43806ace0 0x7fa43806d190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.211+0000 7fa45ab0a700 1 --2- 172.21.15.52:0/1647879859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa454145850 0x7fa4541e04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.211+0000 7fa45ab0a700 1 --2- 172.21.15.52:0/1647879859 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa444003a30 0x7fa454147390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.211+0000 7fa45ab0a700 1 --2- 172.21.15.52:0/1647879859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4541461b0 0x7fa454145310 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.211+0000 7fa45ab0a700 1 -- 172.21.15.52:0/1647879859 >> 172.21.15.52:0/1647879859 conn(0x7fa454071410 msgr2=0x7fa4541427e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:16.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.211+0000 7fa45ab0a700 1 -- 172.21.15.52:0/1647879859 shutdown_connections 2023-06-23T18:45:16.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.211+0000 7fa45ab0a700 1 -- 172.21.15.52:0/1647879859 wait complete. 2023-06-23T18:45:16.227 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T18:45:16.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.352+0000 7fc971ab8700 1 Processor -- start 2023-06-23T18:45:16.357 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.352+0000 7fc971ab8700 1 -- start start 2023-06-23T18:45:16.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.353+0000 7fc971ab8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc96c14b170 0x7fc96c0ba4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:16.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.353+0000 7fc971ab8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc96c0a5bf0 0x7fc96c0b8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:16.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.353+0000 7fc971ab8700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc96c14dc20 0x7fc96c14e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:16.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.353+0000 7fc971ab8700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96c069ef0 con 0x7fc96c14dc20 2023-06-23T18:45:16.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.353+0000 7fc971ab8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96c06a1d0 con 0x7fc96c14b170 2023-06-23T18:45:16.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.353+0000 7fc971ab8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c06a4b0 con 0x7fc96c0a5bf0 2023-06-23T18:45:16.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.353+0000 7fc96bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc96c14dc20 0x7fc96c14e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:16.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.353+0000 7fc96bfff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc96c14dc20 0x7fc96c14e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56770/0 (socket says 172.21.15.52:56770) 2023-06-23T18:45:16.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.353+0000 7fc96bfff700 1 -- 172.21.15.52:0/2004412141 learned_addr learned my addr 172.21.15.52:0/2004412141 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:16.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.353+0000 7fc963fff700 1 --2- 172.21.15.52:0/2004412141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc96c0a5bf0 0x7fc96c0b8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:16.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.353+0000 7fc96b7fe700 1 --2- 172.21.15.52:0/2004412141 >> v2:172.21.15.89:3300/0 conn(0x7fc96c14b170 0x7fc96c0ba4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:16.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.353+0000 7fc96bfff700 1 -- 172.21.15.52:0/2004412141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc96c0a5bf0 msgr2=0x7fc96c0b8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:16.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.353+0000 7fc96bfff700 1 --2- 172.21.15.52:0/2004412141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc96c0a5bf0 0x7fc96c0b8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.353+0000 7fc96bfff700 1 -- 172.21.15.52:0/2004412141 >> v2:172.21.15.89:3300/0 conn(0x7fc96c14b170 msgr2=0x7fc96c0ba4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:16.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.353+0000 7fc96bfff700 1 --2- 172.21.15.52:0/2004412141 >> v2:172.21.15.89:3300/0 conn(0x7fc96c14b170 0x7fc96c0ba4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.353+0000 7fc96bfff700 1 -- 172.21.15.52:0/2004412141 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c06a790 con 0x7fc96c14dc20 2023-06-23T18:45:16.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.353+0000 7fc96bfff700 1 --2- 172.21.15.52:0/2004412141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc96c14dc20 0x7fc96c14e0c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0c17f0 tx=0x7fc96400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17149f873998ccff server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:16.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.353+0000 7fc96affd700 1 -- 172.21.15.52:0/2004412141 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96400e070 con 0x7fc96c14dc20 2023-06-23T18:45:16.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.353+0000 7fc96affd700 1 -- 172.21.15.52:0/2004412141 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96400b9c0 con 0x7fc96c14dc20 2023-06-23T18:45:16.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.353+0000 7fc96affd700 1 -- 172.21.15.52:0/2004412141 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96400bd70 con 0x7fc96c14dc20 2023-06-23T18:45:16.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.354+0000 7fc971ab8700 1 -- 172.21.15.52:0/2004412141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc96c14dc20 msgr2=0x7fc96c14e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:16.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.354+0000 7fc971ab8700 1 --2- 172.21.15.52:0/2004412141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc96c14dc20 0x7fc96c14e0c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0c17f0 tx=0x7fc96400b330 comp rx=0 tx=0).stop 2023-06-23T18:45:16.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.354+0000 7fc971ab8700 1 -- 172.21.15.52:0/2004412141 shutdown_connections 2023-06-23T18:45:16.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.354+0000 7fc971ab8700 1 --2- 172.21.15.52:0/2004412141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc96c14dc20 0x7fc96c14e0c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.354+0000 7fc971ab8700 1 --2- 172.21.15.52:0/2004412141 >> v2:172.21.15.89:3300/0 conn(0x7fc96c14b170 0x7fc96c0ba4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.354+0000 7fc971ab8700 1 --2- 172.21.15.52:0/2004412141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc96c0a5bf0 0x7fc96c0b8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.354+0000 7fc971ab8700 1 -- 172.21.15.52:0/2004412141 >> 172.21.15.52:0/2004412141 conn(0x7fc96c0c06f0 msgr2=0x7fc96c0c0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:16.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.354+0000 7fc971ab8700 1 -- 172.21.15.52:0/2004412141 shutdown_connections 2023-06-23T18:45:16.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.354+0000 7fc971ab8700 1 -- 172.21.15.52:0/2004412141 wait complete. 2023-06-23T18:45:16.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.355+0000 7fc971ab8700 1 Processor -- start 2023-06-23T18:45:16.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.355+0000 7fc971ab8700 1 -- start start 2023-06-23T18:45:16.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.356+0000 7fc971ab8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc96c0a5bf0 0x7fc96c142900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:16.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.356+0000 7fc971ab8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc96c14b170 0x7fc96c1e0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:16.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.356+0000 7fc971ab8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc96c14dc20 0x7fc96c0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:16.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.356+0000 7fc971ab8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c14d2e0 con 0x7fc96c0a5bf0 2023-06-23T18:45:16.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.356+0000 7fc971ab8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c142e40 con 0x7fc96c14b170 2023-06-23T18:45:16.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.356+0000 7fc971ab8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c14b810 con 0x7fc96c14dc20 2023-06-23T18:45:16.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.356+0000 7fc96b7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc96c0a5bf0 0x7fc96c142900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:16.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.356+0000 7fc96b7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc96c0a5bf0 0x7fc96c142900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56780/0 (socket says 172.21.15.52:56780) 2023-06-23T18:45:16.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.356+0000 7fc96b7fe700 1 -- 172.21.15.52:0/291073795 learned_addr learned my addr 172.21.15.52:0/291073795 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:16.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.356+0000 7fc96bfff700 1 --2- 172.21.15.52:0/291073795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc96c14dc20 0x7fc96c0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:16.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.356+0000 7fc963fff700 1 --2- 172.21.15.52:0/291073795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc96c14b170 0x7fc96c1e0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:16.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.356+0000 7fc96b7fe700 1 -- 172.21.15.52:0/291073795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc96c14dc20 msgr2=0x7fc96c0b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:16.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.356+0000 7fc96b7fe700 1 --2- 172.21.15.52:0/291073795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc96c14dc20 0x7fc96c0b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.356+0000 7fc96b7fe700 1 -- 172.21.15.52:0/291073795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc96c14b170 msgr2=0x7fc96c1e0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:16.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.356+0000 7fc96b7fe700 1 --2- 172.21.15.52:0/291073795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc96c14b170 0x7fc96c1e0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.356+0000 7fc96b7fe700 1 -- 172.21.15.52:0/291073795 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc964009b30 con 0x7fc96c0a5bf0 2023-06-23T18:45:16.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.356+0000 7fc963fff700 1 --2- 172.21.15.52:0/291073795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc96c14b170 0x7fc96c1e0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:45:16.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.356+0000 7fc96b7fe700 1 --2- 172.21.15.52:0/291073795 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc96c0a5bf0 0x7fc96c142900 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00e840 tx=0x7fc95c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:16.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.356+0000 7fc968ff9700 1 -- 172.21.15.52:0/291073795 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c013610 con 0x7fc96c0a5bf0 2023-06-23T18:45:16.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.357+0000 7fc968ff9700 1 -- 172.21.15.52:0/291073795 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c013770 con 0x7fc96c0a5bf0 2023-06-23T18:45:16.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.357+0000 7fc971ab8700 1 -- 172.21.15.52:0/291073795 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96c1e3e00 con 0x7fc96c0a5bf0 2023-06-23T18:45:16.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.357+0000 7fc968ff9700 1 -- 172.21.15.52:0/291073795 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c013b20 con 0x7fc96c0a5bf0 2023-06-23T18:45:16.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.357+0000 7fc971ab8700 1 -- 172.21.15.52:0/291073795 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96c1e3b20 con 0x7fc96c0a5bf0 2023-06-23T18:45:16.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.358+0000 7fc971ab8700 1 -- 172.21.15.52:0/291073795 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96c04e1d0 con 0x7fc96c0a5bf0 2023-06-23T18:45:16.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.358+0000 7fc968ff9700 1 -- 172.21.15.52:0/291073795 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc95c013c80 con 0x7fc96c0a5bf0 2023-06-23T18:45:16.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.358+0000 7fc968ff9700 1 --2- 172.21.15.52:0/291073795 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc94c06ad10 0x7fc94c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:16.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.359+0000 7fc968ff9700 1 -- 172.21.15.52:0/291073795 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc95c089090 con 0x7fc96c0a5bf0 2023-06-23T18:45:16.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.359+0000 7fc963fff700 1 --2- 172.21.15.52:0/291073795 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc94c06ad10 0x7fc94c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:16.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.359+0000 7fc963fff700 1 --2- 172.21.15.52:0/291073795 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc94c06ad10 0x7fc94c06d1c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0b78b0 tx=0x7fc954008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:16.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.363+0000 7fc968ff9700 1 -- 172.21.15.52:0/291073795 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc95c057bd0 con 0x7fc96c0a5bf0 2023-06-23T18:45:16.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.559+0000 7fc971ab8700 1 -- 172.21.15.52:0/291073795 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc96c06b030 con 0x7fc96c0a5bf0 2023-06-23T18:45:16.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.559+0000 7fc968ff9700 1 -- 172.21.15.52:0/291073795 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc95c057760 con 0x7fc96c0a5bf0 2023-06-23T18:45:16.565 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2023-06-23T18:45:16.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.562+0000 7fc971ab8700 1 -- 172.21.15.52:0/291073795 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc94c06ad10 msgr2=0x7fc94c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:16.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.562+0000 7fc971ab8700 1 --2- 172.21.15.52:0/291073795 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc94c06ad10 0x7fc94c06d1c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0b78b0 tx=0x7fc954008040 comp rx=0 tx=0).stop 2023-06-23T18:45:16.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.562+0000 7fc971ab8700 1 -- 172.21.15.52:0/291073795 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc96c0a5bf0 msgr2=0x7fc96c142900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:16.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.562+0000 7fc971ab8700 1 --2- 172.21.15.52:0/291073795 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc96c0a5bf0 0x7fc96c142900 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00e840 tx=0x7fc95c00ec00 comp rx=0 tx=0).stop 2023-06-23T18:45:16.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.562+0000 7fc971ab8700 1 -- 172.21.15.52:0/291073795 shutdown_connections 2023-06-23T18:45:16.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.562+0000 7fc971ab8700 1 --2- 172.21.15.52:0/291073795 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc94c06ad10 0x7fc94c06d1c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.562+0000 7fc971ab8700 1 --2- 172.21.15.52:0/291073795 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc96c14dc20 0x7fc96c0b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.562+0000 7fc971ab8700 1 --2- 172.21.15.52:0/291073795 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc96c0a5bf0 0x7fc96c142900 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.562+0000 7fc971ab8700 1 --2- 172.21.15.52:0/291073795 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc96c14b170 0x7fc96c1e0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.562+0000 7fc971ab8700 1 -- 172.21.15.52:0/291073795 >> 172.21.15.52:0/291073795 conn(0x7fc96c0c06f0 msgr2=0x7fc96c0c0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:16.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.562+0000 7fc971ab8700 1 -- 172.21.15.52:0/291073795 shutdown_connections 2023-06-23T18:45:16.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.562+0000 7fc971ab8700 1 -- 172.21.15.52:0/291073795 wait complete. 2023-06-23T18:45:16.578 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T18:45:16.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.702+0000 7f2bd39ec700 1 Processor -- start 2023-06-23T18:45:16.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.702+0000 7f2bd39ec700 1 -- start start 2023-06-23T18:45:16.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.703+0000 7f2bd39ec700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2bcc0b9100 0x7f2bcc14a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:16.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.703+0000 7f2bd39ec700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2bcc0b8660 0x7f2bcc06af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:16.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.703+0000 7f2bd39ec700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bcc070f20 con 0x7f2bcc0b5fe0 2023-06-23T18:45:16.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.703+0000 7f2bd39ec700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bcc141a50 con 0x7f2bcc0b9100 2023-06-23T18:45:16.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.703+0000 7f2bd39ec700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bcc0b6aa0 con 0x7f2bcc0b8660 2023-06-23T18:45:16.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.704+0000 7f2bd0f87700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f2bcc0b9100 0x7f2bcc14a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:16.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.704+0000 7f2bd1788700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2bcc0b5fe0 0x7f2bcc071690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37878/0 (socket says 172.21.15.52:37878) 2023-06-23T18:45:16.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.704+0000 7f2bd1788700 1 -- 172.21.15.52:0/2778000700 learned_addr learned my addr 172.21.15.52:0/2778000700 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:16.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.704+0000 7f2bd1f89700 1 --2- 172.21.15.52:0/2778000700 >> v2:172.21.15.89:3300/0 conn(0x7f2bcc0b8660 0x7f2bcc06af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:16.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.704+0000 7f2bc3fff700 1 -- 172.21.15.52:0/2778000700 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 197057806 0 0) 0x7f2bcc070f20 con 0x7f2bcc0b5fe0 2023-06-23T18:45:16.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.704+0000 7f2bc3fff700 1 -- 172.21.15.52:0/2778000700 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bb80057c0 con 0x7f2bcc0b5fe0 2023-06-23T18:45:16.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.704+0000 7f2bd0f87700 1 -- 172.21.15.52:0/2778000700 >> v2:172.21.15.89:3300/0 conn(0x7f2bcc0b8660 msgr2=0x7f2bcc06af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:16.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.704+0000 7f2bd0f87700 1 --2- 172.21.15.52:0/2778000700 >> v2:172.21.15.89:3300/0 conn(0x7f2bcc0b8660 0x7f2bcc06af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.704+0000 7f2bd0f87700 1 -- 172.21.15.52:0/2778000700 >> v1:172.21.15.52:6789/0 conn(0x7f2bcc0b5fe0 legacy=0x7f2bcc071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:16.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.704+0000 7f2bd0f87700 1 -- 172.21.15.52:0/2778000700 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bcc0b6d80 con 0x7f2bcc0b9100 2023-06-23T18:45:16.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.704+0000 7f2bd0f87700 1 --2- 172.21.15.52:0/2778000700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bcc0b9100 0x7f2bcc14a7b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc14b8b0 tx=0x7f2bbc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee9a910e90ec2093 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:16.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.704+0000 7f2bc3fff700 1 -- 172.21.15.52:0/2778000700 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc011830 con 0x7f2bcc0b9100 2023-06-23T18:45:16.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.704+0000 7f2bc3fff700 1 -- 172.21.15.52:0/2778000700 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bbc011990 con 0x7f2bcc0b9100 2023-06-23T18:45:16.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.704+0000 7f2bc3fff700 1 -- 172.21.15.52:0/2778000700 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc011d20 con 0x7f2bcc0b9100 2023-06-23T18:45:16.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.705+0000 7f2bd39ec700 1 -- 172.21.15.52:0/2778000700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bcc0b9100 msgr2=0x7f2bcc14a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:16.713 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.705+0000 7f2bd39ec700 1 --2- 172.21.15.52:0/2778000700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bcc0b9100 0x7f2bcc14a7b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc14b8b0 tx=0x7f2bbc009b20 comp rx=0 tx=0).stop 2023-06-23T18:45:16.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.705+0000 7f2bd39ec700 1 -- 172.21.15.52:0/2778000700 shutdown_connections 2023-06-23T18:45:16.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.705+0000 7f2bd39ec700 1 --2- 172.21.15.52:0/2778000700 >> v2:172.21.15.89:3300/0 conn(0x7f2bcc0b8660 0x7f2bcc06af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.705+0000 7f2bd39ec700 1 --2- 172.21.15.52:0/2778000700 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bcc0b9100 0x7f2bcc14a7b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.705+0000 7f2bd39ec700 1 -- 172.21.15.52:0/2778000700 >> 172.21.15.52:0/2778000700 conn(0x7f2bcc06d250 msgr2=0x7f2bcc06d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:16.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.705+0000 7f2bd39ec700 1 -- 172.21.15.52:0/2778000700 shutdown_connections 2023-06-23T18:45:16.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.705+0000 7f2bd39ec700 1 -- 172.21.15.52:0/2778000700 wait complete. 2023-06-23T18:45:16.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.706+0000 7f2bd39ec700 1 Processor -- start 2023-06-23T18:45:16.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.706+0000 7f2bd39ec700 1 -- start start 2023-06-23T18:45:16.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.707+0000 7f2bd39ec700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bcc0b5fe0 0x7f2bcc143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:16.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.707+0000 7f2bd39ec700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bcc0b8660 0x7f2bcc144280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:16.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.707+0000 7f2bd39ec700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bcc0b9100 0x7f2bcc1db470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:16.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.707+0000 7f2bd39ec700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bcc143110 con 0x7f2bcc0b5fe0 2023-06-23T18:45:16.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.707+0000 7f2bd39ec700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bcc142250 con 0x7f2bcc0b9100 2023-06-23T18:45:16.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.707+0000 7f2bd39ec700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bcc142530 con 0x7f2bcc0b8660 2023-06-23T18:45:16.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.707+0000 7f2bd1788700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bcc0b5fe0 0x7f2bcc143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:16.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.707+0000 7f2bd1788700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bcc0b5fe0 0x7f2bcc143d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56804/0 (socket says 172.21.15.52:56804) 2023-06-23T18:45:16.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.707+0000 7f2bd1788700 1 -- 172.21.15.52:0/4158999948 learned_addr learned my addr 172.21.15.52:0/4158999948 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:16.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.707+0000 7f2bd0f87700 1 --2- 172.21.15.52:0/4158999948 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bcc0b8660 0x7f2bcc144280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:16.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.707+0000 7f2bd1f89700 1 --2- 172.21.15.52:0/4158999948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bcc0b9100 0x7f2bcc1db470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:16.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.707+0000 7f2bd1788700 1 -- 172.21.15.52:0/4158999948 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bcc0b8660 msgr2=0x7f2bcc144280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:16.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.707+0000 7f2bd1788700 1 --2- 172.21.15.52:0/4158999948 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bcc0b8660 0x7f2bcc144280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.707+0000 7f2bd1788700 1 -- 172.21.15.52:0/4158999948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bcc0b9100 msgr2=0x7f2bcc1db470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:16.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.707+0000 7f2bd1788700 1 --2- 172.21.15.52:0/4158999948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bcc0b9100 0x7f2bcc1db470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.707+0000 7f2bd1788700 1 -- 172.21.15.52:0/4158999948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bbc0094a0 con 0x7f2bcc0b5fe0 2023-06-23T18:45:16.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.707+0000 7f2bd1788700 1 --2- 172.21.15.52:0/4158999948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bcc0b5fe0 0x7f2bcc143d40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2bc800c700 tx=0x7f2bc800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:16.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.707+0000 7f2bc1ffb700 1 -- 172.21.15.52:0/4158999948 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8005d70 con 0x7f2bcc0b5fe0 2023-06-23T18:45:16.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.707+0000 7f2bc1ffb700 1 -- 172.21.15.52:0/4158999948 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc80070d0 con 0x7f2bcc0b5fe0 2023-06-23T18:45:16.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.707+0000 7f2bd39ec700 1 -- 172.21.15.52:0/4158999948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bcc142810 con 0x7f2bcc0b5fe0 2023-06-23T18:45:16.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.707+0000 7f2bc1ffb700 1 -- 172.21.15.52:0/4158999948 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8007460 con 0x7f2bcc0b5fe0 2023-06-23T18:45:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.708+0000 7f2bd39ec700 1 -- 172.21.15.52:0/4158999948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bcc145520 con 0x7f2bcc0b5fe0 2023-06-23T18:45:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.709+0000 7f2bd39ec700 1 -- 172.21.15.52:0/4158999948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bcc04e1d0 con 0x7f2bcc0b5fe0 2023-06-23T18:45:16.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.709+0000 7f2bc1ffb700 1 -- 172.21.15.52:0/4158999948 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2bc80075c0 con 0x7f2bcc0b5fe0 2023-06-23T18:45:16.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.710+0000 7f2bc1ffb700 1 --2- 172.21.15.52:0/4158999948 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2bb006ad10 0x7f2bb006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:16.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.710+0000 7f2bc1ffb700 1 -- 172.21.15.52:0/4158999948 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2bc80888c0 con 0x7f2bcc0b5fe0 2023-06-23T18:45:16.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.710+0000 7f2bd0f87700 1 --2- 172.21.15.52:0/4158999948 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2bb006ad10 0x7f2bb006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:16.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.710+0000 7f2bd0f87700 1 --2- 172.21.15.52:0/4158999948 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2bb006ad10 0x7f2bb006d1c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0b9500 tx=0x7f2bbc01c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:16.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.714+0000 7f2bc1ffb700 1 -- 172.21.15.52:0/4158999948 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2bc8053970 con 0x7f2bcc0b5fe0 2023-06-23T18:45:16.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.909+0000 7f2bd39ec700 1 -- 172.21.15.52:0/4158999948 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2bcc066920 con 0x7f2bcc0b5fe0 2023-06-23T18:45:16.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.909+0000 7f2bc1ffb700 1 -- 172.21.15.52:0/4158999948 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2bc80170a0 con 0x7f2bcc0b5fe0 2023-06-23T18:45:16.914 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-06-23T18:45:16.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.911+0000 7f2bd39ec700 1 -- 172.21.15.52:0/4158999948 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2bb006ad10 msgr2=0x7f2bb006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:16.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.911+0000 7f2bd39ec700 1 --2- 172.21.15.52:0/4158999948 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2bb006ad10 0x7f2bb006d1c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0b9500 tx=0x7f2bbc01c040 comp rx=0 tx=0).stop 2023-06-23T18:45:16.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.911+0000 7f2bd39ec700 1 -- 172.21.15.52:0/4158999948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bcc0b5fe0 msgr2=0x7f2bcc143d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:16.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.911+0000 7f2bd39ec700 1 --2- 172.21.15.52:0/4158999948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bcc0b5fe0 0x7f2bcc143d40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2bc800c700 tx=0x7f2bc800ca10 comp rx=0 tx=0).stop 2023-06-23T18:45:16.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.911+0000 7f2bd39ec700 1 -- 172.21.15.52:0/4158999948 shutdown_connections 2023-06-23T18:45:16.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.911+0000 7f2bd39ec700 1 --2- 172.21.15.52:0/4158999948 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2bb006ad10 0x7f2bb006d1c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.911+0000 7f2bd39ec700 1 --2- 172.21.15.52:0/4158999948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2bcc0b9100 0x7f2bcc1db470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.911+0000 7f2bd39ec700 1 --2- 172.21.15.52:0/4158999948 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2bcc0b5fe0 0x7f2bcc143d40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.911+0000 7f2bd39ec700 1 --2- 172.21.15.52:0/4158999948 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2bcc0b8660 0x7f2bcc144280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:16.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.911+0000 7f2bd39ec700 1 -- 172.21.15.52:0/4158999948 >> 172.21.15.52:0/4158999948 conn(0x7f2bcc06d250 msgr2=0x7f2bcc06f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:16.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.911+0000 7f2bd39ec700 1 -- 172.21.15.52:0/4158999948 shutdown_connections 2023-06-23T18:45:16.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:16.911+0000 7f2bd39ec700 1 -- 172.21.15.52:0/4158999948 wait complete. 2023-06-23T18:45:17.004 INFO:tasks.cephfs_test_runner:Starting test: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-06-23T18:45:17.006 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2023-06-23T18:45:17.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.128+0000 7f75cbe84700 1 Processor -- start 2023-06-23T18:45:17.133 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.128+0000 7f75cbe84700 1 -- start start 2023-06-23T18:45:17.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.129+0000 7f75cbe84700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75c406c250 0x7f75c40708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:17.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.129+0000 7f75cbe84700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75c4070e10 0x7f75c4154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:17.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.129+0000 7f75cbe84700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c40b8e90 con 0x7f75c4071570 2023-06-23T18:45:17.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.129+0000 7f75cbe84700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75c40b9240 con 0x7f75c4070e10 2023-06-23T18:45:17.135 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.129+0000 7f75cbe84700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c40b94c0 con 0x7f75c406c250 2023-06-23T18:45:17.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.129+0000 7f75ca421700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75c4070e10 0x7f75c4154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:17.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.129+0000 7f75ca421700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75c4070e10 0x7f75c4154bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56808/0 (socket says 172.21.15.52:56808) 2023-06-23T18:45:17.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.129+0000 7f75ca421700 1 -- 172.21.15.52:0/1009188859 learned_addr learned my addr 172.21.15.52:0/1009188859 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:17.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.129+0000 7f75c9c20700 1 --2- 172.21.15.52:0/1009188859 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75c406c250 0x7f75c40708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:17.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.129+0000 7f75ca421700 1 -- 172.21.15.52:0/1009188859 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75c406c250 msgr2=0x7f75c40708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:17.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.129+0000 7f75ca421700 1 --2- 172.21.15.52:0/1009188859 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75c406c250 0x7f75c40708d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:17.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.129+0000 7f75ca421700 1 -- 172.21.15.52:0/1009188859 >> v1:172.21.15.89:6789/0 conn(0x7f75c4071570 legacy=0x7f75c4144190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:17.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.129+0000 7f75ca421700 1 -- 172.21.15.52:0/1009188859 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c40b97a0 con 0x7f75c4070e10 2023-06-23T18:45:17.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.129+0000 7f75ca421700 1 --2- 172.21.15.52:0/1009188859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75c4070e10 0x7f75c4154bd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f75bc009e50 tx=0x7f75bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222cc3bf491bf890 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:17.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.129+0000 7f75c8c1e700 1 -- 172.21.15.52:0/1009188859 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc00e070 con 0x7f75c4070e10 2023-06-23T18:45:17.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.130+0000 7f75c8c1e700 1 -- 172.21.15.52:0/1009188859 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc003a20 con 0x7f75c4070e10 2023-06-23T18:45:17.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.130+0000 7f75c8c1e700 1 -- 172.21.15.52:0/1009188859 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc003dd0 con 0x7f75c4070e10 2023-06-23T18:45:17.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.130+0000 7f75cbe84700 1 -- 172.21.15.52:0/1009188859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75c4070e10 msgr2=0x7f75c4154bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:17.137 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.130+0000 7f75cbe84700 1 --2- 172.21.15.52:0/1009188859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75c4070e10 0x7f75c4154bd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f75bc009e50 tx=0x7f75bc00b330 comp rx=0 tx=0).stop 2023-06-23T18:45:17.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.130+0000 7f75cbe84700 1 -- 172.21.15.52:0/1009188859 shutdown_connections 2023-06-23T18:45:17.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.130+0000 7f75cbe84700 1 --2- 172.21.15.52:0/1009188859 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75c4070e10 0x7f75c4154bd0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:17.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.130+0000 7f75cbe84700 1 --2- 172.21.15.52:0/1009188859 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75c406c250 0x7f75c40708d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:17.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.130+0000 7f75cbe84700 1 -- 172.21.15.52:0/1009188859 >> 172.21.15.52:0/1009188859 conn(0x7f75c40bdf70 msgr2=0x7f75c40b9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:17.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.130+0000 7f75cbe84700 1 -- 172.21.15.52:0/1009188859 shutdown_connections 2023-06-23T18:45:17.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.130+0000 7f75cbe84700 1 -- 172.21.15.52:0/1009188859 wait complete. 2023-06-23T18:45:17.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.131+0000 7f75cbe84700 1 Processor -- start 2023-06-23T18:45:17.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.131+0000 7f75cbe84700 1 -- start start 2023-06-23T18:45:17.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.132+0000 7f75cbe84700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75c406c250 0x7f75c413ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:17.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.132+0000 7f75cbe84700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75c4070e10 0x7f75c41492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:17.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.132+0000 7f75cbe84700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75c4071570 0x7f75c4149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:17.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.132+0000 7f75cbe84700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c4149de0 con 0x7f75c4070e10 2023-06-23T18:45:17.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.132+0000 7f75cbe84700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c413cf90 con 0x7f75c4071570 2023-06-23T18:45:17.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.132+0000 7f75cbe84700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c4145a70 con 0x7f75c406c250 2023-06-23T18:45:17.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.132+0000 7f75c941f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75c4070e10 0x7f75c41492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:17.141 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.132+0000 7f75c941f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75c4070e10 0x7f75c41492e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56810/0 (socket says 172.21.15.52:56810) 2023-06-23T18:45:17.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.132+0000 7f75c941f700 1 -- 172.21.15.52:0/391499913 learned_addr learned my addr 172.21.15.52:0/391499913 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:17.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.132+0000 7f75c9c20700 1 --2- 172.21.15.52:0/391499913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75c406c250 0x7f75c413ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:17.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.132+0000 7f75ca421700 1 --2- 172.21.15.52:0/391499913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75c4071570 0x7f75c4149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:17.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.132+0000 7f75c941f700 1 -- 172.21.15.52:0/391499913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75c406c250 msgr2=0x7f75c413ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:17.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.132+0000 7f75c941f700 1 --2- 172.21.15.52:0/391499913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75c406c250 0x7f75c413ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:17.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.132+0000 7f75c941f700 1 -- 172.21.15.52:0/391499913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75c4071570 msgr2=0x7f75c4149820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:17.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.132+0000 7f75c941f700 1 --2- 172.21.15.52:0/391499913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75c4071570 0x7f75c4149820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:17.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.132+0000 7f75c941f700 1 -- 172.21.15.52:0/391499913 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc009b30 con 0x7f75c4070e10 2023-06-23T18:45:17.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.132+0000 7f75c941f700 1 --2- 172.21.15.52:0/391499913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75c4070e10 0x7f75c41492e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f75c000b480 tx=0x7f75c000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:17.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.133+0000 7f75ba7fc700 1 -- 172.21.15.52:0/391499913 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c0011830 con 0x7f75c4070e10 2023-06-23T18:45:17.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.133+0000 7f75ba7fc700 1 -- 172.21.15.52:0/391499913 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c0011990 con 0x7f75c4070e10 2023-06-23T18:45:17.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.133+0000 7f75cbe84700 1 -- 172.21.15.52:0/391499913 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c4149fc0 con 0x7f75c4070e10 2023-06-23T18:45:17.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.133+0000 7f75ba7fc700 1 -- 172.21.15.52:0/391499913 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c0011d40 con 0x7f75c4070e10 2023-06-23T18:45:17.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.133+0000 7f75cbe84700 1 -- 172.21.15.52:0/391499913 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c414a580 con 0x7f75c4070e10 2023-06-23T18:45:17.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.134+0000 7f75cbe84700 1 -- 172.21.15.52:0/391499913 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c406f830 con 0x7f75c4070e10 2023-06-23T18:45:17.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.134+0000 7f75ba7fc700 1 -- 172.21.15.52:0/391499913 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f75c001a400 con 0x7f75c4070e10 2023-06-23T18:45:17.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.135+0000 7f75ba7fc700 1 --2- 172.21.15.52:0/391499913 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f75a806ace0 0x7f75a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:17.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.135+0000 7f75ba7fc700 1 -- 172.21.15.52:0/391499913 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75c0089140 con 0x7f75c4070e10 2023-06-23T18:45:17.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.135+0000 7f75c9c20700 1 --2- 172.21.15.52:0/391499913 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f75a806ace0 0x7f75a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:17.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.135+0000 7f75c9c20700 1 --2- 172.21.15.52:0/391499913 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f75a806ace0 0x7f75a806d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009930 tx=0x7f75b4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:17.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.139+0000 7f75ba7fc700 1 -- 172.21.15.52:0/391499913 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f75c00542a0 con 0x7f75c4070e10 2023-06-23T18:45:17.420 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.415+0000 7f75cbe84700 1 -- 172.21.15.52:0/391499913 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) v1 -- 0x7f75c4141c20 con 0x7f75c4070e10 2023-06-23T18:45:17.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.855+0000 7f75ba7fc700 1 -- 172.21.15.52:0/391499913 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v44) v1 ==== 166+0+0 (secure 0 0 0) 0x7f75c00578c0 con 0x7f75c4070e10 2023-06-23T18:45:17.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.857+0000 7f75cbe84700 1 -- 172.21.15.52:0/391499913 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f75a806ace0 msgr2=0x7f75a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:17.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.857+0000 7f75cbe84700 1 --2- 172.21.15.52:0/391499913 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f75a806ace0 0x7f75a806d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009930 tx=0x7f75b4008040 comp rx=0 tx=0).stop 2023-06-23T18:45:17.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.857+0000 7f75cbe84700 1 -- 172.21.15.52:0/391499913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75c4070e10 msgr2=0x7f75c41492e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:17.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.857+0000 7f75cbe84700 1 --2- 172.21.15.52:0/391499913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75c4070e10 0x7f75c41492e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f75c000b480 tx=0x7f75c000b840 comp rx=0 tx=0).stop 2023-06-23T18:45:17.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.857+0000 7f75cbe84700 1 -- 172.21.15.52:0/391499913 shutdown_connections 2023-06-23T18:45:17.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.857+0000 7f75cbe84700 1 --2- 172.21.15.52:0/391499913 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f75a806ace0 0x7f75a806d190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:17.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.857+0000 7f75cbe84700 1 --2- 172.21.15.52:0/391499913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75c4071570 0x7f75c4149820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:17.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.857+0000 7f75cbe84700 1 --2- 172.21.15.52:0/391499913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75c406c250 0x7f75c413ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:17.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.857+0000 7f75cbe84700 1 --2- 172.21.15.52:0/391499913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75c4070e10 0x7f75c41492e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:17.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.857+0000 7f75cbe84700 1 -- 172.21.15.52:0/391499913 >> 172.21.15.52:0/391499913 conn(0x7f75c40bdf70 msgr2=0x7f75c41423c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:17.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.858+0000 7f75cbe84700 1 -- 172.21.15.52:0/391499913 shutdown_connections 2023-06-23T18:45:17.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:17.858+0000 7f75cbe84700 1 -- 172.21.15.52:0/391499913 wait complete. 2023-06-23T18:45:17.876 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-06-23T18:45:18.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.004+0000 7f59cb08a700 1 Processor -- start 2023-06-23T18:45:18.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.004+0000 7f59cb08a700 1 -- start start 2023-06-23T18:45:18.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.004+0000 7f59cb08a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59c40a5bf0 0x7f59c40b8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:18.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.004+0000 7f59cb08a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f59c4152f40 0x7f59c4155320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:18.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.004+0000 7f59cb08a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c4069ef0 con 0x7f59c414b170 2023-06-23T18:45:18.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.004+0000 7f59cb08a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c40babc0 con 0x7f59c4152f40 2023-06-23T18:45:18.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.004+0000 7f59cb08a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c406a1d0 con 0x7f59c40a5bf0 2023-06-23T18:45:18.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.005+0000 7f59c3fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59c40a5bf0 0x7f59c40b8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:18.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.005+0000 7f59c9627700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f59c4152f40 0x7f59c4155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:18.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.005+0000 7f59c3fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59c40a5bf0 0x7f59c40b8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.52:51924/0 (socket says 172.21.15.52:51924) 2023-06-23T18:45:18.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.005+0000 7f59c8e26700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f59c414b170 0x7f59c40ba4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.52:58988/0 (socket says 172.21.15.52:58988) 2023-06-23T18:45:18.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.005+0000 7f59c3fff700 1 -- 172.21.15.52:0/3091012541 learned_addr learned my addr 172.21.15.52:0/3091012541 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:18.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.005+0000 7f59c9627700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f59c4152f40 0x7f59c4155320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.52:35552/0 (socket says 172.21.15.52:35552) 2023-06-23T18:45:18.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.005+0000 7f59c9627700 1 -- 172.21.15.52:0/3091012541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59c40a5bf0 msgr2=0x7f59c40b8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:18.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.005+0000 7f59c9627700 1 --2- 172.21.15.52:0/3091012541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59c40a5bf0 0x7f59c40b8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:18.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.005+0000 7f59c9627700 1 -- 172.21.15.52:0/3091012541 >> v1:172.21.15.89:6789/0 conn(0x7f59c414b170 legacy=0x7f59c40ba4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:18.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.005+0000 7f59c9627700 1 -- 172.21.15.52:0/3091012541 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c406a4b0 con 0x7f59c4152f40 2023-06-23T18:45:18.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.005+0000 7f59c3fff700 1 --2- 172.21.15.52:0/3091012541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59c40a5bf0 0x7f59c40b8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:45:18.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.005+0000 7f59c9627700 1 --2- 172.21.15.52:0/3091012541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59c4152f40 0x7f59c4155320 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f59bc009d90 tx=0x7f59bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbe912a935ef4180 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:18.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.005+0000 7f59c37fe700 1 -- 172.21.15.52:0/3091012541 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc00e070 con 0x7f59c4152f40 2023-06-23T18:45:18.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.006+0000 7f59c37fe700 1 -- 172.21.15.52:0/3091012541 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59bc00bb20 con 0x7f59c4152f40 2023-06-23T18:45:18.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.006+0000 7f59c37fe700 1 -- 172.21.15.52:0/3091012541 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc012430 con 0x7f59c4152f40 2023-06-23T18:45:18.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.006+0000 7f59cb08a700 1 -- 172.21.15.52:0/3091012541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59c4152f40 msgr2=0x7f59c4155320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:18.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.006+0000 7f59cb08a700 1 --2- 172.21.15.52:0/3091012541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59c4152f40 0x7f59c4155320 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f59bc009d90 tx=0x7f59bc00b330 comp rx=0 tx=0).stop 2023-06-23T18:45:18.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.006+0000 7f59cb08a700 1 -- 172.21.15.52:0/3091012541 shutdown_connections 2023-06-23T18:45:18.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.006+0000 7f59cb08a700 1 --2- 172.21.15.52:0/3091012541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59c4152f40 0x7f59c4155320 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:18.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.006+0000 7f59cb08a700 1 --2- 172.21.15.52:0/3091012541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59c40a5bf0 0x7f59c40b8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:18.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.006+0000 7f59cb08a700 1 -- 172.21.15.52:0/3091012541 >> 172.21.15.52:0/3091012541 conn(0x7f59c40c06f0 msgr2=0x7f59c40c0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:18.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.006+0000 7f59cb08a700 1 -- 172.21.15.52:0/3091012541 shutdown_connections 2023-06-23T18:45:18.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.006+0000 7f59cb08a700 1 -- 172.21.15.52:0/3091012541 wait complete. 2023-06-23T18:45:18.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.007+0000 7f59cb08a700 1 Processor -- start 2023-06-23T18:45:18.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.007+0000 7f59cb08a700 1 -- start start 2023-06-23T18:45:18.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.008+0000 7f59cb08a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59c40a5bf0 0x7f59c41e0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:18.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.008+0000 7f59cb08a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59c414b170 0x7f59c41e0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:18.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.008+0000 7f59cb08a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c4152f40 0x7f59c40ae960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:18.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.008+0000 7f59cb08a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c40aeea0 con 0x7f59c4152f40 2023-06-23T18:45:18.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.008+0000 7f59cb08a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4147b20 con 0x7f59c414b170 2023-06-23T18:45:18.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.008+0000 7f59cb08a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c41dfa60 con 0x7f59c40a5bf0 2023-06-23T18:45:18.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.008+0000 7f59c9627700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c4152f40 0x7f59c40ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:18.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.008+0000 7f59c9627700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c4152f40 0x7f59c40ae960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56822/0 (socket says 172.21.15.52:56822) 2023-06-23T18:45:18.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.008+0000 7f59c9627700 1 -- 172.21.15.52:0/1421539898 learned_addr learned my addr 172.21.15.52:0/1421539898 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:18.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.008+0000 7f59c8e26700 1 --2- 172.21.15.52:0/1421539898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59c40a5bf0 0x7f59c41e0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:18.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.008+0000 7f59c3fff700 1 --2- 172.21.15.52:0/1421539898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59c414b170 0x7f59c41e0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:18.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.008+0000 7f59c9627700 1 -- 172.21.15.52:0/1421539898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59c40a5bf0 msgr2=0x7f59c41e0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:18.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.008+0000 7f59c9627700 1 --2- 172.21.15.52:0/1421539898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59c40a5bf0 0x7f59c41e0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:18.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.008+0000 7f59c9627700 1 -- 172.21.15.52:0/1421539898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59c414b170 msgr2=0x7f59c41e0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:18.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.008+0000 7f59c9627700 1 --2- 172.21.15.52:0/1421539898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59c414b170 0x7f59c41e0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:18.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.008+0000 7f59c9627700 1 -- 172.21.15.52:0/1421539898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b0009550 con 0x7f59c4152f40 2023-06-23T18:45:18.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.009+0000 7f59c9627700 1 --2- 172.21.15.52:0/1421539898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c4152f40 0x7f59c40ae960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f59bc014040 tx=0x7f59bc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:18.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.009+0000 7f59c17fa700 1 -- 172.21.15.52:0/1421539898 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc012430 con 0x7f59c4152f40 2023-06-23T18:45:18.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.009+0000 7f59c17fa700 1 -- 172.21.15.52:0/1421539898 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59bc020070 con 0x7f59c4152f40 2023-06-23T18:45:18.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.009+0000 7f59cb08a700 1 -- 172.21.15.52:0/1421539898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59bc009a70 con 0x7f59c4152f40 2023-06-23T18:45:18.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.009+0000 7f59c17fa700 1 -- 172.21.15.52:0/1421539898 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc003ea0 con 0x7f59c4152f40 2023-06-23T18:45:18.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.009+0000 7f59cb08a700 1 -- 172.21.15.52:0/1421539898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c41e0020 con 0x7f59c4152f40 2023-06-23T18:45:18.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.010+0000 7f59cb08a700 1 -- 172.21.15.52:0/1421539898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c41e01b0 con 0x7f59c4152f40 2023-06-23T18:45:18.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.010+0000 7f59c17fa700 1 -- 172.21.15.52:0/1421539898 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f59bc004040 con 0x7f59c4152f40 2023-06-23T18:45:18.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.010+0000 7f59c17fa700 1 --2- 172.21.15.52:0/1421539898 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f59a806ace0 0x7f59a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:18.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.011+0000 7f59c17fa700 1 -- 172.21.15.52:0/1421539898 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f59bc022070 con 0x7f59c4152f40 2023-06-23T18:45:18.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.011+0000 7f59c8e26700 1 --2- 172.21.15.52:0/1421539898 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f59a806ace0 0x7f59a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:18.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.011+0000 7f59c8e26700 1 --2- 172.21.15.52:0/1421539898 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f59a806ace0 0x7f59a806d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f59b8000f60 tx=0x7f59b8007ed0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:18.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.015+0000 7f59c17fa700 1 -- 172.21.15.52:0/1421539898 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f59bc0565b0 con 0x7f59c4152f40 2023-06-23T18:45:18.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.210+0000 7f59cb08a700 1 -- 172.21.15.52:0/1421539898 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f59c404e1d0 con 0x7f59c4152f40 2023-06-23T18:45:18.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.213+0000 7f59c17fa700 1 -- 172.21.15.52:0/1421539898 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f59bc059bd0 con 0x7f59c4152f40 2023-06-23T18:45:18.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.215+0000 7f59cb08a700 1 -- 172.21.15.52:0/1421539898 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f59a806ace0 msgr2=0x7f59a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:18.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.215+0000 7f59cb08a700 1 --2- 172.21.15.52:0/1421539898 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f59a806ace0 0x7f59a806d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f59b8000f60 tx=0x7f59b8007ed0 comp rx=0 tx=0).stop 2023-06-23T18:45:18.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.215+0000 7f59cb08a700 1 -- 172.21.15.52:0/1421539898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c4152f40 msgr2=0x7f59c40ae960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:18.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.215+0000 7f59cb08a700 1 --2- 172.21.15.52:0/1421539898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c4152f40 0x7f59c40ae960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f59bc014040 tx=0x7f59bc004ad0 comp rx=0 tx=0).stop 2023-06-23T18:45:18.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.215+0000 7f59cb08a700 1 -- 172.21.15.52:0/1421539898 shutdown_connections 2023-06-23T18:45:18.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.215+0000 7f59cb08a700 1 --2- 172.21.15.52:0/1421539898 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f59a806ace0 0x7f59a806d190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:18.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.215+0000 7f59cb08a700 1 --2- 172.21.15.52:0/1421539898 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f59c4152f40 0x7f59c40ae960 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:18.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.215+0000 7f59cb08a700 1 --2- 172.21.15.52:0/1421539898 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59c40a5bf0 0x7f59c41e0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:18.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.215+0000 7f59cb08a700 1 --2- 172.21.15.52:0/1421539898 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59c414b170 0x7f59c41e0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:18.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.215+0000 7f59cb08a700 1 -- 172.21.15.52:0/1421539898 >> 172.21.15.52:0/1421539898 conn(0x7f59c40c06f0 msgr2=0x7f59c40bf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:18.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.215+0000 7f59cb08a700 1 -- 172.21.15.52:0/1421539898 shutdown_connections 2023-06-23T18:45:18.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.215+0000 7f59cb08a700 1 -- 172.21.15.52:0/1421539898 wait complete. 2023-06-23T18:45:18.232 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-23T18:45:18.233 DEBUG:teuthology.orchestra.run.smithi052:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-23T18:45:18.306 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-23T18:45:18.387 DEBUG:teuthology.orchestra.run.smithi158:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-23T18:45:18.487 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-23T18:45:18.488 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-06-23T18:45:18.488 DEBUG:teuthology.orchestra.run.smithi158:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T18:45:18.534 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-06-23T18:45:18.535 DEBUG:teuthology.orchestra.run.smithi158:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T18:45:18.619 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-06-23T18:45:18.619 DEBUG:teuthology.orchestra.run.smithi158:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T18:45:18.704 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:45:18.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.830+0000 7f4340e23700 1 Processor -- start 2023-06-23T18:45:18.835 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.830+0000 7f4340e23700 1 -- start start 2023-06-23T18:45:18.836 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.831+0000 7f4340e23700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f433c1444a0 0x7f433c0b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:18.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.831+0000 7f4340e23700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f433c0b5a20 0x7f433c154da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:18.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.831+0000 7f4340e23700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f433c0b7aa0 con 0x7f433c06a0d0 2023-06-23T18:45:18.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.831+0000 7f4340e23700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f433c0bcfc0 con 0x7f433c1444a0 2023-06-23T18:45:18.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.831+0000 7f4340e23700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f433c0b5f30 con 0x7f433c0b5a20 2023-06-23T18:45:18.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.831+0000 7f4339d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f433c1444a0 0x7f433c0b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:18.837 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.831+0000 7f4339d9b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f433c1444a0 0x7f433c0b54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56830/0 (socket says 172.21.15.52:56830) 2023-06-23T18:45:18.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.831+0000 7f4339d9b700 1 -- 172.21.15.52:0/2147202551 learned_addr learned my addr 172.21.15.52:0/2147202551 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:18.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.831+0000 7f433ad9d700 1 --2- 172.21.15.52:0/2147202551 >> v2:172.21.15.89:3300/0 conn(0x7f433c0b5a20 0x7f433c154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:18.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.831+0000 7f4339d9b700 1 -- 172.21.15.52:0/2147202551 >> v2:172.21.15.89:3300/0 conn(0x7f433c0b5a20 msgr2=0x7f433c154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:18.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.831+0000 7f4339d9b700 1 --2- 172.21.15.52:0/2147202551 >> v2:172.21.15.89:3300/0 conn(0x7f433c0b5a20 0x7f433c154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:18.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.831+0000 7f4339d9b700 1 -- 172.21.15.52:0/2147202551 >> v1:172.21.15.89:6789/0 conn(0x7f433c06a0d0 legacy=0x7f433c0bc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:18.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.831+0000 7f4339d9b700 1 -- 172.21.15.52:0/2147202551 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433c0b6210 con 0x7f433c1444a0 2023-06-23T18:45:18.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.832+0000 7f4339d9b700 1 --2- 172.21.15.52:0/2147202551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f433c1444a0 0x7f433c0b54e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f433c06cc80 tx=0x7f4330009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4150a083239b3cf server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:18.838 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.832+0000 7f433959a700 1 -- 172.21.15.52:0/2147202551 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4330011830 con 0x7f433c1444a0 2023-06-23T18:45:18.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.832+0000 7f433959a700 1 -- 172.21.15.52:0/2147202551 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4330011990 con 0x7f433c1444a0 2023-06-23T18:45:18.839 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.832+0000 7f433959a700 1 -- 172.21.15.52:0/2147202551 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4330011d20 con 0x7f433c1444a0 2023-06-23T18:45:18.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.832+0000 7f4340e23700 1 -- 172.21.15.52:0/2147202551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f433c1444a0 msgr2=0x7f433c0b54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:18.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.832+0000 7f4340e23700 1 --2- 172.21.15.52:0/2147202551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f433c1444a0 0x7f433c0b54e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f433c06cc80 tx=0x7f4330009bd0 comp rx=0 tx=0).stop 2023-06-23T18:45:18.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.832+0000 7f4340e23700 1 -- 172.21.15.52:0/2147202551 shutdown_connections 2023-06-23T18:45:18.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.832+0000 7f4340e23700 1 --2- 172.21.15.52:0/2147202551 >> v2:172.21.15.89:3300/0 conn(0x7f433c0b5a20 0x7f433c154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:18.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.832+0000 7f4340e23700 1 --2- 172.21.15.52:0/2147202551 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f433c1444a0 0x7f433c0b54e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:18.841 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.832+0000 7f4340e23700 1 -- 172.21.15.52:0/2147202551 >> 172.21.15.52:0/2147202551 conn(0x7f433c06bb90 msgr2=0x7f433c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:18.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.832+0000 7f4340e23700 1 -- 172.21.15.52:0/2147202551 shutdown_connections 2023-06-23T18:45:18.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.832+0000 7f4340e23700 1 -- 172.21.15.52:0/2147202551 wait complete. 2023-06-23T18:45:18.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.834+0000 7f4340e23700 1 Processor -- start 2023-06-23T18:45:18.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.834+0000 7f4340e23700 1 -- start start 2023-06-23T18:45:18.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.834+0000 7f4340e23700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f433c06a0d0 0x7f433c1d7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:18.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.834+0000 7f4340e23700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f433c0b5a20 0x7f433c140820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:18.842 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.834+0000 7f4340e23700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f433c1444a0 0x7f433c1d19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:18.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.834+0000 7f4340e23700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c1d7960 con 0x7f433c06a0d0 2023-06-23T18:45:18.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.834+0000 7f4340e23700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c140440 con 0x7f433c0b5a20 2023-06-23T18:45:18.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.834+0000 7f4340e23700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f433c143450 con 0x7f433c1444a0 2023-06-23T18:45:18.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.834+0000 7f433a59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f433c06a0d0 0x7f433c1d7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:18.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.834+0000 7f433a59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f433c06a0d0 0x7f433c1d7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56832/0 (socket says 172.21.15.52:56832) 2023-06-23T18:45:18.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.834+0000 7f433a59c700 1 -- 172.21.15.52:0/1836402653 learned_addr learned my addr 172.21.15.52:0/1836402653 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:18.843 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.834+0000 7f4339d9b700 1 --2- 172.21.15.52:0/1836402653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f433c0b5a20 0x7f433c140820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:18.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.834+0000 7f433ad9d700 1 --2- 172.21.15.52:0/1836402653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f433c1444a0 0x7f433c1d19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:18.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.835+0000 7f433a59c700 1 -- 172.21.15.52:0/1836402653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f433c1444a0 msgr2=0x7f433c1d19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:18.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.835+0000 7f433a59c700 1 --2- 172.21.15.52:0/1836402653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f433c1444a0 0x7f433c1d19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:18.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.835+0000 7f433a59c700 1 -- 172.21.15.52:0/1836402653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f433c0b5a20 msgr2=0x7f433c140820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:18.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.835+0000 7f433a59c700 1 --2- 172.21.15.52:0/1836402653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f433c0b5a20 0x7f433c140820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:18.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.835+0000 7f433a59c700 1 -- 172.21.15.52:0/1836402653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4330009550 con 0x7f433c06a0d0 2023-06-23T18:45:18.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.835+0000 7f433a59c700 1 --2- 172.21.15.52:0/1836402653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f433c06a0d0 0x7f433c1d7420 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f433400cc00 tx=0x7f433400cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:18.844 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.835+0000 7f432affd700 1 -- 172.21.15.52:0/1836402653 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4334003c00 con 0x7f433c06a0d0 2023-06-23T18:45:18.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.835+0000 7f432affd700 1 -- 172.21.15.52:0/1836402653 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4334003d60 con 0x7f433c06a0d0 2023-06-23T18:45:18.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.835+0000 7f4340e23700 1 -- 172.21.15.52:0/1836402653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433c1d3130 con 0x7f433c06a0d0 2023-06-23T18:45:18.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.835+0000 7f432affd700 1 -- 172.21.15.52:0/1836402653 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433400aa80 con 0x7f433c06a0d0 2023-06-23T18:45:18.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.835+0000 7f4340e23700 1 -- 172.21.15.52:0/1836402653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433c141050 con 0x7f433c06a0d0 2023-06-23T18:45:18.845 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.836+0000 7f4340e23700 1 -- 172.21.15.52:0/1836402653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f433c1d1820 con 0x7f433c06a0d0 2023-06-23T18:45:18.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.836+0000 7f432affd700 1 -- 172.21.15.52:0/1836402653 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f433400abe0 con 0x7f433c06a0d0 2023-06-23T18:45:18.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.837+0000 7f432affd700 1 --2- 172.21.15.52:0/1836402653 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f431c06ace0 0x7f431c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:18.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.837+0000 7f432affd700 1 -- 172.21.15.52:0/1836402653 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4334089350 con 0x7f433c06a0d0 2023-06-23T18:45:18.846 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.837+0000 7f4339d9b700 1 --2- 172.21.15.52:0/1836402653 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f431c06ace0 0x7f431c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:18.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.838+0000 7f4339d9b700 1 --2- 172.21.15.52:0/1836402653 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f431c06ace0 0x7f431c06d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4330009c10 tx=0x7f433001d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:18.847 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:18.842+0000 7f432affd700 1 -- 172.21.15.52:0/1836402653 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4334054490 con 0x7f433c06a0d0 2023-06-23T18:45:19.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.037+0000 7f4340e23700 1 -- 172.21.15.52:0/1836402653 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f433c04e1d0 con 0x7f433c06a0d0 2023-06-23T18:45:19.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.038+0000 7f432affd700 1 -- 172.21.15.52:0/1836402653 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7f4334057ab0 con 0x7f433c06a0d0 2023-06-23T18:45:19.043 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:19.044 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","created":"2023-06-23T18:44:31.918434+0000","modified":"2023-06-23T18:44:51.644330+0000","last_up_change":"2023-06-23T18:44:42.169624+0000","last_in_change":"2023-06-23T18:44:34.510501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-23T18:44:43.346578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-23T18:44:43.829719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:44:48.517897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:44:49.621134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c371fb28-1b15-4e43-8d5a-43e402920ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6812","nonce":1066999520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6815","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6818","nonce":1066999520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6829","nonce":1066999520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6823","nonce":1066999520}]},"public_addr":"172.21.15.52:6812/1066999520","cluster_addr":"172.21.15.52:6818/1066999520","heartbeat_back_addr":"172.21.15.52:6829/1066999520","heartbeat_front_addr":"172.21.15.52:6823/1066999520","state":["exists","up"]},{"osd":1,"uuid":"4a142f04-33eb-47ec-9cc5-b08b44d82658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6813","nonce":2360219751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6819","nonce":2360219751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6830","nonce":2360219751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6825","nonce":2360219751}]},"public_addr":"172.21.15.52:6813/2360219751","cluster_addr":"172.21.15.52:6819/2360219751","heartbeat_back_addr":"172.21.15.52:6830/2360219751","heartbeat_front_addr":"172.21.15.52:6825/2360219751","state":["exists","up"]},{"osd":2,"uuid":"d7bb089d-4c55-4370-ba59-7fe88c39512a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6801","nonce":835073005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6803","nonce":835073005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6807","nonce":835073005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6805","nonce":835073005}]},"public_addr":"172.21.15.52:6801/835073005","cluster_addr":"172.21.15.52:6803/835073005","heartbeat_back_addr":"172.21.15.52:6807/835073005","heartbeat_front_addr":"172.21.15.52:6805/835073005","state":["exists","up"]},{"osd":3,"uuid":"4bcdcdc3-6a8f-468e-877e-57f76079ac3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6811","nonce":2852700864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6817","nonce":2852700864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6831","nonce":2852700864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6824","nonce":2852700864}]},"public_addr":"172.21.15.52:6811/2852700864","cluster_addr":"172.21.15.52:6817/2852700864","heartbeat_back_addr":"172.21.15.52:6831/2852700864","heartbeat_front_addr":"172.21.15.52:6824/2852700864","state":["exists","up"]},{"osd":4,"uuid":"cac63000-ae94-4b08-93e6-a99119640b63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6809","nonce":2538664679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6811","nonce":2538664679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6815","nonce":2538664679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6813","nonce":2538664679}]},"public_addr":"172.21.15.89:6809/2538664679","cluster_addr":"172.21.15.89:6811/2538664679","heartbeat_back_addr":"172.21.15.89:6815/2538664679","heartbeat_front_addr":"172.21.15.89:6813/2538664679","state":["exists","up"]},{"osd":5,"uuid":"45c53102-18a6-4fd7-9c25-8ea5e1ef6851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6801","nonce":1683710352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6803","nonce":1683710352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6807","nonce":1683710352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6805","nonce":1683710352}]},"public_addr":"172.21.15.89:6801/1683710352","cluster_addr":"172.21.15.89:6803/1683710352","heartbeat_back_addr":"172.21.15.89:6807/1683710352","heartbeat_front_addr":"172.21.15.89:6805/1683710352","state":["exists","up"]},{"osd":6,"uuid":"abee09d1-8eba-484f-a25c-871c1fe2e843","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6817","nonce":3890899288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6819","nonce":3890899288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6823","nonce":3890899288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6821","nonce":3890899288}]},"public_addr":"172.21.15.89:6817/3890899288","cluster_addr":"172.21.15.89:6819/3890899288","heartbeat_back_addr":"172.21.15.89:6823/3890899288","heartbeat_front_addr":"172.21.15.89:6821/3890899288","state":["exists","up"]},{"osd":7,"uuid":"5acf9e2e-00dd-4f9b-a7d9-3d820f695de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6825","nonce":2989085420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6827","nonce":2989085420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6831","nonce":2989085420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6829","nonce":2989085420}]},"public_addr":"172.21.15.89:6825/2989085420","cluster_addr":"172.21.15.89:6827/2989085420","heartbeat_back_addr":"172.21.15.89:6831/2989085420","heartbeat_front_addr":"172.21.15.89:6829/2989085420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.663866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.710904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.619347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.660102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.686933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.724635+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.669111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.678740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:45:19.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.041+0000 7f4340e23700 1 -- 172.21.15.52:0/1836402653 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f431c06ace0 msgr2=0x7f431c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:19.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.041+0000 7f4340e23700 1 --2- 172.21.15.52:0/1836402653 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f431c06ace0 0x7f431c06d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4330009c10 tx=0x7f433001d040 comp rx=0 tx=0).stop 2023-06-23T18:45:19.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.041+0000 7f4340e23700 1 -- 172.21.15.52:0/1836402653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f433c06a0d0 msgr2=0x7f433c1d7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:19.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.041+0000 7f4340e23700 1 --2- 172.21.15.52:0/1836402653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f433c06a0d0 0x7f433c1d7420 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f433400cc00 tx=0x7f433400cf10 comp rx=0 tx=0).stop 2023-06-23T18:45:19.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.041+0000 7f4340e23700 1 -- 172.21.15.52:0/1836402653 shutdown_connections 2023-06-23T18:45:19.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.041+0000 7f4340e23700 1 --2- 172.21.15.52:0/1836402653 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f431c06ace0 0x7f431c06d190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.041+0000 7f4340e23700 1 --2- 172.21.15.52:0/1836402653 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f433c1444a0 0x7f433c1d19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.046 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.041+0000 7f4340e23700 1 --2- 172.21.15.52:0/1836402653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f433c06a0d0 0x7f433c1d7420 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.041+0000 7f4340e23700 1 --2- 172.21.15.52:0/1836402653 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f433c0b5a20 0x7f433c140820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.041+0000 7f4340e23700 1 -- 172.21.15.52:0/1836402653 >> 172.21.15.52:0/1836402653 conn(0x7f433c06bb90 msgr2=0x7f433c148740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:19.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.041+0000 7f4340e23700 1 -- 172.21.15.52:0/1836402653 shutdown_connections 2023-06-23T18:45:19.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.041+0000 7f4340e23700 1 -- 172.21.15.52:0/1836402653 wait complete. 2023-06-23T18:45:19.058 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-23T18:44:43.346578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-23T18:44:43.829719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T18:44:48.517897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T18:44:49.621134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-23T18:45:19.058 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T18:45:19.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.182+0000 7f4de376e700 1 Processor -- start 2023-06-23T18:45:19.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.182+0000 7f4de376e700 1 -- start start 2023-06-23T18:45:19.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.183+0000 7f4de376e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4ddc0b6870 0x7f4ddc144480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:19.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.183+0000 7f4de376e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ddc0bb900 0x7f4ddc1449c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:19.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.183+0000 7f4de376e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ddc0be040 con 0x7f4ddc14a600 2023-06-23T18:45:19.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.183+0000 7f4de376e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ddc14aae0 con 0x7f4ddc0b6870 2023-06-23T18:45:19.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.183+0000 7f4de376e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc14adc0 con 0x7f4ddc0bb900 2023-06-23T18:45:19.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.183+0000 7f4de150a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4ddc0b6870 0x7f4ddc144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:19.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.183+0000 7f4de150a700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4ddc0b6870 0x7f4ddc144480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56842/0 (socket says 172.21.15.52:56842) 2023-06-23T18:45:19.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.183+0000 7f4de150a700 1 -- 172.21.15.52:0/2203729749 learned_addr learned my addr 172.21.15.52:0/2203729749 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:19.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.183+0000 7f4de1d0b700 1 --2- 172.21.15.52:0/2203729749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ddc0bb900 0x7f4ddc1449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:19.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.183+0000 7f4de150a700 1 -- 172.21.15.52:0/2203729749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ddc0bb900 msgr2=0x7f4ddc1449c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:19.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.183+0000 7f4de150a700 1 --2- 172.21.15.52:0/2203729749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ddc0bb900 0x7f4ddc1449c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.183+0000 7f4de150a700 1 -- 172.21.15.52:0/2203729749 >> v1:172.21.15.89:6789/0 conn(0x7f4ddc14a600 legacy=0x7f4ddc0bb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:19.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.183+0000 7f4de150a700 1 -- 172.21.15.52:0/2203729749 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ddc14b0a0 con 0x7f4ddc0b6870 2023-06-23T18:45:19.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.183+0000 7f4de1d0b700 1 --2- 172.21.15.52:0/2203729749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ddc0bb900 0x7f4ddc1449c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:45:19.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.183+0000 7f4de150a700 1 --2- 172.21.15.52:0/2203729749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ddc0b6870 0x7f4ddc144480 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4dd80098f0 tx=0x7f4dd8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a6970ce3750e9b server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:19.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.183+0000 7f4dd3fff700 1 -- 172.21.15.52:0/2203729749 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8004230 con 0x7f4ddc0b6870 2023-06-23T18:45:19.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.184+0000 7f4dd3fff700 1 -- 172.21.15.52:0/2203729749 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd8004390 con 0x7f4ddc0b6870 2023-06-23T18:45:19.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.184+0000 7f4dd3fff700 1 -- 172.21.15.52:0/2203729749 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd80036a0 con 0x7f4ddc0b6870 2023-06-23T18:45:19.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.184+0000 7f4de376e700 1 -- 172.21.15.52:0/2203729749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ddc0b6870 msgr2=0x7f4ddc144480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:19.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.184+0000 7f4de376e700 1 --2- 172.21.15.52:0/2203729749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ddc0b6870 0x7f4ddc144480 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4dd80098f0 tx=0x7f4dd8009c00 comp rx=0 tx=0).stop 2023-06-23T18:45:19.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.184+0000 7f4de376e700 1 -- 172.21.15.52:0/2203729749 shutdown_connections 2023-06-23T18:45:19.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.184+0000 7f4de376e700 1 --2- 172.21.15.52:0/2203729749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ddc0bb900 0x7f4ddc1449c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.184+0000 7f4de376e700 1 --2- 172.21.15.52:0/2203729749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ddc0b6870 0x7f4ddc144480 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.184+0000 7f4de376e700 1 -- 172.21.15.52:0/2203729749 >> 172.21.15.52:0/2203729749 conn(0x7f4ddc0bd140 msgr2=0x7f4ddc0bd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:19.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.184+0000 7f4de376e700 1 -- 172.21.15.52:0/2203729749 shutdown_connections 2023-06-23T18:45:19.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.184+0000 7f4de376e700 1 -- 172.21.15.52:0/2203729749 wait complete. 2023-06-23T18:45:19.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.185+0000 7f4de376e700 1 Processor -- start 2023-06-23T18:45:19.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.185+0000 7f4de376e700 1 -- start start 2023-06-23T18:45:19.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.186+0000 7f4de376e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ddc0b6870 0x7f4ddc145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:19.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.186+0000 7f4de376e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ddc0bb900 0x7f4ddc146bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:19.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.186+0000 7f4de376e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ddc14a600 0x7f4ddc0b9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:19.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.186+0000 7f4de376e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc146240 con 0x7f4ddc0b6870 2023-06-23T18:45:19.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.186+0000 7f4de376e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc149450 con 0x7f4ddc0bb900 2023-06-23T18:45:19.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.186+0000 7f4de376e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc149cb0 con 0x7f4ddc14a600 2023-06-23T18:45:19.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.186+0000 7f4de150a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ddc0b6870 0x7f4ddc145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:19.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.186+0000 7f4de150a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ddc0b6870 0x7f4ddc145d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56858/0 (socket says 172.21.15.52:56858) 2023-06-23T18:45:19.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.186+0000 7f4de150a700 1 -- 172.21.15.52:0/1481430591 learned_addr learned my addr 172.21.15.52:0/1481430591 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:19.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.186+0000 7f4de1d0b700 1 --2- 172.21.15.52:0/1481430591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ddc14a600 0x7f4ddc0b9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:19.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.186+0000 7f4de0d09700 1 --2- 172.21.15.52:0/1481430591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ddc0bb900 0x7f4ddc146bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:19.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.186+0000 7f4de150a700 1 -- 172.21.15.52:0/1481430591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ddc14a600 msgr2=0x7f4ddc0b9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:19.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.186+0000 7f4de150a700 1 --2- 172.21.15.52:0/1481430591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ddc14a600 0x7f4ddc0b9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.186+0000 7f4de150a700 1 -- 172.21.15.52:0/1481430591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ddc0bb900 msgr2=0x7f4ddc146bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:19.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.186+0000 7f4de150a700 1 --2- 172.21.15.52:0/1481430591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ddc0bb900 0x7f4ddc146bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.186+0000 7f4de150a700 1 -- 172.21.15.52:0/1481430591 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd8009550 con 0x7f4ddc0b6870 2023-06-23T18:45:19.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.186+0000 7f4de1d0b700 1 --2- 172.21.15.52:0/1481430591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ddc14a600 0x7f4ddc0b9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:19.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.186+0000 7f4de150a700 1 --2- 172.21.15.52:0/1481430591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ddc0b6870 0x7f4ddc145d00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc08a810 tx=0x7f4dd8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:19.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.187+0000 7f4dd1ffb700 1 -- 172.21.15.52:0/1481430591 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8003e30 con 0x7f4ddc0b6870 2023-06-23T18:45:19.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.187+0000 7f4dd1ffb700 1 -- 172.21.15.52:0/1481430591 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd801f070 con 0x7f4ddc0b6870 2023-06-23T18:45:19.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.187+0000 7f4de376e700 1 -- 172.21.15.52:0/1481430591 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ddc147110 con 0x7f4ddc0b6870 2023-06-23T18:45:19.200 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.187+0000 7f4dd1ffb700 1 -- 172.21.15.52:0/1481430591 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd800b8a0 con 0x7f4ddc0b6870 2023-06-23T18:45:19.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.187+0000 7f4de376e700 1 -- 172.21.15.52:0/1481430591 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ddc149660 con 0x7f4ddc0b6870 2023-06-23T18:45:19.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.188+0000 7f4de376e700 1 -- 172.21.15.52:0/1481430591 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ddc04e1d0 con 0x7f4ddc0b6870 2023-06-23T18:45:19.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.188+0000 7f4dd1ffb700 1 -- 172.21.15.52:0/1481430591 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4dd8021030 con 0x7f4ddc0b6870 2023-06-23T18:45:19.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.189+0000 7f4dd1ffb700 1 --2- 172.21.15.52:0/1481430591 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f4dc006ace0 0x7f4dc006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:19.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.189+0000 7f4dd1ffb700 1 -- 172.21.15.52:0/1481430591 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4dd808aab0 con 0x7f4ddc0b6870 2023-06-23T18:45:19.201 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.189+0000 7f4de0d09700 1 --2- 172.21.15.52:0/1481430591 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f4dc006ace0 0x7f4dc006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:19.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.189+0000 7f4de0d09700 1 --2- 172.21.15.52:0/1481430591 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f4dc006ace0 0x7f4dc006d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc1d4930 tx=0x7f4dcc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:19.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.193+0000 7f4dd1ffb700 1 -- 172.21.15.52:0/1481430591 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4dd8055bf0 con 0x7f4ddc0b6870 2023-06-23T18:45:19.395 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.391+0000 7f4de376e700 1 -- 172.21.15.52:0/1481430591 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4ddc04e1d0 con 0x7f4ddc0b6870 2023-06-23T18:45:19.396 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.391+0000 7f4dd1ffb700 1 -- 172.21.15.52:0/1481430591 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4dd8059210 con 0x7f4ddc0b6870 2023-06-23T18:45:19.396 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-06-23T18:45:19.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.393+0000 7f4de376e700 1 -- 172.21.15.52:0/1481430591 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f4dc006ace0 msgr2=0x7f4dc006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:19.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.393+0000 7f4de376e700 1 --2- 172.21.15.52:0/1481430591 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f4dc006ace0 0x7f4dc006d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc1d4930 tx=0x7f4dcc008040 comp rx=0 tx=0).stop 2023-06-23T18:45:19.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.393+0000 7f4de376e700 1 -- 172.21.15.52:0/1481430591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ddc0b6870 msgr2=0x7f4ddc145d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:19.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.393+0000 7f4de376e700 1 --2- 172.21.15.52:0/1481430591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ddc0b6870 0x7f4ddc145d00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc08a810 tx=0x7f4dd8004750 comp rx=0 tx=0).stop 2023-06-23T18:45:19.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.393+0000 7f4de376e700 1 -- 172.21.15.52:0/1481430591 shutdown_connections 2023-06-23T18:45:19.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.393+0000 7f4de376e700 1 --2- 172.21.15.52:0/1481430591 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f4dc006ace0 0x7f4dc006d190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.393+0000 7f4de376e700 1 --2- 172.21.15.52:0/1481430591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ddc14a600 0x7f4ddc0b9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.393+0000 7f4de376e700 1 --2- 172.21.15.52:0/1481430591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4ddc0b6870 0x7f4ddc145d00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.393+0000 7f4de376e700 1 --2- 172.21.15.52:0/1481430591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ddc0bb900 0x7f4ddc146bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.393+0000 7f4de376e700 1 -- 172.21.15.52:0/1481430591 >> 172.21.15.52:0/1481430591 conn(0x7f4ddc0bd140 msgr2=0x7f4ddc141ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:19.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.394+0000 7f4de376e700 1 -- 172.21.15.52:0/1481430591 shutdown_connections 2023-06-23T18:45:19.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.394+0000 7f4de376e700 1 -- 172.21.15.52:0/1481430591 wait complete. 2023-06-23T18:45:19.410 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T18:45:19.538 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.533+0000 7f0c0d5c8700 1 Processor -- start 2023-06-23T18:45:19.539 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.533+0000 7f0c0d5c8700 1 -- start start 2023-06-23T18:45:19.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.534+0000 7f0c0d5c8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c08070b10 0x7f0c08070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:19.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.535+0000 7f0c0d5c8700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c08141260 con 0x7f0c0814a4c0 2023-06-23T18:45:19.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.535+0000 7f0c0d5c8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c08070140 con 0x7f0c0806b0e0 2023-06-23T18:45:19.542 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.535+0000 7f0c0d5c8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c08070420 con 0x7f0c08070b10 2023-06-23T18:45:19.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.535+0000 7f0c077fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0c0814a4c0 0x7f0c0814a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37884/0 (socket says 172.21.15.52:37884) 2023-06-23T18:45:19.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.535+0000 7f0c077fe700 1 -- 172.21.15.52:0/4001215301 learned_addr learned my addr 172.21.15.52:0/4001215301 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:19.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.535+0000 7f0bfe7fc700 1 --2- 172.21.15.52:0/4001215301 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c08070b10 0x7f0c08070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:19.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.535+0000 7f0c067fc700 1 -- 172.21.15.52:0/4001215301 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495323659 0 0) 0x7f0c08141260 con 0x7f0c0814a4c0 2023-06-23T18:45:19.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.535+0000 7f0c067fc700 1 -- 172.21.15.52:0/4001215301 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bf40034d0 con 0x7f0c0814a4c0 2023-06-23T18:45:19.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.535+0000 7f0c067fc700 1 -- 172.21.15.52:0/4001215301 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3015960842 0 0) 0x7f0bf40034d0 con 0x7f0c0814a4c0 2023-06-23T18:45:19.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.535+0000 7f0c067fc700 1 -- 172.21.15.52:0/4001215301 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c08070b10 msgr2=0x7f0c08070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:19.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.535+0000 7f0c067fc700 1 --2- 172.21.15.52:0/4001215301 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c08070b10 0x7f0c08070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.535+0000 7f0c067fc700 1 -- 172.21.15.52:0/4001215301 >> v1:172.21.15.89:6789/0 conn(0x7f0c0806b0e0 legacy=0x7f0c08140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:19.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.535+0000 7f0c067fc700 1 -- 172.21.15.52:0/4001215301 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c08070700 con 0x7f0c0814a4c0 2023-06-23T18:45:19.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.535+0000 7f0c067fc700 1 -- 172.21.15.52:0/4001215301 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7f0c000019f0 con 0x7f0c0814a4c0 2023-06-23T18:45:19.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.535+0000 7f0c067fc700 1 -- 172.21.15.52:0/4001215301 >> v1:172.21.15.52:6789/0 conn(0x7f0c0814a4c0 legacy=0x7f0c0814a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:19.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.535+0000 7f0c067fc700 1 --2- 172.21.15.52:0/4001215301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0bf4003b20 0x7f0bf4003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:19.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.535+0000 7f0c067fc700 1 --2- 172.21.15.52:0/4001215301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bf40088e0 0x7f0bf400acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:19.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.535+0000 7f0c067fc700 1 --2- 172.21.15.52:0/4001215301 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c08070b10 0x7f0bf400d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:19.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.535+0000 7f0c067fc700 1 -- 172.21.15.52:0/4001215301 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c08070420 con 0x7f0bf4003b20 2023-06-23T18:45:19.545 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.535+0000 7f0c067fc700 1 -- 172.21.15.52:0/4001215301 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf400dc30 con 0x7f0bf40088e0 2023-06-23T18:45:19.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.535+0000 7f0c067fc700 1 -- 172.21.15.52:0/4001215301 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf400ddf0 con 0x7f0c08070b10 2023-06-23T18:45:19.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.535+0000 7f0c06ffd700 1 --2- 172.21.15.52:0/4001215301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0bf4003b20 0x7f0bf4003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:19.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.535+0000 7f0c077fe700 1 --2- 172.21.15.52:0/4001215301 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c08070b10 0x7f0bf400d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:19.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.536+0000 7f0bfe7fc700 1 --2- 172.21.15.52:0/4001215301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bf40088e0 0x7f0bf400acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:19.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.536+0000 7f0c06ffd700 1 -- 172.21.15.52:0/4001215301 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c08070b10 msgr2=0x7f0bf400d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:19.546 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.536+0000 7f0c06ffd700 1 --2- 172.21.15.52:0/4001215301 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c08070b10 0x7f0bf400d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.536+0000 7f0c06ffd700 1 -- 172.21.15.52:0/4001215301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bf40088e0 msgr2=0x7f0bf400acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:19.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.536+0000 7f0c06ffd700 1 --2- 172.21.15.52:0/4001215301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bf40088e0 0x7f0bf400acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.536+0000 7f0c06ffd700 1 -- 172.21.15.52:0/4001215301 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf40034d0 con 0x7f0bf4003b20 2023-06-23T18:45:19.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.536+0000 7f0bfe7fc700 1 --2- 172.21.15.52:0/4001215301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bf40088e0 0x7f0bf400acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:19.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.536+0000 7f0c06ffd700 1 --2- 172.21.15.52:0/4001215301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0bf4003b20 0x7f0bf4003ef0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0bf80018b0 tx=0x7f0bf4003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760016cc27b2bc40 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:19.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.536+0000 7f0c067fc700 1 -- 172.21.15.52:0/4001215301 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8001370 con 0x7f0bf4003b20 2023-06-23T18:45:19.547 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.536+0000 7f0c067fc700 1 -- 172.21.15.52:0/4001215301 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf800c6b0 con 0x7f0bf4003b20 2023-06-23T18:45:19.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.536+0000 7f0c067fc700 1 -- 172.21.15.52:0/4001215301 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf800ca60 con 0x7f0bf4003b20 2023-06-23T18:45:19.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.536+0000 7f0c0d5c8700 1 -- 172.21.15.52:0/4001215301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0bf4003b20 msgr2=0x7f0bf4003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:19.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.536+0000 7f0c0d5c8700 1 --2- 172.21.15.52:0/4001215301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0bf4003b20 0x7f0bf4003ef0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0bf80018b0 tx=0x7f0bf4003780 comp rx=0 tx=0).stop 2023-06-23T18:45:19.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.536+0000 7f0c077fe700 1 -- 172.21.15.52:0/4001215301 reap_dead start 2023-06-23T18:45:19.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.536+0000 7f0c0d5c8700 1 -- 172.21.15.52:0/4001215301 shutdown_connections 2023-06-23T18:45:19.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.536+0000 7f0c0d5c8700 1 -- 172.21.15.52:0/4001215301 >> 172.21.15.52:0/4001215301 conn(0x7f0c080b95c0 msgr2=0x7f0c080b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:19.548 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.537+0000 7f0c0d5c8700 1 -- 172.21.15.52:0/4001215301 shutdown_connections 2023-06-23T18:45:19.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.537+0000 7f0c0d5c8700 1 -- 172.21.15.52:0/4001215301 wait complete. 2023-06-23T18:45:19.549 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.538+0000 7f0c0d5c8700 1 Processor -- start 2023-06-23T18:45:19.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.538+0000 7f0c0d5c8700 1 -- start start 2023-06-23T18:45:19.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.538+0000 7f0c0d5c8700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0bf4003b20 0x7f0c080bbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:19.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.538+0000 7f0c0d5c8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c08144820 0x7f0c081db410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:19.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.538+0000 7f0c0d5c8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c080b51e0 0x7f0c080b5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:19.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.538+0000 7f0c0d5c8700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c080bc130 con 0x7f0bf4003b20 2023-06-23T18:45:19.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.538+0000 7f0c0d5c8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c08143cf0 con 0x7f0c080b51e0 2023-06-23T18:45:19.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.538+0000 7f0c0d5c8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c08144cb0 con 0x7f0c08144820 2023-06-23T18:45:19.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.538+0000 7f0c06ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0bf4003b20 0x7f0c080bbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:19.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.539+0000 7f0c06ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0bf4003b20 0x7f0c080bbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56882/0 (socket says 172.21.15.52:56882) 2023-06-23T18:45:19.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.539+0000 7f0c06ffd700 1 -- 172.21.15.52:0/1324005250 learned_addr learned my addr 172.21.15.52:0/1324005250 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:19.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.539+0000 7f0bfe7fc700 1 --2- 172.21.15.52:0/1324005250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c08144820 0x7f0c081db410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:19.552 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.539+0000 7f0c077fe700 1 --2- 172.21.15.52:0/1324005250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c080b51e0 0x7f0c080b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:19.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.539+0000 7f0c06ffd700 1 -- 172.21.15.52:0/1324005250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c08144820 msgr2=0x7f0c081db410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:19.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.539+0000 7f0c06ffd700 1 --2- 172.21.15.52:0/1324005250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c08144820 0x7f0c081db410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.539+0000 7f0c06ffd700 1 -- 172.21.15.52:0/1324005250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c080b51e0 msgr2=0x7f0c080b5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:19.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.539+0000 7f0c06ffd700 1 --2- 172.21.15.52:0/1324005250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c080b51e0 0x7f0c080b5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.539+0000 7f0c06ffd700 1 -- 172.21.15.52:0/1324005250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c081426c0 con 0x7f0bf4003b20 2023-06-23T18:45:19.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.539+0000 7f0bfe7fc700 1 --2- 172.21.15.52:0/1324005250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c08144820 0x7f0c081db410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:19.553 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.539+0000 7f0c077fe700 1 --2- 172.21.15.52:0/1324005250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c080b51e0 0x7f0c080b5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:19.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.539+0000 7f0c06ffd700 1 --2- 172.21.15.52:0/1324005250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0bf4003b20 0x7f0c080bbbf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400dc00 tx=0x7f0bf8001110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:19.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.539+0000 7f0bfffff700 1 -- 172.21.15.52:0/1324005250 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8001370 con 0x7f0bf4003b20 2023-06-23T18:45:19.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.539+0000 7f0bfffff700 1 -- 172.21.15.52:0/1324005250 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf800cc30 con 0x7f0bf4003b20 2023-06-23T18:45:19.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.539+0000 7f0bfffff700 1 -- 172.21.15.52:0/1324005250 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8003680 con 0x7f0bf4003b20 2023-06-23T18:45:19.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.539+0000 7f0c0d5c8700 1 -- 172.21.15.52:0/1324005250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c081429a0 con 0x7f0bf4003b20 2023-06-23T18:45:19.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.539+0000 7f0c0d5c8700 1 -- 172.21.15.52:0/1324005250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c08144180 con 0x7f0bf4003b20 2023-06-23T18:45:19.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.540+0000 7f0c0d5c8700 1 -- 172.21.15.52:0/1324005250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c08142520 con 0x7f0bf4003b20 2023-06-23T18:45:19.554 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.541+0000 7f0bfffff700 1 -- 172.21.15.52:0/1324005250 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0bf8023070 con 0x7f0bf4003b20 2023-06-23T18:45:19.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.541+0000 7f0bfffff700 1 --2- 172.21.15.52:0/1324005250 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0be806ace0 0x7f0be806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:19.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.541+0000 7f0bfffff700 1 -- 172.21.15.52:0/1324005250 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0bf808a9b0 con 0x7f0bf4003b20 2023-06-23T18:45:19.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.541+0000 7f0bfe7fc700 1 --2- 172.21.15.52:0/1324005250 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0be806ace0 0x7f0be806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:19.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.542+0000 7f0bfe7fc700 1 --2- 172.21.15.52:0/1324005250 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0be806ace0 0x7f0be806d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0c08143420 tx=0x7f0bf0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:19.555 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.545+0000 7f0bfffff700 1 -- 172.21.15.52:0/1324005250 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0c08142520 con 0x7f0bf4003b20 2023-06-23T18:45:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.742+0000 7f0c0d5c8700 1 -- 172.21.15.52:0/1324005250 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0c08142520 con 0x7f0bf4003b20 2023-06-23T18:45:19.747 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.742+0000 7f0bfffff700 1 -- 172.21.15.52:0/1324005250 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0c08142520 con 0x7f0bf4003b20 2023-06-23T18:45:19.747 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-06-23T18:45:19.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.744+0000 7f0c0d5c8700 1 -- 172.21.15.52:0/1324005250 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0be806ace0 msgr2=0x7f0be806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:19.749 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.744+0000 7f0c0d5c8700 1 --2- 172.21.15.52:0/1324005250 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0be806ace0 0x7f0be806d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0c08143420 tx=0x7f0bf0008040 comp rx=0 tx=0).stop 2023-06-23T18:45:19.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.744+0000 7f0c0d5c8700 1 -- 172.21.15.52:0/1324005250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0bf4003b20 msgr2=0x7f0c080bbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:19.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.744+0000 7f0c0d5c8700 1 --2- 172.21.15.52:0/1324005250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0bf4003b20 0x7f0c080bbbf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400dc00 tx=0x7f0bf8001110 comp rx=0 tx=0).stop 2023-06-23T18:45:19.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.744+0000 7f0c0d5c8700 1 -- 172.21.15.52:0/1324005250 shutdown_connections 2023-06-23T18:45:19.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.744+0000 7f0c0d5c8700 1 --2- 172.21.15.52:0/1324005250 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0be806ace0 0x7f0be806d190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.750 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.744+0000 7f0c0d5c8700 1 --2- 172.21.15.52:0/1324005250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c080b51e0 0x7f0c080b5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.744+0000 7f0c0d5c8700 1 --2- 172.21.15.52:0/1324005250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0bf4003b20 0x7f0c080bbbf0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.744+0000 7f0c0d5c8700 1 --2- 172.21.15.52:0/1324005250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c08144820 0x7f0c081db410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.744+0000 7f0c0d5c8700 1 -- 172.21.15.52:0/1324005250 >> 172.21.15.52:0/1324005250 conn(0x7f0c080b95c0 msgr2=0x7f0c080b7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:19.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.744+0000 7f0c0d5c8700 1 -- 172.21.15.52:0/1324005250 shutdown_connections 2023-06-23T18:45:19.751 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.744+0000 7f0c0d5c8700 1 -- 172.21.15.52:0/1324005250 wait complete. 2023-06-23T18:45:19.761 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T18:45:19.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.886+0000 7f45e3c4b700 1 Processor -- start 2023-06-23T18:45:19.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.886+0000 7f45e3c4b700 1 -- start start 2023-06-23T18:45:19.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.886+0000 7f45e3c4b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f45dc142890 0x7f45dc06af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:19.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.887+0000 7f45e3c4b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45dc0b8e60 0x7f45dc148a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:19.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.887+0000 7f45e3c4b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45dc148570 con 0x7f45dc148f40 2023-06-23T18:45:19.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.887+0000 7f45e3c4b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45dc0b49b0 con 0x7f45dc142890 2023-06-23T18:45:19.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.887+0000 7f45e3c4b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc0b5610 con 0x7f45dc0b8e60 2023-06-23T18:45:19.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.887+0000 7f45e19e7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f45dc142890 0x7f45dc06af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:19.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.887+0000 7f45e21e8700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f45dc148f40 0x7f45dc14baf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.52:59036/0 (socket says 172.21.15.52:59036) 2023-06-23T18:45:19.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.887+0000 7f45e21e8700 1 -- 172.21.15.52:0/2471783213 learned_addr learned my addr 172.21.15.52:0/2471783213 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:19.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.887+0000 7f45e11e6700 1 --2- 172.21.15.52:0/2471783213 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45dc0b8e60 0x7f45dc148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:19.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.887+0000 7f45e09e5700 1 -- 172.21.15.52:0/2471783213 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015294477 0 0) 0x7f45dc148570 con 0x7f45dc148f40 2023-06-23T18:45:19.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.887+0000 7f45e09e5700 1 -- 172.21.15.52:0/2471783213 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45c80035b0 con 0x7f45dc148f40 2023-06-23T18:45:19.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.887+0000 7f45e19e7700 1 -- 172.21.15.52:0/2471783213 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45dc0b8e60 msgr2=0x7f45dc148a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:19.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.887+0000 7f45e19e7700 1 --2- 172.21.15.52:0/2471783213 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45dc0b8e60 0x7f45dc148a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.887+0000 7f45e19e7700 1 -- 172.21.15.52:0/2471783213 >> v1:172.21.15.89:6789/0 conn(0x7f45dc148f40 legacy=0x7f45dc14baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:19.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.887+0000 7f45e19e7700 1 -- 172.21.15.52:0/2471783213 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc142c60 con 0x7f45dc142890 2023-06-23T18:45:19.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.887+0000 7f45e11e6700 1 --2- 172.21.15.52:0/2471783213 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45dc0b8e60 0x7f45dc148a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:45:19.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.887+0000 7f45e19e7700 1 --2- 172.21.15.52:0/2471783213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45dc142890 0x7f45dc06af00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009840 tx=0x7f45cc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b366f04a08ba189a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:19.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.887+0000 7f45e09e5700 1 -- 172.21.15.52:0/2471783213 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc011830 con 0x7f45dc142890 2023-06-23T18:45:19.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.888+0000 7f45e09e5700 1 -- 172.21.15.52:0/2471783213 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45cc011990 con 0x7f45dc142890 2023-06-23T18:45:19.895 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.888+0000 7f45e09e5700 1 -- 172.21.15.52:0/2471783213 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc011d00 con 0x7f45dc142890 2023-06-23T18:45:19.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.888+0000 7f45e3c4b700 1 -- 172.21.15.52:0/2471783213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45dc142890 msgr2=0x7f45dc06af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:19.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.888+0000 7f45e3c4b700 1 --2- 172.21.15.52:0/2471783213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45dc142890 0x7f45dc06af00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009840 tx=0x7f45cc009b50 comp rx=0 tx=0).stop 2023-06-23T18:45:19.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.888+0000 7f45e3c4b700 1 -- 172.21.15.52:0/2471783213 shutdown_connections 2023-06-23T18:45:19.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.888+0000 7f45e3c4b700 1 --2- 172.21.15.52:0/2471783213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45dc142890 0x7f45dc06af00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.888+0000 7f45e3c4b700 1 --2- 172.21.15.52:0/2471783213 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45dc0b8e60 0x7f45dc148a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.888+0000 7f45e3c4b700 1 -- 172.21.15.52:0/2471783213 >> 172.21.15.52:0/2471783213 conn(0x7f45dc0b95c0 msgr2=0x7f45dc0b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:19.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.888+0000 7f45e3c4b700 1 -- 172.21.15.52:0/2471783213 shutdown_connections 2023-06-23T18:45:19.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.888+0000 7f45e3c4b700 1 -- 172.21.15.52:0/2471783213 wait complete. 2023-06-23T18:45:19.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.889+0000 7f45e3c4b700 1 Processor -- start 2023-06-23T18:45:19.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.889+0000 7f45e3c4b700 1 -- start start 2023-06-23T18:45:19.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.890+0000 7f45e3c4b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45dc0b8e60 0x7f45dc0bbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:19.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.890+0000 7f45e3c4b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45dc142890 0x7f45dc06fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:19.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.890+0000 7f45e3c4b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45dc148f40 0x7f45dc135aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:19.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.890+0000 7f45e3c4b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc0bc370 con 0x7f45dc142890 2023-06-23T18:45:19.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.890+0000 7f45e3c4b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc136d10 con 0x7f45dc0b8e60 2023-06-23T18:45:19.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.890+0000 7f45e3c4b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc1417c0 con 0x7f45dc148f40 2023-06-23T18:45:19.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.890+0000 7f45e11e6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45dc142890 0x7f45dc06fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:19.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.890+0000 7f45e11e6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45dc142890 0x7f45dc06fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56886/0 (socket says 172.21.15.52:56886) 2023-06-23T18:45:19.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.890+0000 7f45e11e6700 1 -- 172.21.15.52:0/1644762426 learned_addr learned my addr 172.21.15.52:0/1644762426 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:19.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.890+0000 7f45e21e8700 1 --2- 172.21.15.52:0/1644762426 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45dc148f40 0x7f45dc135aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:19.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.890+0000 7f45e19e7700 1 --2- 172.21.15.52:0/1644762426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45dc0b8e60 0x7f45dc0bbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:19.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.890+0000 7f45e11e6700 1 -- 172.21.15.52:0/1644762426 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45dc148f40 msgr2=0x7f45dc135aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:19.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.890+0000 7f45e11e6700 1 --2- 172.21.15.52:0/1644762426 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45dc148f40 0x7f45dc135aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.901 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.890+0000 7f45e11e6700 1 -- 172.21.15.52:0/1644762426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45dc0b8e60 msgr2=0x7f45dc0bbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:19.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.890+0000 7f45e11e6700 1 --2- 172.21.15.52:0/1644762426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45dc0b8e60 0x7f45dc0bbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:19.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.890+0000 7f45e11e6700 1 -- 172.21.15.52:0/1644762426 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d80094a0 con 0x7f45dc142890 2023-06-23T18:45:19.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.891+0000 7f45e11e6700 1 --2- 172.21.15.52:0/1644762426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45dc142890 0x7f45dc06fd20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f45d800ebe0 tx=0x7f45d800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:19.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.891+0000 7f45d27fc700 1 -- 172.21.15.52:0/1644762426 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d800c7f0 con 0x7f45dc142890 2023-06-23T18:45:19.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.891+0000 7f45d27fc700 1 -- 172.21.15.52:0/1644762426 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d800c950 con 0x7f45dc142890 2023-06-23T18:45:19.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.891+0000 7f45d27fc700 1 -- 172.21.15.52:0/1644762426 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d800cce0 con 0x7f45dc142890 2023-06-23T18:45:19.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.891+0000 7f45e3c4b700 1 -- 172.21.15.52:0/1644762426 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45cc0094a0 con 0x7f45dc142890 2023-06-23T18:45:19.902 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.891+0000 7f45e3c4b700 1 -- 172.21.15.52:0/1644762426 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45dc141b10 con 0x7f45dc142890 2023-06-23T18:45:19.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.892+0000 7f45e3c4b700 1 -- 172.21.15.52:0/1644762426 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45dc1420e0 con 0x7f45dc142890 2023-06-23T18:45:19.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.892+0000 7f45d27fc700 1 -- 172.21.15.52:0/1644762426 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f45d8013470 con 0x7f45dc142890 2023-06-23T18:45:19.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.893+0000 7f45d27fc700 1 --2- 172.21.15.52:0/1644762426 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f45c006ace0 0x7f45c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:19.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.893+0000 7f45d27fc700 1 -- 172.21.15.52:0/1644762426 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f45d8089410 con 0x7f45dc142890 2023-06-23T18:45:19.903 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.893+0000 7f45e19e7700 1 --2- 172.21.15.52:0/1644762426 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f45c006ace0 0x7f45c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:19.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.893+0000 7f45e19e7700 1 --2- 172.21.15.52:0/1644762426 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f45c006ace0 0x7f45c006d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f45cc000c00 tx=0x7f45cc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:19.904 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:19.897+0000 7f45d27fc700 1 -- 172.21.15.52:0/1644762426 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f45d8054550 con 0x7f45dc142890 2023-06-23T18:45:20.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.093+0000 7f45e3c4b700 1 -- 172.21.15.52:0/1644762426 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45dc04e1d0 con 0x7f45dc142890 2023-06-23T18:45:20.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.094+0000 7f45d27fc700 1 -- 172.21.15.52:0/1644762426 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45d8057b70 con 0x7f45dc142890 2023-06-23T18:45:20.099 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2023-06-23T18:45:20.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.096+0000 7f45e3c4b700 1 -- 172.21.15.52:0/1644762426 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f45c006ace0 msgr2=0x7f45c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.096+0000 7f45e3c4b700 1 --2- 172.21.15.52:0/1644762426 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f45c006ace0 0x7f45c006d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f45cc000c00 tx=0x7f45cc008030 comp rx=0 tx=0).stop 2023-06-23T18:45:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.096+0000 7f45e3c4b700 1 -- 172.21.15.52:0/1644762426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45dc142890 msgr2=0x7f45dc06fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.096+0000 7f45e3c4b700 1 --2- 172.21.15.52:0/1644762426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45dc142890 0x7f45dc06fd20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f45d800ebe0 tx=0x7f45d800eef0 comp rx=0 tx=0).stop 2023-06-23T18:45:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.096+0000 7f45e3c4b700 1 -- 172.21.15.52:0/1644762426 shutdown_connections 2023-06-23T18:45:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.096+0000 7f45e3c4b700 1 --2- 172.21.15.52:0/1644762426 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f45c006ace0 0x7f45c006d190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:20.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.096+0000 7f45e3c4b700 1 --2- 172.21.15.52:0/1644762426 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45dc148f40 0x7f45dc135aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.096+0000 7f45e3c4b700 1 --2- 172.21.15.52:0/1644762426 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45dc0b8e60 0x7f45dc0bbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.096+0000 7f45e3c4b700 1 --2- 172.21.15.52:0/1644762426 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f45dc142890 0x7f45dc06fd20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.096+0000 7f45e3c4b700 1 -- 172.21.15.52:0/1644762426 >> 172.21.15.52:0/1644762426 conn(0x7f45dc0b95c0 msgr2=0x7f45dc1d1930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.096+0000 7f45e3c4b700 1 -- 172.21.15.52:0/1644762426 shutdown_connections 2023-06-23T18:45:20.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.096+0000 7f45e3c4b700 1 -- 172.21.15.52:0/1644762426 wait complete. 2023-06-23T18:45:20.112 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T18:45:20.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.236+0000 7fb980ae0700 1 Processor -- start 2023-06-23T18:45:20.241 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.236+0000 7fb980ae0700 1 -- start start 2023-06-23T18:45:20.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.237+0000 7fb980ae0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb97c0b8c80 0x7fb97c071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:20.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.237+0000 7fb980ae0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb97c1479f0 0x7fb97c151a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:20.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.237+0000 7fb980ae0700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb97c0b8360 con 0x7fb97c141220 2023-06-23T18:45:20.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.237+0000 7fb980ae0700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb97c0b4bb0 con 0x7fb97c1479f0 2023-06-23T18:45:20.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.237+0000 7fb980ae0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb97c0b7da0 con 0x7fb97c0b8c80 2023-06-23T18:45:20.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.237+0000 7fb97ad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb97c1479f0 0x7fb97c151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:20.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.237+0000 7fb979d9b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb97c141220 0x7fb97c1472e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37900/0 (socket says 172.21.15.52:37900) 2023-06-23T18:45:20.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.237+0000 7fb97ad9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb97c1479f0 0x7fb97c151a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56888/0 (socket says 172.21.15.52:56888) 2023-06-23T18:45:20.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.237+0000 7fb979d9b700 1 -- 172.21.15.52:0/1305873435 learned_addr learned my addr 172.21.15.52:0/1305873435 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:20.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.238+0000 7fb97a59c700 1 --2- 172.21.15.52:0/1305873435 >> v2:172.21.15.89:3300/0 conn(0x7fb97c0b8c80 0x7fb97c071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:20.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.238+0000 7fb97ad9d700 1 -- 172.21.15.52:0/1305873435 >> v2:172.21.15.89:3300/0 conn(0x7fb97c0b8c80 msgr2=0x7fb97c071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:20.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.238+0000 7fb97ad9d700 1 --2- 172.21.15.52:0/1305873435 >> v2:172.21.15.89:3300/0 conn(0x7fb97c0b8c80 0x7fb97c071240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:20.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.238+0000 7fb97ad9d700 1 -- 172.21.15.52:0/1305873435 >> v1:172.21.15.52:6789/0 conn(0x7fb97c141220 legacy=0x7fb97c1472e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:20.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.238+0000 7fb97959a700 1 -- 172.21.15.52:0/1305873435 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278867368 0 0) 0x7fb97c0b8360 con 0x7fb97c141220 2023-06-23T18:45:20.245 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.238+0000 7fb97ad9d700 1 -- 172.21.15.52:0/1305873435 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97c0b8080 con 0x7fb97c1479f0 2023-06-23T18:45:20.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.238+0000 7fb97ad9d700 1 --2- 172.21.15.52:0/1305873435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb97c1479f0 0x7fb97c151a80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb97c0b9470 tx=0x7fb97400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca53e74f6ba1eb82 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:20.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.238+0000 7fb97959a700 1 -- 172.21.15.52:0/1305873435 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97400e070 con 0x7fb97c1479f0 2023-06-23T18:45:20.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.238+0000 7fb97959a700 1 -- 172.21.15.52:0/1305873435 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97400bbd0 con 0x7fb97c1479f0 2023-06-23T18:45:20.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.238+0000 7fb97959a700 1 -- 172.21.15.52:0/1305873435 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb974012430 con 0x7fb97c1479f0 2023-06-23T18:45:20.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.239+0000 7fb980ae0700 1 -- 172.21.15.52:0/1305873435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb97c1479f0 msgr2=0x7fb97c151a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:20.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.239+0000 7fb980ae0700 1 --2- 172.21.15.52:0/1305873435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb97c1479f0 0x7fb97c151a80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb97c0b9470 tx=0x7fb97400b330 comp rx=0 tx=0).stop 2023-06-23T18:45:20.246 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.239+0000 7fb980ae0700 1 -- 172.21.15.52:0/1305873435 shutdown_connections 2023-06-23T18:45:20.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.239+0000 7fb980ae0700 1 --2- 172.21.15.52:0/1305873435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb97c1479f0 0x7fb97c151a80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:20.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.239+0000 7fb980ae0700 1 --2- 172.21.15.52:0/1305873435 >> v2:172.21.15.89:3300/0 conn(0x7fb97c0b8c80 0x7fb97c071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:20.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.239+0000 7fb980ae0700 1 -- 172.21.15.52:0/1305873435 >> 172.21.15.52:0/1305873435 conn(0x7fb97c0bd420 msgr2=0x7fb97c0bd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:20.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.239+0000 7fb980ae0700 1 -- 172.21.15.52:0/1305873435 shutdown_connections 2023-06-23T18:45:20.247 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.239+0000 7fb980ae0700 1 -- 172.21.15.52:0/1305873435 wait complete. 2023-06-23T18:45:20.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.240+0000 7fb980ae0700 1 Processor -- start 2023-06-23T18:45:20.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.240+0000 7fb980ae0700 1 -- start start 2023-06-23T18:45:20.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.241+0000 7fb980ae0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb97c0b8c80 0x7fb97c0bc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:20.249 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.241+0000 7fb980ae0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb97c141220 0x7fb97c13dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:20.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.241+0000 7fb980ae0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb97c1479f0 0x7fb97c0bb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:20.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.241+0000 7fb980ae0700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c13e0f0 con 0x7fb97c141220 2023-06-23T18:45:20.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.241+0000 7fb980ae0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c1d0320 con 0x7fb97c0b8c80 2023-06-23T18:45:20.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.241+0000 7fb980ae0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c13f280 con 0x7fb97c1479f0 2023-06-23T18:45:20.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.241+0000 7fb979d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb97c141220 0x7fb97c13dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:20.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.241+0000 7fb979d9b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb97c141220 0x7fb97c13dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56900/0 (socket says 172.21.15.52:56900) 2023-06-23T18:45:20.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.241+0000 7fb979d9b700 1 -- 172.21.15.52:0/3252257306 learned_addr learned my addr 172.21.15.52:0/3252257306 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:20.250 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.241+0000 7fb97a59c700 1 --2- 172.21.15.52:0/3252257306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb97c0b8c80 0x7fb97c0bc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:20.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.241+0000 7fb97ad9d700 1 --2- 172.21.15.52:0/3252257306 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb97c1479f0 0x7fb97c0bb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:20.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.241+0000 7fb979d9b700 1 -- 172.21.15.52:0/3252257306 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb97c1479f0 msgr2=0x7fb97c0bb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:20.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.241+0000 7fb979d9b700 1 --2- 172.21.15.52:0/3252257306 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb97c1479f0 0x7fb97c0bb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:20.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.241+0000 7fb979d9b700 1 -- 172.21.15.52:0/3252257306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb97c0b8c80 msgr2=0x7fb97c0bc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:20.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.241+0000 7fb979d9b700 1 --2- 172.21.15.52:0/3252257306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb97c0b8c80 0x7fb97c0bc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:20.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.241+0000 7fb979d9b700 1 -- 172.21.15.52:0/3252257306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb974009a70 con 0x7fb97c141220 2023-06-23T18:45:20.251 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.241+0000 7fb979d9b700 1 --2- 172.21.15.52:0/3252257306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb97c141220 0x7fb97c13dbb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0011e0 tx=0x7fb96c00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:20.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.241+0000 7fb96affd700 1 -- 172.21.15.52:0/3252257306 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c004c80 con 0x7fb97c141220 2023-06-23T18:45:20.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.241+0000 7fb96affd700 1 -- 172.21.15.52:0/3252257306 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96c004e00 con 0x7fb97c141220 2023-06-23T18:45:20.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.241+0000 7fb980ae0700 1 -- 172.21.15.52:0/3252257306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb97c0bcd70 con 0x7fb97c141220 2023-06-23T18:45:20.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.241+0000 7fb96affd700 1 -- 172.21.15.52:0/3252257306 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c007310 con 0x7fb97c141220 2023-06-23T18:45:20.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.241+0000 7fb980ae0700 1 -- 172.21.15.52:0/3252257306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb97c1cffb0 con 0x7fb97c141220 2023-06-23T18:45:20.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.242+0000 7fb980ae0700 1 -- 172.21.15.52:0/3252257306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb97c04e1d0 con 0x7fb97c141220 2023-06-23T18:45:20.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.243+0000 7fb96affd700 1 -- 172.21.15.52:0/3252257306 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb96c007470 con 0x7fb97c141220 2023-06-23T18:45:20.252 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.243+0000 7fb96affd700 1 --2- 172.21.15.52:0/3252257306 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fb95c06ace0 0x7fb95c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:20.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.243+0000 7fb96affd700 1 -- 172.21.15.52:0/3252257306 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb96c0890d0 con 0x7fb97c141220 2023-06-23T18:45:20.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.244+0000 7fb97a59c700 1 --2- 172.21.15.52:0/3252257306 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fb95c06ace0 0x7fb95c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:20.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.244+0000 7fb97a59c700 1 --2- 172.21.15.52:0/3252257306 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fb95c06ace0 0x7fb95c06d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb970006b20 tx=0x7fb970008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:20.253 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.248+0000 7fb96affd700 1 -- 172.21.15.52:0/3252257306 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb96c054180 con 0x7fb97c141220 2023-06-23T18:45:20.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.443+0000 7fb980ae0700 1 -- 172.21.15.52:0/3252257306 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb97c0ba7c0 con 0x7fb97c141220 2023-06-23T18:45:20.449 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.444+0000 7fb96affd700 1 -- 172.21.15.52:0/3252257306 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb96c0577a0 con 0x7fb97c141220 2023-06-23T18:45:20.449 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-06-23T18:45:20.451 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.446+0000 7fb980ae0700 1 -- 172.21.15.52:0/3252257306 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fb95c06ace0 msgr2=0x7fb95c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:20.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.446+0000 7fb980ae0700 1 --2- 172.21.15.52:0/3252257306 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fb95c06ace0 0x7fb95c06d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb970006b20 tx=0x7fb970008040 comp rx=0 tx=0).stop 2023-06-23T18:45:20.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.446+0000 7fb980ae0700 1 -- 172.21.15.52:0/3252257306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb97c141220 msgr2=0x7fb97c13dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:20.452 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.446+0000 7fb980ae0700 1 --2- 172.21.15.52:0/3252257306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb97c141220 0x7fb97c13dbb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb96c0011e0 tx=0x7fb96c00ca30 comp rx=0 tx=0).stop 2023-06-23T18:45:20.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.446+0000 7fb980ae0700 1 -- 172.21.15.52:0/3252257306 shutdown_connections 2023-06-23T18:45:20.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.446+0000 7fb980ae0700 1 --2- 172.21.15.52:0/3252257306 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fb95c06ace0 0x7fb95c06d190 secure :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb970006b20 tx=0x7fb970008040 comp rx=0 tx=0).stop 2023-06-23T18:45:20.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.446+0000 7fb980ae0700 1 --2- 172.21.15.52:0/3252257306 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb97c1479f0 0x7fb97c0bb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:20.453 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.446+0000 7fb980ae0700 1 --2- 172.21.15.52:0/3252257306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb97c0b8c80 0x7fb97c0bc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:20.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.446+0000 7fb980ae0700 1 --2- 172.21.15.52:0/3252257306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb97c141220 0x7fb97c13dbb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:20.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.446+0000 7fb980ae0700 1 -- 172.21.15.52:0/3252257306 >> 172.21.15.52:0/3252257306 conn(0x7fb97c0bd420 msgr2=0x7fb97c0b9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:20.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.446+0000 7fb980ae0700 1 -- 172.21.15.52:0/3252257306 shutdown_connections 2023-06-23T18:45:20.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.446+0000 7fb980ae0700 1 -- 172.21.15.52:0/3252257306 wait complete. 2023-06-23T18:45:20.463 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-23T18:45:20.589 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.585+0000 7f43ebbc0700 1 Processor -- start 2023-06-23T18:45:20.590 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.585+0000 7f43ebbc0700 1 -- start start 2023-06-23T18:45:20.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.586+0000 7f43ebbc0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e406c1f0 0x7f43e40b8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:20.591 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.586+0000 7f43ebbc0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f43e40b9310 0x7f43e41443e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:20.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.586+0000 7f43ebbc0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e40b98a0 con 0x7f43e414da40 2023-06-23T18:45:20.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.586+0000 7f43ebbc0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e414a6a0 con 0x7f43e40b9310 2023-06-23T18:45:20.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.586+0000 7f43ebbc0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e414a980 con 0x7f43e406c1f0 2023-06-23T18:45:20.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.586+0000 7f43e995c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e406c1f0 0x7f43e40b8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:20.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.586+0000 7f43e915b700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f43e414da40 0x7f43e414aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.52:59042/0 (socket says 172.21.15.52:59042) 2023-06-23T18:45:20.592 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.586+0000 7f43ea15d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f43e40b9310 0x7f43e41443e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:20.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.586+0000 7f43e995c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e406c1f0 0x7f43e40b8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.52:52012/0 (socket says 172.21.15.52:52012) 2023-06-23T18:45:20.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.586+0000 7f43e915b700 1 -- 172.21.15.52:0/3273797158 learned_addr learned my addr 172.21.15.52:0/3273797158 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:20.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.586+0000 7f43e895a700 1 -- 172.21.15.52:0/3273797158 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794815620 0 0) 0x7f43e40b98a0 con 0x7f43e414da40 2023-06-23T18:45:20.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.586+0000 7f43e895a700 1 -- 172.21.15.52:0/3273797158 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43d00035b0 con 0x7f43e414da40 2023-06-23T18:45:20.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.586+0000 7f43e995c700 1 -- 172.21.15.52:0/3273797158 >> v2:172.21.15.89:3300/0 conn(0x7f43e40b9310 msgr2=0x7f43e41443e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:20.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.586+0000 7f43e995c700 1 --2- 172.21.15.52:0/3273797158 >> v2:172.21.15.89:3300/0 conn(0x7f43e40b9310 0x7f43e41443e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:20.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.586+0000 7f43e995c700 1 -- 172.21.15.52:0/3273797158 >> v1:172.21.15.89:6789/0 conn(0x7f43e414da40 legacy=0x7f43e414aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:20.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.586+0000 7f43e995c700 1 -- 172.21.15.52:0/3273797158 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e406c5c0 con 0x7f43e406c1f0 2023-06-23T18:45:20.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.587+0000 7f43e995c700 1 --2- 172.21.15.52:0/3273797158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e406c1f0 0x7f43e40b8870 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f43e0009840 tx=0x7f43e0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f8defe340cb3178 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:20.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.587+0000 7f43e895a700 1 -- 172.21.15.52:0/3273797158 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e0011830 con 0x7f43e406c1f0 2023-06-23T18:45:20.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.587+0000 7f43e895a700 1 -- 172.21.15.52:0/3273797158 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e0011990 con 0x7f43e406c1f0 2023-06-23T18:45:20.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.587+0000 7f43e895a700 1 -- 172.21.15.52:0/3273797158 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e0011d20 con 0x7f43e406c1f0 2023-06-23T18:45:20.596 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.587+0000 7f43ebbc0700 1 -- 172.21.15.52:0/3273797158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e406c1f0 msgr2=0x7f43e40b8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:20.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.587+0000 7f43ebbc0700 1 --2- 172.21.15.52:0/3273797158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e406c1f0 0x7f43e40b8870 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f43e0009840 tx=0x7f43e0009b50 comp rx=0 tx=0).stop 2023-06-23T18:45:20.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.587+0000 7f43ebbc0700 1 -- 172.21.15.52:0/3273797158 shutdown_connections 2023-06-23T18:45:20.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.587+0000 7f43ebbc0700 1 --2- 172.21.15.52:0/3273797158 >> v2:172.21.15.89:3300/0 conn(0x7f43e40b9310 0x7f43e41443e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:20.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.587+0000 7f43ebbc0700 1 --2- 172.21.15.52:0/3273797158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e406c1f0 0x7f43e40b8870 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:20.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.587+0000 7f43ebbc0700 1 -- 172.21.15.52:0/3273797158 >> 172.21.15.52:0/3273797158 conn(0x7f43e40bdf30 msgr2=0x7f43e40b9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:20.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.587+0000 7f43ebbc0700 1 -- 172.21.15.52:0/3273797158 shutdown_connections 2023-06-23T18:45:20.597 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.587+0000 7f43ebbc0700 1 -- 172.21.15.52:0/3273797158 wait complete. 2023-06-23T18:45:20.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.588+0000 7f43ebbc0700 1 Processor -- start 2023-06-23T18:45:20.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.589+0000 7f43ebbc0700 1 -- start start 2023-06-23T18:45:20.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.589+0000 7f43ebbc0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e406c1f0 0x7f43e4145690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:20.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.589+0000 7f43ebbc0700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43e40b9310 0x7f43e41e0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:20.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.589+0000 7f43ebbc0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43e414da40 0x7f43e40b6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:20.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.589+0000 7f43ebbc0700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e40b7760 con 0x7f43e40b9310 2023-06-23T18:45:20.598 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.589+0000 7f43ebbc0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e41e0140 con 0x7f43e414da40 2023-06-23T18:45:20.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.589+0000 7f43ebbc0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e41e0aa0 con 0x7f43e406c1f0 2023-06-23T18:45:20.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.589+0000 7f43e915b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43e40b9310 0x7f43e41e0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:20.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.589+0000 7f43e915b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43e40b9310 0x7f43e41e0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56904/0 (socket says 172.21.15.52:56904) 2023-06-23T18:45:20.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.589+0000 7f43e915b700 1 -- 172.21.15.52:0/225395887 learned_addr learned my addr 172.21.15.52:0/225395887 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:20.599 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.589+0000 7f43e995c700 1 --2- 172.21.15.52:0/225395887 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e406c1f0 0x7f43e4145690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:20.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.589+0000 7f43ea15d700 1 --2- 172.21.15.52:0/225395887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43e414da40 0x7f43e40b6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:20.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.590+0000 7f43e915b700 1 -- 172.21.15.52:0/225395887 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e406c1f0 msgr2=0x7f43e4145690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:20.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.590+0000 7f43e915b700 1 --2- 172.21.15.52:0/225395887 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e406c1f0 0x7f43e4145690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:20.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.590+0000 7f43e915b700 1 -- 172.21.15.52:0/225395887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43e414da40 msgr2=0x7f43e40b6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:20.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.590+0000 7f43e915b700 1 --2- 172.21.15.52:0/225395887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43e414da40 0x7f43e40b6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:20.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.590+0000 7f43e915b700 1 -- 172.21.15.52:0/225395887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e00094a0 con 0x7f43e40b9310 2023-06-23T18:45:20.600 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.590+0000 7f43e995c700 1 --2- 172.21.15.52:0/225395887 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e406c1f0 0x7f43e4145690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:45:20.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.590+0000 7f43e915b700 1 --2- 172.21.15.52:0/225395887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43e40b9310 0x7f43e41e0560 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f43d4001eb0 tx=0x7f43d400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:20.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.590+0000 7f43da7fc700 1 -- 172.21.15.52:0/225395887 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d4005d70 con 0x7f43e40b9310 2023-06-23T18:45:20.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.590+0000 7f43da7fc700 1 -- 172.21.15.52:0/225395887 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d40070d0 con 0x7f43e40b9310 2023-06-23T18:45:20.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.590+0000 7f43ebbc0700 1 -- 172.21.15.52:0/225395887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e4145d70 con 0x7f43e40b9310 2023-06-23T18:45:20.601 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.590+0000 7f43da7fc700 1 -- 172.21.15.52:0/225395887 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d4007460 con 0x7f43e40b9310 2023-06-23T18:45:20.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.590+0000 7f43ebbc0700 1 -- 172.21.15.52:0/225395887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e41dfd60 con 0x7f43e40b9310 2023-06-23T18:45:20.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.591+0000 7f43ebbc0700 1 -- 172.21.15.52:0/225395887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e41dfbc0 con 0x7f43e40b9310 2023-06-23T18:45:20.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.592+0000 7f43da7fc700 1 -- 172.21.15.52:0/225395887 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f43d40075c0 con 0x7f43e40b9310 2023-06-23T18:45:20.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.592+0000 7f43da7fc700 1 --2- 172.21.15.52:0/225395887 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f43c806ace0 0x7f43c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:20.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.592+0000 7f43da7fc700 1 -- 172.21.15.52:0/225395887 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f43d40888a0 con 0x7f43e40b9310 2023-06-23T18:45:20.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.592+0000 7f43e995c700 1 --2- 172.21.15.52:0/225395887 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f43c806ace0 0x7f43c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:20.604 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.593+0000 7f43e995c700 1 --2- 172.21.15.52:0/225395887 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f43c806ace0 0x7f43c806d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f43e0000c00 tx=0x7f43e0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:20.605 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.597+0000 7f43da7fc700 1 -- 172.21.15.52:0/225395887 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f43e41dfbc0 con 0x7f43e40b9310 2023-06-23T18:45:20.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.809+0000 7f43ebbc0700 1 -- 172.21.15.52:0/225395887 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f43e41dfbc0 con 0x7f43e40b9310 2023-06-23T18:45:20.814 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.810+0000 7f43da7fc700 1 -- 172.21.15.52:0/225395887 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f43e41dfbc0 con 0x7f43e40b9310 2023-06-23T18:45:20.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.812+0000 7f43ebbc0700 1 -- 172.21.15.52:0/225395887 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f43c806ace0 msgr2=0x7f43c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:20.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.812+0000 7f43ebbc0700 1 --2- 172.21.15.52:0/225395887 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f43c806ace0 0x7f43c806d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f43e0000c00 tx=0x7f43e0008030 comp rx=0 tx=0).stop 2023-06-23T18:45:20.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.812+0000 7f43ebbc0700 1 -- 172.21.15.52:0/225395887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43e40b9310 msgr2=0x7f43e41e0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:20.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.812+0000 7f43ebbc0700 1 --2- 172.21.15.52:0/225395887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43e40b9310 0x7f43e41e0560 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f43d4001eb0 tx=0x7f43d400c7b0 comp rx=0 tx=0).stop 2023-06-23T18:45:20.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.812+0000 7f43ebbc0700 1 -- 172.21.15.52:0/225395887 shutdown_connections 2023-06-23T18:45:20.817 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.812+0000 7f43ebbc0700 1 --2- 172.21.15.52:0/225395887 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f43c806ace0 0x7f43c806d190 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:20.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.812+0000 7f43ebbc0700 1 --2- 172.21.15.52:0/225395887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f43e414da40 0x7f43e40b6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:20.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.812+0000 7f43ebbc0700 1 --2- 172.21.15.52:0/225395887 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43e406c1f0 0x7f43e4145690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:20.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.812+0000 7f43ebbc0700 1 --2- 172.21.15.52:0/225395887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43e40b9310 0x7f43e41e0560 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:20.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.812+0000 7f43ebbc0700 1 -- 172.21.15.52:0/225395887 >> 172.21.15.52:0/225395887 conn(0x7f43e40bdf30 msgr2=0x7f43e40bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:20.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.812+0000 7f43ebbc0700 1 -- 172.21.15.52:0/225395887 shutdown_connections 2023-06-23T18:45:20.818 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:20.812+0000 7f43ebbc0700 1 -- 172.21.15.52:0/225395887 wait complete. 2023-06-23T18:45:20.819 INFO:teuthology.orchestra.run.smithi052.stderr:listed 0 entries 2023-06-23T18:45:20.828 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-06-23T18:45:20.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:20.829 DEBUG:teuthology.orchestra.run.smithi158:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-06-23T18:45:20.918 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi158.front.sepia.ceph.com 2023-06-23T18:45:20.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:20.919 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-23T18:45:20.981 INFO:tasks.cephfs.cephfs_test_case:[] 2023-06-23T18:45:20.982 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T18:45:21.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.103+0000 7f2c9ada1700 1 Processor -- start 2023-06-23T18:45:21.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.104+0000 7f2c9ada1700 1 -- start start 2023-06-23T18:45:21.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c9ada1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c941446e0 0x7f2c9406fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:21.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c9ada1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2c940b8fe0 0x7f2c94154d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:21.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c9ada1700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c940b67d0 con 0x7f2c940b6c60 2023-06-23T18:45:21.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c9ada1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c940723d0 con 0x7f2c940b8fe0 2023-06-23T18:45:21.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c9ada1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9406b610 con 0x7f2c941446e0 2023-06-23T18:45:21.111 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c8bfff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2c940b6c60 0x7f2c9406af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37916/0 (socket says 172.21.15.52:37916) 2023-06-23T18:45:21.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c8bfff700 1 -- 172.21.15.52:0/1671853006 learned_addr learned my addr 172.21.15.52:0/1671853006 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:21.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c98b3d700 1 --2- 172.21.15.52:0/1671853006 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c941446e0 0x7f2c9406fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:21.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c9933e700 1 --2- 172.21.15.52:0/1671853006 >> v2:172.21.15.89:3300/0 conn(0x7f2c940b8fe0 0x7f2c94154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:21.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c8b7fe700 1 -- 172.21.15.52:0/1671853006 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4099224379 0 0) 0x7f2c940b67d0 con 0x7f2c940b6c60 2023-06-23T18:45:21.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c8b7fe700 1 -- 172.21.15.52:0/1671853006 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c7c0035b0 con 0x7f2c940b6c60 2023-06-23T18:45:21.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c8b7fe700 1 -- 172.21.15.52:0/1671853006 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4051300354 0 0) 0x7f2c7c0035b0 con 0x7f2c940b6c60 2023-06-23T18:45:21.112 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c8b7fe700 1 -- 172.21.15.52:0/1671853006 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c941446e0 msgr2=0x7f2c9406fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:21.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c8b7fe700 1 --2- 172.21.15.52:0/1671853006 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c941446e0 0x7f2c9406fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:21.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c8b7fe700 1 -- 172.21.15.52:0/1671853006 >> v2:172.21.15.89:3300/0 conn(0x7f2c940b8fe0 msgr2=0x7f2c94154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:21.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c8b7fe700 1 --2- 172.21.15.52:0/1671853006 >> v2:172.21.15.89:3300/0 conn(0x7f2c940b8fe0 0x7f2c94154d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:21.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c8b7fe700 1 -- 172.21.15.52:0/1671853006 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c940720f0 con 0x7f2c940b6c60 2023-06-23T18:45:21.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c8b7fe700 1 -- 172.21.15.52:0/1671853006 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7f2c84001670 con 0x7f2c940b6c60 2023-06-23T18:45:21.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c8b7fe700 1 -- 172.21.15.52:0/1671853006 >> v1:172.21.15.52:6789/0 conn(0x7f2c940b6c60 legacy=0x7f2c9406af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:21.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c8b7fe700 1 --2- 172.21.15.52:0/1671853006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c7c003a00 0x7f2c7c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:21.113 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c8b7fe700 1 --2- 172.21.15.52:0/1671853006 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c941446e0 0x7f2c7c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:21.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c8b7fe700 1 --2- 172.21.15.52:0/1671853006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c7c004d90 0x7f2c7c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:21.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c8b7fe700 1 -- 172.21.15.52:0/1671853006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940723d0 con 0x7f2c7c003a00 2023-06-23T18:45:21.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c8b7fe700 1 -- 172.21.15.52:0/1671853006 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9406b610 con 0x7f2c7c004d90 2023-06-23T18:45:21.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c8b7fe700 1 -- 172.21.15.52:0/1671853006 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c00ba10 con 0x7f2c941446e0 2023-06-23T18:45:21.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c9933e700 1 --2- 172.21.15.52:0/1671853006 >> v2:172.21.15.89:3300/0 conn(0x7f2c940b8fe0 0x7f2c94154d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:45:21.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.105+0000 7f2c98b3d700 1 --2- 172.21.15.52:0/1671853006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c7c003a00 0x7f2c7c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:21.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.106+0000 7f2c8bfff700 1 --2- 172.21.15.52:0/1671853006 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c941446e0 0x7f2c7c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:21.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.106+0000 7f2c9933e700 1 --2- 172.21.15.52:0/1671853006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c7c004d90 0x7f2c7c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:21.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.106+0000 7f2c98b3d700 1 -- 172.21.15.52:0/1671853006 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c941446e0 msgr2=0x7f2c7c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:21.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.106+0000 7f2c98b3d700 1 --2- 172.21.15.52:0/1671853006 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c941446e0 0x7f2c7c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:21.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.106+0000 7f2c98b3d700 1 -- 172.21.15.52:0/1671853006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c7c004d90 msgr2=0x7f2c7c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:21.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.106+0000 7f2c98b3d700 1 --2- 172.21.15.52:0/1671853006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c7c004d90 0x7f2c7c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:21.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.106+0000 7f2c98b3d700 1 -- 172.21.15.52:0/1671853006 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7c0035b0 con 0x7f2c7c003a00 2023-06-23T18:45:21.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.106+0000 7f2c9933e700 1 --2- 172.21.15.52:0/1671853006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c7c004d90 0x7f2c7c005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:21.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.106+0000 7f2c98b3d700 1 --2- 172.21.15.52:0/1671853006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c7c003a00 0x7f2c7c003e10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009b90 tx=0x7f2c7c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9791c1b7666ed7a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:21.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.106+0000 7f2c8b7fe700 1 -- 172.21.15.52:0/1671853006 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9000e660 con 0x7f2c7c003a00 2023-06-23T18:45:21.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.106+0000 7f2c8b7fe700 1 -- 172.21.15.52:0/1671853006 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9000e7c0 con 0x7f2c7c003a00 2023-06-23T18:45:21.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.106+0000 7f2c8b7fe700 1 -- 172.21.15.52:0/1671853006 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9000eb30 con 0x7f2c7c003a00 2023-06-23T18:45:21.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.107+0000 7f2c9ada1700 1 -- 172.21.15.52:0/1671853006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c7c003a00 msgr2=0x7f2c7c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:21.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.107+0000 7f2c9ada1700 1 --2- 172.21.15.52:0/1671853006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c7c003a00 0x7f2c7c003e10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009b90 tx=0x7f2c7c005880 comp rx=0 tx=0).stop 2023-06-23T18:45:21.118 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.107+0000 7f2c9933e700 1 -- 172.21.15.52:0/1671853006 reap_dead start 2023-06-23T18:45:21.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.107+0000 7f2c9ada1700 1 -- 172.21.15.52:0/1671853006 shutdown_connections 2023-06-23T18:45:21.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.107+0000 7f2c9ada1700 1 -- 172.21.15.52:0/1671853006 >> 172.21.15.52:0/1671853006 conn(0x7f2c940bd690 msgr2=0x7f2c940b9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:21.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.107+0000 7f2c9ada1700 1 -- 172.21.15.52:0/1671853006 shutdown_connections 2023-06-23T18:45:21.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.107+0000 7f2c9ada1700 1 -- 172.21.15.52:0/1671853006 wait complete. 2023-06-23T18:45:21.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.108+0000 7f2c9ada1700 1 Processor -- start 2023-06-23T18:45:21.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.108+0000 7f2c9ada1700 1 -- start start 2023-06-23T18:45:21.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.109+0000 7f2c9ada1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c7c003a00 0x7f2c9413d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:21.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.109+0000 7f2c9ada1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c94142ac0 0x7f2c94141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:21.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.109+0000 7f2c9ada1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c941e3880 0x7f2c940b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:21.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.109+0000 7f2c9ada1700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9413d780 con 0x7f2c94142ac0 2023-06-23T18:45:21.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.109+0000 7f2c9ada1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c94143870 con 0x7f2c941e3880 2023-06-23T18:45:21.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.109+0000 7f2c9ada1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c941422e0 con 0x7f2c7c003a00 2023-06-23T18:45:21.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.109+0000 7f2c8bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c94142ac0 0x7f2c94141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:21.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.109+0000 7f2c8bfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c94142ac0 0x7f2c94141ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56926/0 (socket says 172.21.15.52:56926) 2023-06-23T18:45:21.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.109+0000 7f2c8bfff700 1 -- 172.21.15.52:0/1086110259 learned_addr learned my addr 172.21.15.52:0/1086110259 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:21.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.109+0000 7f2c98b3d700 1 --2- 172.21.15.52:0/1086110259 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c7c003a00 0x7f2c9413d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:21.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.109+0000 7f2c9933e700 1 --2- 172.21.15.52:0/1086110259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c941e3880 0x7f2c940b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:21.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.110+0000 7f2c8bfff700 1 -- 172.21.15.52:0/1086110259 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c7c003a00 msgr2=0x7f2c9413d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:21.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.110+0000 7f2c8bfff700 1 --2- 172.21.15.52:0/1086110259 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c7c003a00 0x7f2c9413d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:21.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.110+0000 7f2c8bfff700 1 -- 172.21.15.52:0/1086110259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c941e3880 msgr2=0x7f2c940b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:21.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.110+0000 7f2c8bfff700 1 --2- 172.21.15.52:0/1086110259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c941e3880 0x7f2c940b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:21.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.110+0000 7f2c8bfff700 1 -- 172.21.15.52:0/1086110259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c94143220 con 0x7f2c94142ac0 2023-06-23T18:45:21.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.110+0000 7f2c8bfff700 1 --2- 172.21.15.52:0/1086110259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c94142ac0 0x7f2c94141ac0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2c84007310 tx=0x7f2c84007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:21.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.110+0000 7f2c897fa700 1 -- 172.21.15.52:0/1086110259 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c84007ca0 con 0x7f2c94142ac0 2023-06-23T18:45:21.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.110+0000 7f2c897fa700 1 -- 172.21.15.52:0/1086110259 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8400f5e0 con 0x7f2c94142ac0 2023-06-23T18:45:21.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.110+0000 7f2c9ada1700 1 -- 172.21.15.52:0/1086110259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c94143500 con 0x7f2c94142ac0 2023-06-23T18:45:21.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.110+0000 7f2c897fa700 1 -- 172.21.15.52:0/1086110259 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8400f970 con 0x7f2c94142ac0 2023-06-23T18:45:21.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.110+0000 7f2c9ada1700 1 -- 172.21.15.52:0/1086110259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c94143d00 con 0x7f2c94142ac0 2023-06-23T18:45:21.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.111+0000 7f2c9ada1700 1 -- 172.21.15.52:0/1086110259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c941439e0 con 0x7f2c94142ac0 2023-06-23T18:45:21.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.111+0000 7f2c897fa700 1 -- 172.21.15.52:0/1086110259 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2c8400fad0 con 0x7f2c94142ac0 2023-06-23T18:45:21.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.112+0000 7f2c897fa700 1 --2- 172.21.15.52:0/1086110259 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2c8006ace0 0x7f2c8006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:21.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.112+0000 7f2c897fa700 1 -- 172.21.15.52:0/1086110259 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2c84089530 con 0x7f2c94142ac0 2023-06-23T18:45:21.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.112+0000 7f2c98b3d700 1 --2- 172.21.15.52:0/1086110259 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2c8006ace0 0x7f2c8006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:21.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.112+0000 7f2c98b3d700 1 --2- 172.21.15.52:0/1086110259 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2c8006ace0 0x7f2c8006d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2c900090b0 tx=0x7f2c9001f040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:21.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.116+0000 7f2c897fa700 1 -- 172.21.15.52:0/1086110259 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2c840544b0 con 0x7f2c94142ac0 2023-06-23T18:45:21.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.354+0000 7f2c9ada1700 1 -- 172.21.15.52:0/1086110259 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c9404e1d0 con 0x7f2c94142ac0 2023-06-23T18:45:21.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.354+0000 7f2c897fa700 1 -- 172.21.15.52:0/1086110259 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3906 (secure 0 0 0) 0x7f2c84057ad0 con 0x7f2c94142ac0 2023-06-23T18:45:21.359 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:21.359 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/299877491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":299877491},{"type":"v1","addr":"172.21.15.89:6835","nonce":299877491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/2826461143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2826461143},{"type":"v1","addr":"172.21.15.52:6833","nonce":2826461143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T18:44:50.642376+0000","modified":"2023-06-23T18:44:53.679243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/4214822260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4214822260},{"type":"v1","addr":"172.21.15.52:6835","nonce":4214822260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-23T18:45:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.356+0000 7f2c9ada1700 1 -- 172.21.15.52:0/1086110259 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2c8006ace0 msgr2=0x7f2c8006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.356+0000 7f2c9ada1700 1 --2- 172.21.15.52:0/1086110259 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2c8006ace0 0x7f2c8006d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2c900090b0 tx=0x7f2c9001f040 comp rx=0 tx=0).stop 2023-06-23T18:45:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.356+0000 7f2c9ada1700 1 -- 172.21.15.52:0/1086110259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c94142ac0 msgr2=0x7f2c94141ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.356+0000 7f2c9ada1700 1 --2- 172.21.15.52:0/1086110259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c94142ac0 0x7f2c94141ac0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2c84007310 tx=0x7f2c84007620 comp rx=0 tx=0).stop 2023-06-23T18:45:21.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.356+0000 7f2c9ada1700 1 -- 172.21.15.52:0/1086110259 shutdown_connections 2023-06-23T18:45:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.356+0000 7f2c9ada1700 1 --2- 172.21.15.52:0/1086110259 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2c8006ace0 0x7f2c8006d190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.356+0000 7f2c9ada1700 1 --2- 172.21.15.52:0/1086110259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c941e3880 0x7f2c940b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.356+0000 7f2c9ada1700 1 --2- 172.21.15.52:0/1086110259 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c7c003a00 0x7f2c9413d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.356+0000 7f2c9ada1700 1 --2- 172.21.15.52:0/1086110259 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2c94142ac0 0x7f2c94141ac0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.356+0000 7f2c9ada1700 1 -- 172.21.15.52:0/1086110259 >> 172.21.15.52:0/1086110259 conn(0x7f2c940bd690 msgr2=0x7f2c94069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.356+0000 7f2c9ada1700 1 -- 172.21.15.52:0/1086110259 shutdown_connections 2023-06-23T18:45:21.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.356+0000 7f2c9ada1700 1 -- 172.21.15.52:0/1086110259 wait complete. 2023-06-23T18:45:21.363 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2023-06-23T18:45:21.373 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:45:21.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.494+0000 7fbc73699700 1 Processor -- start 2023-06-23T18:45:21.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.494+0000 7fbc73699700 1 -- start start 2023-06-23T18:45:21.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.494+0000 7fbc73699700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbc6c0bb0a0 0x7fbc6c06b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:21.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.494+0000 7fbc73699700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc6c0bb970 con 0x7fbc6c0b84f0 2023-06-23T18:45:21.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.494+0000 7fbc73699700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc6c0b8900 con 0x7fbc6c14df30 2023-06-23T18:45:21.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.495+0000 7fbc73699700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc6c06b600 con 0x7fbc6c0bb0a0 2023-06-23T18:45:21.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.495+0000 7fbc71435700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbc6c0bb0a0 0x7fbc6c06b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:21.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.495+0000 7fbc70c34700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbc6c0b84f0 0x7fbc6c1442a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37932/0 (socket says 172.21.15.52:37932) 2023-06-23T18:45:21.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.495+0000 7fbc70c34700 1 -- 172.21.15.52:0/982795636 learned_addr learned my addr 172.21.15.52:0/982795636 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:21.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.495+0000 7fbc71435700 1 -- 172.21.15.52:0/982795636 >> v1:172.21.15.89:6789/0 conn(0x7fbc6c14df30 legacy=0x7fbc6c14a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:21.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.495+0000 7fbc71435700 1 -- 172.21.15.52:0/982795636 >> v1:172.21.15.52:6789/0 conn(0x7fbc6c0b84f0 legacy=0x7fbc6c1442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:21.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.495+0000 7fbc71435700 1 -- 172.21.15.52:0/982795636 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c06cfa0 con 0x7fbc6c0bb0a0 2023-06-23T18:45:21.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.495+0000 7fbc63fff700 1 -- 172.21.15.52:0/982795636 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819806155 0 0) 0x7fbc6c0bb970 con 0x7fbc6c0b84f0 2023-06-23T18:45:21.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.495+0000 7fbc71435700 1 --2- 172.21.15.52:0/982795636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc6c0bb0a0 0x7fbc6c06b000 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbc68009840 tx=0x7fbc68009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4caf8674fc8c1214 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:21.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.495+0000 7fbc63fff700 1 -- 172.21.15.52:0/982795636 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc68004230 con 0x7fbc6c0bb0a0 2023-06-23T18:45:21.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.495+0000 7fbc63fff700 1 -- 172.21.15.52:0/982795636 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc68004390 con 0x7fbc6c0bb0a0 2023-06-23T18:45:21.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.495+0000 7fbc63fff700 1 -- 172.21.15.52:0/982795636 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc680036a0 con 0x7fbc6c0bb0a0 2023-06-23T18:45:21.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.496+0000 7fbc73699700 1 -- 172.21.15.52:0/982795636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc6c0bb0a0 msgr2=0x7fbc6c06b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:21.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.496+0000 7fbc73699700 1 --2- 172.21.15.52:0/982795636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc6c0bb0a0 0x7fbc6c06b000 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbc68009840 tx=0x7fbc68009b50 comp rx=0 tx=0).stop 2023-06-23T18:45:21.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.496+0000 7fbc73699700 1 -- 172.21.15.52:0/982795636 shutdown_connections 2023-06-23T18:45:21.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.496+0000 7fbc73699700 1 --2- 172.21.15.52:0/982795636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc6c0bb0a0 0x7fbc6c06b000 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:21.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.496+0000 7fbc73699700 1 -- 172.21.15.52:0/982795636 >> 172.21.15.52:0/982795636 conn(0x7fbc6c06d210 msgr2=0x7fbc6c06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:21.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.496+0000 7fbc73699700 1 -- 172.21.15.52:0/982795636 shutdown_connections 2023-06-23T18:45:21.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.496+0000 7fbc73699700 1 -- 172.21.15.52:0/982795636 wait complete. 2023-06-23T18:45:21.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.497+0000 7fbc73699700 1 Processor -- start 2023-06-23T18:45:21.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.497+0000 7fbc73699700 1 -- start start 2023-06-23T18:45:21.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.498+0000 7fbc73699700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc6c0b84f0 0x7fbc6c1d4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:21.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.498+0000 7fbc73699700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc6c0bb0a0 0x7fbc6c1d6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:21.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.498+0000 7fbc73699700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc6c14df30 0x7fbc6c1d4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:21.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.498+0000 7fbc73699700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c1d5840 con 0x7fbc6c0b84f0 2023-06-23T18:45:21.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.498+0000 7fbc73699700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c13f880 con 0x7fbc6c14df30 2023-06-23T18:45:21.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.498+0000 7fbc73699700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c1d4670 con 0x7fbc6c0bb0a0 2023-06-23T18:45:21.506 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.498+0000 7fbc71435700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc6c0b84f0 0x7fbc6c1d4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:21.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.498+0000 7fbc71435700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc6c0b84f0 0x7fbc6c1d4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56948/0 (socket says 172.21.15.52:56948) 2023-06-23T18:45:21.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.498+0000 7fbc71435700 1 -- 172.21.15.52:0/888255045 learned_addr learned my addr 172.21.15.52:0/888255045 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:21.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.498+0000 7fbc71435700 1 -- 172.21.15.52:0/888255045 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc6c0bb0a0 msgr2=0x7fbc6c1d6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:21.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.498+0000 7fbc71435700 1 --2- 172.21.15.52:0/888255045 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc6c0bb0a0 0x7fbc6c1d6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:21.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.498+0000 7fbc71c36700 1 --2- 172.21.15.52:0/888255045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc6c14df30 0x7fbc6c1d4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:21.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.498+0000 7fbc71435700 1 -- 172.21.15.52:0/888255045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc6c14df30 msgr2=0x7fbc6c1d4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:21.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.498+0000 7fbc71435700 1 --2- 172.21.15.52:0/888255045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc6c14df30 0x7fbc6c1d4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:21.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.498+0000 7fbc71435700 1 -- 172.21.15.52:0/888255045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc680094a0 con 0x7fbc6c0b84f0 2023-06-23T18:45:21.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.498+0000 7fbc71435700 1 --2- 172.21.15.52:0/888255045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc6c0b84f0 0x7fbc6c1d4130 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c072650 tx=0x7fbc68004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:21.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.498+0000 7fbc61ffb700 1 -- 172.21.15.52:0/888255045 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc68011630 con 0x7fbc6c0b84f0 2023-06-23T18:45:21.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.498+0000 7fbc61ffb700 1 -- 172.21.15.52:0/888255045 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6801e070 con 0x7fbc6c0b84f0 2023-06-23T18:45:21.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.498+0000 7fbc73699700 1 -- 172.21.15.52:0/888255045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc6c1d7300 con 0x7fbc6c0b84f0 2023-06-23T18:45:21.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.498+0000 7fbc61ffb700 1 -- 172.21.15.52:0/888255045 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc680119b0 con 0x7fbc6c0b84f0 2023-06-23T18:45:21.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.499+0000 7fbc73699700 1 -- 172.21.15.52:0/888255045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6c1dffe0 con 0x7fbc6c0b84f0 2023-06-23T18:45:21.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.500+0000 7fbc73699700 1 -- 172.21.15.52:0/888255045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc6c06c5b0 con 0x7fbc6c0b84f0 2023-06-23T18:45:21.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.500+0000 7fbc61ffb700 1 -- 172.21.15.52:0/888255045 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbc68011b10 con 0x7fbc6c0b84f0 2023-06-23T18:45:21.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.501+0000 7fbc61ffb700 1 --2- 172.21.15.52:0/888255045 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fbc5006ace0 0x7fbc5006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:21.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.501+0000 7fbc61ffb700 1 -- 172.21.15.52:0/888255045 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbc6808a7d0 con 0x7fbc6c0b84f0 2023-06-23T18:45:21.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.501+0000 7fbc70c34700 1 --2- 172.21.15.52:0/888255045 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fbc5006ace0 0x7fbc5006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:21.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.501+0000 7fbc70c34700 1 --2- 172.21.15.52:0/888255045 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fbc5006ace0 0x7fbc5006d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c0011e0 tx=0x7fbc5c0079b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:21.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.505+0000 7fbc61ffb700 1 -- 172.21.15.52:0/888255045 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbc68055910 con 0x7fbc6c0b84f0 2023-06-23T18:45:21.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.707+0000 7fbc73699700 1 -- 172.21.15.52:0/888255045 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc6c04e1d0 con 0x7fbc6c0b84f0 2023-06-23T18:45:21.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.708+0000 7fbc61ffb700 1 -- 172.21.15.52:0/888255045 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7fbc68058f30 con 0x7fbc6c0b84f0 2023-06-23T18:45:21.713 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:21.713 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","created":"2023-06-23T18:44:31.918434+0000","modified":"2023-06-23T18:44:51.644330+0000","last_up_change":"2023-06-23T18:44:42.169624+0000","last_in_change":"2023-06-23T18:44:34.510501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-23T18:44:43.346578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-23T18:44:43.829719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:44:48.517897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:44:49.621134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c371fb28-1b15-4e43-8d5a-43e402920ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6812","nonce":1066999520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6815","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6818","nonce":1066999520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6829","nonce":1066999520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6823","nonce":1066999520}]},"public_addr":"172.21.15.52:6812/1066999520","cluster_addr":"172.21.15.52:6818/1066999520","heartbeat_back_addr":"172.21.15.52:6829/1066999520","heartbeat_front_addr":"172.21.15.52:6823/1066999520","state":["exists","up"]},{"osd":1,"uuid":"4a142f04-33eb-47ec-9cc5-b08b44d82658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6813","nonce":2360219751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6819","nonce":2360219751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6830","nonce":2360219751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6825","nonce":2360219751}]},"public_addr":"172.21.15.52:6813/2360219751","cluster_addr":"172.21.15.52:6819/2360219751","heartbeat_back_addr":"172.21.15.52:6830/2360219751","heartbeat_front_addr":"172.21.15.52:6825/2360219751","state":["exists","up"]},{"osd":2,"uuid":"d7bb089d-4c55-4370-ba59-7fe88c39512a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6801","nonce":835073005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6803","nonce":835073005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6807","nonce":835073005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6805","nonce":835073005}]},"public_addr":"172.21.15.52:6801/835073005","cluster_addr":"172.21.15.52:6803/835073005","heartbeat_back_addr":"172.21.15.52:6807/835073005","heartbeat_front_addr":"172.21.15.52:6805/835073005","state":["exists","up"]},{"osd":3,"uuid":"4bcdcdc3-6a8f-468e-877e-57f76079ac3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6811","nonce":2852700864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6817","nonce":2852700864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6831","nonce":2852700864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6824","nonce":2852700864}]},"public_addr":"172.21.15.52:6811/2852700864","cluster_addr":"172.21.15.52:6817/2852700864","heartbeat_back_addr":"172.21.15.52:6831/2852700864","heartbeat_front_addr":"172.21.15.52:6824/2852700864","state":["exists","up"]},{"osd":4,"uuid":"cac63000-ae94-4b08-93e6-a99119640b63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6809","nonce":2538664679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6811","nonce":2538664679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6815","nonce":2538664679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6813","nonce":2538664679}]},"public_addr":"172.21.15.89:6809/2538664679","cluster_addr":"172.21.15.89:6811/2538664679","heartbeat_back_addr":"172.21.15.89:6815/2538664679","heartbeat_front_addr":"172.21.15.89:6813/2538664679","state":["exists","up"]},{"osd":5,"uuid":"45c53102-18a6-4fd7-9c25-8ea5e1ef6851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6801","nonce":1683710352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6803","nonce":1683710352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6807","nonce":1683710352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6805","nonce":1683710352}]},"public_addr":"172.21.15.89:6801/1683710352","cluster_addr":"172.21.15.89:6803/1683710352","heartbeat_back_addr":"172.21.15.89:6807/1683710352","heartbeat_front_addr":"172.21.15.89:6805/1683710352","state":["exists","up"]},{"osd":6,"uuid":"abee09d1-8eba-484f-a25c-871c1fe2e843","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6817","nonce":3890899288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6819","nonce":3890899288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6823","nonce":3890899288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6821","nonce":3890899288}]},"public_addr":"172.21.15.89:6817/3890899288","cluster_addr":"172.21.15.89:6819/3890899288","heartbeat_back_addr":"172.21.15.89:6823/3890899288","heartbeat_front_addr":"172.21.15.89:6821/3890899288","state":["exists","up"]},{"osd":7,"uuid":"5acf9e2e-00dd-4f9b-a7d9-3d820f695de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6825","nonce":2989085420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6827","nonce":2989085420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6831","nonce":2989085420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6829","nonce":2989085420}]},"public_addr":"172.21.15.89:6825/2989085420","cluster_addr":"172.21.15.89:6827/2989085420","heartbeat_back_addr":"172.21.15.89:6831/2989085420","heartbeat_front_addr":"172.21.15.89:6829/2989085420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.663866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.710904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.619347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.660102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.686933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.724635+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.669111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.678740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:45:21.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.710+0000 7fbc73699700 1 -- 172.21.15.52:0/888255045 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fbc5006ace0 msgr2=0x7fbc5006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:21.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.710+0000 7fbc73699700 1 --2- 172.21.15.52:0/888255045 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fbc5006ace0 0x7fbc5006d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c0011e0 tx=0x7fbc5c0079b0 comp rx=0 tx=0).stop 2023-06-23T18:45:21.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.710+0000 7fbc73699700 1 -- 172.21.15.52:0/888255045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc6c0b84f0 msgr2=0x7fbc6c1d4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:21.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.710+0000 7fbc73699700 1 --2- 172.21.15.52:0/888255045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc6c0b84f0 0x7fbc6c1d4130 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c072650 tx=0x7fbc68004750 comp rx=0 tx=0).stop 2023-06-23T18:45:21.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.710+0000 7fbc73699700 1 -- 172.21.15.52:0/888255045 shutdown_connections 2023-06-23T18:45:21.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.710+0000 7fbc73699700 1 --2- 172.21.15.52:0/888255045 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fbc5006ace0 0x7fbc5006d190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:21.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.710+0000 7fbc73699700 1 --2- 172.21.15.52:0/888255045 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc6c14df30 0x7fbc6c1d4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:21.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.710+0000 7fbc73699700 1 --2- 172.21.15.52:0/888255045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc6c0b84f0 0x7fbc6c1d4130 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:21.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.710+0000 7fbc73699700 1 --2- 172.21.15.52:0/888255045 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbc6c0bb0a0 0x7fbc6c1d6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:21.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.710+0000 7fbc73699700 1 -- 172.21.15.52:0/888255045 >> 172.21.15.52:0/888255045 conn(0x7fbc6c06d210 msgr2=0x7fbc6c0b8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:21.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.710+0000 7fbc73699700 1 -- 172.21.15.52:0/888255045 shutdown_connections 2023-06-23T18:45:21.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.710+0000 7fbc73699700 1 -- 172.21.15.52:0/888255045 wait complete. 2023-06-23T18:45:21.727 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-23T18:44:43.346578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-23T18:44:43.829719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T18:44:48.517897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T18:44:49.621134+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-23T18:45:21.728 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T18:45:21.856 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.852+0000 7fc196d72700 1 Processor -- start 2023-06-23T18:45:21.857 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.852+0000 7fc196d72700 1 -- start start 2023-06-23T18:45:21.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.852+0000 7fc196d72700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc1900b6c50 0x7fc1900b8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:21.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.852+0000 7fc196d72700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc19006b0e0 0x7fc19006c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:21.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.853+0000 7fc196d72700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1900b7da0 con 0x7fc1900b8a20 2023-06-23T18:45:21.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.853+0000 7fc196d72700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1900b9c30 con 0x7fc1900b6c50 2023-06-23T18:45:21.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.853+0000 7fc196d72700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1900b9390 con 0x7fc19006b0e0 2023-06-23T18:45:21.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.853+0000 7fc19530f700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fc1900b8a20 0x7fc190141f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37942/0 (socket says 172.21.15.52:37942) 2023-06-23T18:45:21.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.853+0000 7fc19530f700 1 -- 172.21.15.52:0/182109770 learned_addr learned my addr 172.21.15.52:0/182109770 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:21.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.853+0000 7fc18ffff700 1 --2- 172.21.15.52:0/182109770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc19006b0e0 0x7fc19006c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:21.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.853+0000 7fc194b0e700 1 --2- 172.21.15.52:0/182109770 >> v2:172.21.15.89:3300/0 conn(0x7fc1900b6c50 0x7fc1900b8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:21.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.853+0000 7fc18f7fe700 1 -- 172.21.15.52:0/182109770 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590413529 0 0) 0x7fc1900b7da0 con 0x7fc1900b8a20 2023-06-23T18:45:21.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.853+0000 7fc18f7fe700 1 -- 172.21.15.52:0/182109770 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1800035b0 con 0x7fc1900b8a20 2023-06-23T18:45:21.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.853+0000 7fc18f7fe700 1 -- 172.21.15.52:0/182109770 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2651014835 0 0) 0x7fc1800035b0 con 0x7fc1900b8a20 2023-06-23T18:45:21.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.853+0000 7fc18f7fe700 1 -- 172.21.15.52:0/182109770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc19006b0e0 msgr2=0x7fc19006c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:21.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.853+0000 7fc18f7fe700 1 --2- 172.21.15.52:0/182109770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc19006b0e0 0x7fc19006c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:21.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.853+0000 7fc18f7fe700 1 -- 172.21.15.52:0/182109770 >> v2:172.21.15.89:3300/0 conn(0x7fc1900b6c50 msgr2=0x7fc1900b8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:21.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.853+0000 7fc18f7fe700 1 --2- 172.21.15.52:0/182109770 >> v2:172.21.15.89:3300/0 conn(0x7fc1900b6c50 0x7fc1900b8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:21.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.853+0000 7fc18f7fe700 1 -- 172.21.15.52:0/182109770 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1900b9670 con 0x7fc1900b8a20 2023-06-23T18:45:21.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.853+0000 7fc18f7fe700 1 -- 172.21.15.52:0/182109770 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7fc1880019f0 con 0x7fc1900b8a20 2023-06-23T18:45:21.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.853+0000 7fc18ffff700 1 --2- 172.21.15.52:0/182109770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc19006b0e0 0x7fc19006c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:45:21.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.853+0000 7fc18f7fe700 1 -- 172.21.15.52:0/182109770 >> v1:172.21.15.52:6789/0 conn(0x7fc1900b8a20 legacy=0x7fc190141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:21.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.853+0000 7fc18f7fe700 1 --2- 172.21.15.52:0/182109770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc180003a00 0x7fc180003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:21.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.853+0000 7fc18f7fe700 1 --2- 172.21.15.52:0/182109770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc19006b0e0 0x7fc180004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:21.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.853+0000 7fc18f7fe700 1 --2- 172.21.15.52:0/182109770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc180004d90 0x7fc180005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:21.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.853+0000 7fc18f7fe700 1 -- 172.21.15.52:0/182109770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1900b9c30 con 0x7fc180004d90 2023-06-23T18:45:21.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.853+0000 7fc18f7fe700 1 -- 172.21.15.52:0/182109770 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1900b9390 con 0x7fc180003a00 2023-06-23T18:45:21.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.853+0000 7fc18f7fe700 1 -- 172.21.15.52:0/182109770 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18000ba90 con 0x7fc19006b0e0 2023-06-23T18:45:21.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.853+0000 7fc19530f700 1 --2- 172.21.15.52:0/182109770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc180004d90 0x7fc180005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:21.864 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.854+0000 7fc18ffff700 1 --2- 172.21.15.52:0/182109770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc19006b0e0 0x7fc180004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:21.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.854+0000 7fc194b0e700 1 --2- 172.21.15.52:0/182109770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc180003a00 0x7fc180003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:21.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.854+0000 7fc19530f700 1 -- 172.21.15.52:0/182109770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc19006b0e0 msgr2=0x7fc180004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:21.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.854+0000 7fc19530f700 1 --2- 172.21.15.52:0/182109770 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc19006b0e0 0x7fc180004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:21.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.854+0000 7fc19530f700 1 -- 172.21.15.52:0/182109770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc180003a00 msgr2=0x7fc180003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:21.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.854+0000 7fc19530f700 1 --2- 172.21.15.52:0/182109770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc180003a00 0x7fc180003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:21.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.854+0000 7fc19530f700 1 -- 172.21.15.52:0/182109770 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c0094a0 con 0x7fc180004d90 2023-06-23T18:45:21.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.854+0000 7fc194b0e700 1 --2- 172.21.15.52:0/182109770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc180003a00 0x7fc180003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:21.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.854+0000 7fc19530f700 1 --2- 172.21.15.52:0/182109770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc180004d90 0x7fc180005200 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc18800a790 tx=0x7fc180005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dada94a51d45eb8 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:21.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.854+0000 7fc18f7fe700 1 -- 172.21.15.52:0/182109770 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18800a250 con 0x7fc180004d90 2023-06-23T18:45:21.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.854+0000 7fc18f7fe700 1 -- 172.21.15.52:0/182109770 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc188012600 con 0x7fc180004d90 2023-06-23T18:45:21.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.854+0000 7fc18f7fe700 1 -- 172.21.15.52:0/182109770 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1880129b0 con 0x7fc180004d90 2023-06-23T18:45:21.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.854+0000 7fc196d72700 1 -- 172.21.15.52:0/182109770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc180004d90 msgr2=0x7fc180005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:21.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.855+0000 7fc196d72700 1 --2- 172.21.15.52:0/182109770 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc180004d90 0x7fc180005200 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc18800a790 tx=0x7fc180005880 comp rx=0 tx=0).stop 2023-06-23T18:45:21.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.855+0000 7fc19530f700 1 -- 172.21.15.52:0/182109770 reap_dead start 2023-06-23T18:45:21.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.855+0000 7fc196d72700 1 -- 172.21.15.52:0/182109770 shutdown_connections 2023-06-23T18:45:21.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.855+0000 7fc196d72700 1 -- 172.21.15.52:0/182109770 >> 172.21.15.52:0/182109770 conn(0x7fc1900bd420 msgr2=0x7fc1900bd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:21.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.855+0000 7fc196d72700 1 -- 172.21.15.52:0/182109770 shutdown_connections 2023-06-23T18:45:21.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.855+0000 7fc196d72700 1 -- 172.21.15.52:0/182109770 wait complete. 2023-06-23T18:45:21.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.856+0000 7fc196d72700 1 Processor -- start 2023-06-23T18:45:21.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.856+0000 7fc196d72700 1 -- start start 2023-06-23T18:45:21.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.856+0000 7fc196d72700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc180004d90 0x7fc1901cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:21.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.856+0000 7fc196d72700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc190143b20 0x7fc1901dd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:21.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.857+0000 7fc196d72700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1901ddbd0 0x7fc1901e05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:21.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.857+0000 7fc196d72700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1901d01a0 con 0x7fc1901ddbd0 2023-06-23T18:45:21.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.857+0000 7fc196d72700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1901de040 con 0x7fc190143b20 2023-06-23T18:45:21.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.857+0000 7fc196d72700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc19013f1b0 con 0x7fc180004d90 2023-06-23T18:45:21.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.857+0000 7fc19530f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1901ddbd0 0x7fc1901e05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:21.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.857+0000 7fc19530f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1901ddbd0 0x7fc1901e05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56980/0 (socket says 172.21.15.52:56980) 2023-06-23T18:45:21.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.857+0000 7fc19530f700 1 -- 172.21.15.52:0/3988390143 learned_addr learned my addr 172.21.15.52:0/3988390143 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:21.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.857+0000 7fc18ffff700 1 --2- 172.21.15.52:0/3988390143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc190143b20 0x7fc1901dd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:21.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.857+0000 7fc194b0e700 1 --2- 172.21.15.52:0/3988390143 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc180004d90 0x7fc1901cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:21.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.857+0000 7fc19530f700 1 -- 172.21.15.52:0/3988390143 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc180004d90 msgr2=0x7fc1901cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:21.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.857+0000 7fc19530f700 1 --2- 172.21.15.52:0/3988390143 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc180004d90 0x7fc1901cfc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:21.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.857+0000 7fc19530f700 1 -- 172.21.15.52:0/3988390143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc190143b20 msgr2=0x7fc1901dd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:21.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.857+0000 7fc19530f700 1 --2- 172.21.15.52:0/3988390143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc190143b20 0x7fc1901dd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:21.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.857+0000 7fc19530f700 1 -- 172.21.15.52:0/3988390143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19013f450 con 0x7fc1901ddbd0 2023-06-23T18:45:21.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.857+0000 7fc19530f700 1 --2- 172.21.15.52:0/3988390143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1901ddbd0 0x7fc1901e05d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc188012000 tx=0x7fc188001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:21.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.857+0000 7fc18d7fa700 1 -- 172.21.15.52:0/3988390143 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18800a250 con 0x7fc1901ddbd0 2023-06-23T18:45:21.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.857+0000 7fc18d7fa700 1 -- 172.21.15.52:0/3988390143 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc18801e400 con 0x7fc1901ddbd0 2023-06-23T18:45:21.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.857+0000 7fc196d72700 1 -- 172.21.15.52:0/3988390143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1901dd170 con 0x7fc1901ddbd0 2023-06-23T18:45:21.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.857+0000 7fc18d7fa700 1 -- 172.21.15.52:0/3988390143 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc18801e5b0 con 0x7fc1901ddbd0 2023-06-23T18:45:21.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.857+0000 7fc196d72700 1 -- 172.21.15.52:0/3988390143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc19006b580 con 0x7fc1901ddbd0 2023-06-23T18:45:21.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.858+0000 7fc196d72700 1 -- 172.21.15.52:0/3988390143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1901d01a0 con 0x7fc1901ddbd0 2023-06-23T18:45:21.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.859+0000 7fc18d7fa700 1 -- 172.21.15.52:0/3988390143 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc188019030 con 0x7fc1901ddbd0 2023-06-23T18:45:21.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.859+0000 7fc18d7fa700 1 --2- 172.21.15.52:0/3988390143 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc17406ad10 0x7fc17406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:21.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.859+0000 7fc18d7fa700 1 -- 172.21.15.52:0/3988390143 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc18808b210 con 0x7fc1901ddbd0 2023-06-23T18:45:21.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.859+0000 7fc194b0e700 1 --2- 172.21.15.52:0/3988390143 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc17406ad10 0x7fc17406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:21.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.860+0000 7fc194b0e700 1 --2- 172.21.15.52:0/3988390143 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc17406ad10 0x7fc17406d1c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc184009b90 tx=0x7fc184008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:21.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:21.864+0000 7fc18d7fa700 1 -- 172.21.15.52:0/3988390143 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc188056350 con 0x7fc1901ddbd0 2023-06-23T18:45:22.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.059+0000 7fc196d72700 1 -- 172.21.15.52:0/3988390143 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc1901dd360 con 0x7fc1901ddbd0 2023-06-23T18:45:22.064 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.059+0000 7fc18d7fa700 1 -- 172.21.15.52:0/3988390143 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc188059970 con 0x7fc1901ddbd0 2023-06-23T18:45:22.064 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-06-23T18:45:22.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.061+0000 7fc196d72700 1 -- 172.21.15.52:0/3988390143 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc17406ad10 msgr2=0x7fc17406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:22.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.061+0000 7fc196d72700 1 --2- 172.21.15.52:0/3988390143 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc17406ad10 0x7fc17406d1c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc184009b90 tx=0x7fc184008040 comp rx=0 tx=0).stop 2023-06-23T18:45:22.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.061+0000 7fc196d72700 1 -- 172.21.15.52:0/3988390143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1901ddbd0 msgr2=0x7fc1901e05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:22.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.061+0000 7fc196d72700 1 --2- 172.21.15.52:0/3988390143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1901ddbd0 0x7fc1901e05d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc188012000 tx=0x7fc188001cb0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.062+0000 7fc196d72700 1 -- 172.21.15.52:0/3988390143 shutdown_connections 2023-06-23T18:45:22.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.062+0000 7fc196d72700 1 --2- 172.21.15.52:0/3988390143 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc17406ad10 0x7fc17406d1c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.062+0000 7fc196d72700 1 --2- 172.21.15.52:0/3988390143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc1901ddbd0 0x7fc1901e05d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.062+0000 7fc196d72700 1 --2- 172.21.15.52:0/3988390143 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc180004d90 0x7fc1901cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.062+0000 7fc196d72700 1 --2- 172.21.15.52:0/3988390143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc190143b20 0x7fc1901dd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.062+0000 7fc196d72700 1 -- 172.21.15.52:0/3988390143 >> 172.21.15.52:0/3988390143 conn(0x7fc1900bd420 msgr2=0x7fc1901ce3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:22.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.062+0000 7fc196d72700 1 -- 172.21.15.52:0/3988390143 shutdown_connections 2023-06-23T18:45:22.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.062+0000 7fc196d72700 1 -- 172.21.15.52:0/3988390143 wait complete. 2023-06-23T18:45:22.078 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T18:45:22.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.203+0000 7f40e2c2c700 1 Processor -- start 2023-06-23T18:45:22.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.203+0000 7f40e2c2c700 1 -- start start 2023-06-23T18:45:22.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.203+0000 7f40e2c2c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40dc071a70 0x7f40dc14a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:22.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.203+0000 7f40e2c2c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f40dc0b6cf0 0x7f40dc06af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:22.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.203+0000 7f40e2c2c700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40dc0b8df0 con 0x7f40dc0b5f40 2023-06-23T18:45:22.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.203+0000 7f40e2c2c700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40dc0b90d0 con 0x7f40dc0b6cf0 2023-06-23T18:45:22.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.203+0000 7f40e2c2c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc071270 con 0x7f40dc071a70 2023-06-23T18:45:22.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.204+0000 7f40e11c9700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f40dc0b6cf0 0x7f40dc06af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:22.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.204+0000 7f40e09c8700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f40dc0b5f40 0x7f40dc0b85d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37954/0 (socket says 172.21.15.52:37954) 2023-06-23T18:45:22.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.204+0000 7f40e09c8700 1 -- 172.21.15.52:0/1785034131 learned_addr learned my addr 172.21.15.52:0/1785034131 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:22.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.204+0000 7f40d3fff700 1 --2- 172.21.15.52:0/1785034131 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40dc071a70 0x7f40dc14a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:22.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.204+0000 7f40e11c9700 1 -- 172.21.15.52:0/1785034131 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40dc071a70 msgr2=0x7f40dc14a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:22.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.204+0000 7f40e11c9700 1 --2- 172.21.15.52:0/1785034131 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40dc071a70 0x7f40dc14a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.204+0000 7f40e11c9700 1 -- 172.21.15.52:0/1785034131 >> v1:172.21.15.52:6789/0 conn(0x7f40dc0b5f40 legacy=0x7f40dc0b85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:22.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.204+0000 7f40e11c9700 1 -- 172.21.15.52:0/1785034131 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40dc071550 con 0x7f40dc0b6cf0 2023-06-23T18:45:22.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.204+0000 7f40d37fe700 1 -- 172.21.15.52:0/1785034131 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1308789205 0 0) 0x7f40dc0b8df0 con 0x7f40dc0b5f40 2023-06-23T18:45:22.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.204+0000 7f40e11c9700 1 --2- 172.21.15.52:0/1785034131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40dc0b6cf0 0x7f40dc06af00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f40d4009d90 tx=0x7f40d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa40360cb23c1997 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:22.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.204+0000 7f40d37fe700 1 -- 172.21.15.52:0/1785034131 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d400bd20 con 0x7f40dc0b6cf0 2023-06-23T18:45:22.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.204+0000 7f40d37fe700 1 -- 172.21.15.52:0/1785034131 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d400be80 con 0x7f40dc0b6cf0 2023-06-23T18:45:22.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.204+0000 7f40d37fe700 1 -- 172.21.15.52:0/1785034131 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d40116a0 con 0x7f40dc0b6cf0 2023-06-23T18:45:22.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.205+0000 7f40e2c2c700 1 -- 172.21.15.52:0/1785034131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40dc0b6cf0 msgr2=0x7f40dc06af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:22.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.205+0000 7f40e2c2c700 1 --2- 172.21.15.52:0/1785034131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40dc0b6cf0 0x7f40dc06af00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f40d4009d90 tx=0x7f40d400b330 comp rx=0 tx=0).stop 2023-06-23T18:45:22.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.205+0000 7f40e2c2c700 1 -- 172.21.15.52:0/1785034131 shutdown_connections 2023-06-23T18:45:22.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.205+0000 7f40e2c2c700 1 --2- 172.21.15.52:0/1785034131 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40dc0b6cf0 0x7f40dc06af00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.205+0000 7f40e2c2c700 1 --2- 172.21.15.52:0/1785034131 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40dc071a70 0x7f40dc14a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.205+0000 7f40e2c2c700 1 -- 172.21.15.52:0/1785034131 >> 172.21.15.52:0/1785034131 conn(0x7f40dc0b95c0 msgr2=0x7f40dc0b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:22.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.205+0000 7f40e2c2c700 1 -- 172.21.15.52:0/1785034131 shutdown_connections 2023-06-23T18:45:22.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.205+0000 7f40e2c2c700 1 -- 172.21.15.52:0/1785034131 wait complete. 2023-06-23T18:45:22.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.206+0000 7f40e2c2c700 1 Processor -- start 2023-06-23T18:45:22.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.206+0000 7f40e2c2c700 1 -- start start 2023-06-23T18:45:22.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.207+0000 7f40e2c2c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40dc071a70 0x7f40dc145fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:22.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.207+0000 7f40e2c2c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40dc0b5f40 0x7f40dc142d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:22.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.207+0000 7f40e2c2c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40dc0b6cf0 0x7f40dc147110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:22.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.207+0000 7f40e2c2c700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc145820 con 0x7f40dc0b5f40 2023-06-23T18:45:22.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.207+0000 7f40e2c2c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc1468f0 con 0x7f40dc0b6cf0 2023-06-23T18:45:22.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.207+0000 7f40e2c2c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc144810 con 0x7f40dc071a70 2023-06-23T18:45:22.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.207+0000 7f40d3fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40dc0b5f40 0x7f40dc142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:22.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.207+0000 7f40d3fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40dc0b5f40 0x7f40dc142d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:56986/0 (socket says 172.21.15.52:56986) 2023-06-23T18:45:22.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.207+0000 7f40e09c8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40dc071a70 0x7f40dc145fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:22.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.207+0000 7f40d3fff700 1 -- 172.21.15.52:0/3581559523 learned_addr learned my addr 172.21.15.52:0/3581559523 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:22.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.207+0000 7f40e11c9700 1 --2- 172.21.15.52:0/3581559523 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40dc0b6cf0 0x7f40dc147110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:22.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.207+0000 7f40d3fff700 1 -- 172.21.15.52:0/3581559523 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40dc071a70 msgr2=0x7f40dc145fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:22.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.207+0000 7f40d3fff700 1 --2- 172.21.15.52:0/3581559523 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40dc071a70 0x7f40dc145fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.207+0000 7f40d3fff700 1 -- 172.21.15.52:0/3581559523 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40dc0b6cf0 msgr2=0x7f40dc147110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:22.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.207+0000 7f40d3fff700 1 --2- 172.21.15.52:0/3581559523 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40dc0b6cf0 0x7f40dc147110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.207+0000 7f40d3fff700 1 -- 172.21.15.52:0/3581559523 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d4009a70 con 0x7f40dc0b5f40 2023-06-23T18:45:22.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.207+0000 7f40d3fff700 1 --2- 172.21.15.52:0/3581559523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40dc0b5f40 0x7f40dc142d70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f40cc00e9b0 tx=0x7f40cc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:22.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.207+0000 7f40d17fa700 1 -- 172.21.15.52:0/3581559523 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc009710 con 0x7f40dc0b5f40 2023-06-23T18:45:22.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.207+0000 7f40d17fa700 1 -- 172.21.15.52:0/3581559523 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40cc00ee50 con 0x7f40dc0b5f40 2023-06-23T18:45:22.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.207+0000 7f40e2c2c700 1 -- 172.21.15.52:0/3581559523 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40dc14b020 con 0x7f40dc0b5f40 2023-06-23T18:45:22.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.207+0000 7f40d17fa700 1 -- 172.21.15.52:0/3581559523 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40cc00ca50 con 0x7f40dc0b5f40 2023-06-23T18:45:22.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.207+0000 7f40e2c2c700 1 -- 172.21.15.52:0/3581559523 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40dc1465a0 con 0x7f40dc0b5f40 2023-06-23T18:45:22.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.208+0000 7f40e2c2c700 1 -- 172.21.15.52:0/3581559523 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40dc145680 con 0x7f40dc0b5f40 2023-06-23T18:45:22.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.209+0000 7f40d17fa700 1 -- 172.21.15.52:0/3581559523 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f40cc00cbb0 con 0x7f40dc0b5f40 2023-06-23T18:45:22.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.209+0000 7f40d17fa700 1 --2- 172.21.15.52:0/3581559523 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f40c806ace0 0x7f40c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:22.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.209+0000 7f40d17fa700 1 -- 172.21.15.52:0/3581559523 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f40cc089470 con 0x7f40dc0b5f40 2023-06-23T18:45:22.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.210+0000 7f40e09c8700 1 --2- 172.21.15.52:0/3581559523 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f40c806ace0 0x7f40c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:22.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.210+0000 7f40e09c8700 1 --2- 172.21.15.52:0/3581559523 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f40c806ace0 0x7f40c806d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f40d8007fd0 tx=0x7f40d8007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:22.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.214+0000 7f40d17fa700 1 -- 172.21.15.52:0/3581559523 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f40dc145680 con 0x7f40dc0b5f40 2023-06-23T18:45:22.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.413+0000 7f40e2c2c700 1 -- 172.21.15.52:0/3581559523 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f40dc145680 con 0x7f40dc0b5f40 2023-06-23T18:45:22.418 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.414+0000 7f40d17fa700 1 -- 172.21.15.52:0/3581559523 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f40dc145680 con 0x7f40dc0b5f40 2023-06-23T18:45:22.419 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-06-23T18:45:22.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.416+0000 7f40e2c2c700 1 -- 172.21.15.52:0/3581559523 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f40c806ace0 msgr2=0x7f40c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:22.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.416+0000 7f40e2c2c700 1 --2- 172.21.15.52:0/3581559523 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f40c806ace0 0x7f40c806d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f40d8007fd0 tx=0x7f40d8007de0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.416+0000 7f40e2c2c700 1 -- 172.21.15.52:0/3581559523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40dc0b5f40 msgr2=0x7f40dc142d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:22.421 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.416+0000 7f40e2c2c700 1 --2- 172.21.15.52:0/3581559523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40dc0b5f40 0x7f40dc142d70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f40cc00e9b0 tx=0x7f40cc00ecc0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.416+0000 7f40e2c2c700 1 -- 172.21.15.52:0/3581559523 shutdown_connections 2023-06-23T18:45:22.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.416+0000 7f40e2c2c700 1 --2- 172.21.15.52:0/3581559523 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f40c806ace0 0x7f40c806d190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.416+0000 7f40e2c2c700 1 --2- 172.21.15.52:0/3581559523 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40dc0b6cf0 0x7f40dc147110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.416+0000 7f40e2c2c700 1 --2- 172.21.15.52:0/3581559523 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40dc071a70 0x7f40dc145fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.416+0000 7f40e2c2c700 1 --2- 172.21.15.52:0/3581559523 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40dc0b5f40 0x7f40dc142d70 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.416+0000 7f40e2c2c700 1 -- 172.21.15.52:0/3581559523 >> 172.21.15.52:0/3581559523 conn(0x7f40dc0b95c0 msgr2=0x7f40dc0704c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:22.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.416+0000 7f40e2c2c700 1 -- 172.21.15.52:0/3581559523 shutdown_connections 2023-06-23T18:45:22.422 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.416+0000 7f40e2c2c700 1 -- 172.21.15.52:0/3581559523 wait complete. 2023-06-23T18:45:22.433 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T18:45:22.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.556+0000 7f85434aa700 1 Processor -- start 2023-06-23T18:45:22.561 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.556+0000 7f85434aa700 1 -- start start 2023-06-23T18:45:22.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.557+0000 7f85434aa700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f853c06b0e0 0x7f853c06fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:22.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.557+0000 7f85434aa700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f853c070930 0x7f853c0b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:22.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.557+0000 7f85434aa700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853c0b6fe0 con 0x7f853c0afe00 2023-06-23T18:45:22.562 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.557+0000 7f85434aa700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f853c071c00 con 0x7f853c070930 2023-06-23T18:45:22.563 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.557+0000 7f85434aa700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853c0b6a20 con 0x7f853c06b0e0 2023-06-23T18:45:22.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.558+0000 7f8540a45700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f853c070930 0x7f853c0b73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:22.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.558+0000 7f8541246700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f853c06b0e0 0x7f853c06fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:22.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.558+0000 7f8541a47700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f853c0afe00 0x7f853c14de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.52:59072/0 (socket says 172.21.15.52:59072) 2023-06-23T18:45:22.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.558+0000 7f8541a47700 1 -- 172.21.15.52:0/2012425264 learned_addr learned my addr 172.21.15.52:0/2012425264 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:22.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.558+0000 7f8540a45700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f853c070930 0x7f853c0b73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.52:35722/0 (socket says 172.21.15.52:35722) 2023-06-23T18:45:22.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.558+0000 7f8540a45700 1 -- 172.21.15.52:0/2012425264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f853c06b0e0 msgr2=0x7f853c06fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:22.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.558+0000 7f8540a45700 1 --2- 172.21.15.52:0/2012425264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f853c06b0e0 0x7f853c06fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.558+0000 7f8540a45700 1 -- 172.21.15.52:0/2012425264 >> v1:172.21.15.89:6789/0 conn(0x7f853c0afe00 legacy=0x7f853c14de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:22.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.558+0000 7f8540a45700 1 -- 172.21.15.52:0/2012425264 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c0b6d00 con 0x7f853c070930 2023-06-23T18:45:22.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.558+0000 7f8541246700 1 --2- 172.21.15.52:0/2012425264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f853c06b0e0 0x7f853c06fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:45:22.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.558+0000 7f8540a45700 1 --2- 172.21.15.52:0/2012425264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f853c070930 0x7f853c0b73c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f852c009840 tx=0x7f852c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71ac3ea07fd7f8bd server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:22.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.559+0000 7f8533fff700 1 -- 172.21.15.52:0/2012425264 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c011830 con 0x7f853c070930 2023-06-23T18:45:22.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.559+0000 7f8533fff700 1 -- 172.21.15.52:0/2012425264 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852c011990 con 0x7f853c070930 2023-06-23T18:45:22.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.559+0000 7f8533fff700 1 -- 172.21.15.52:0/2012425264 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c011d20 con 0x7f853c070930 2023-06-23T18:45:22.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.559+0000 7f85434aa700 1 -- 172.21.15.52:0/2012425264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f853c070930 msgr2=0x7f853c0b73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:22.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.559+0000 7f85434aa700 1 --2- 172.21.15.52:0/2012425264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f853c070930 0x7f853c0b73c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f852c009840 tx=0x7f852c009b50 comp rx=0 tx=0).stop 2023-06-23T18:45:22.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.559+0000 7f85434aa700 1 -- 172.21.15.52:0/2012425264 shutdown_connections 2023-06-23T18:45:22.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.559+0000 7f85434aa700 1 --2- 172.21.15.52:0/2012425264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f853c06b0e0 0x7f853c06fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.566 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.559+0000 7f85434aa700 1 --2- 172.21.15.52:0/2012425264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f853c070930 0x7f853c0b73c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.559+0000 7f85434aa700 1 -- 172.21.15.52:0/2012425264 >> 172.21.15.52:0/2012425264 conn(0x7f853c0b95c0 msgr2=0x7f853c0b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:22.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.559+0000 7f85434aa700 1 -- 172.21.15.52:0/2012425264 shutdown_connections 2023-06-23T18:45:22.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.559+0000 7f85434aa700 1 -- 172.21.15.52:0/2012425264 wait complete. 2023-06-23T18:45:22.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.561+0000 7f85434aa700 1 Processor -- start 2023-06-23T18:45:22.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.561+0000 7f85434aa700 1 -- start start 2023-06-23T18:45:22.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.561+0000 7f85434aa700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f853c06b0e0 0x7f853c1d4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:22.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.561+0000 7f85434aa700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f853c070930 0x7f853c0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:22.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.561+0000 7f85434aa700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f853c0afe00 0x7f853c0b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:22.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.561+0000 7f85434aa700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853c0b2df0 con 0x7f853c06b0e0 2023-06-23T18:45:22.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.562+0000 7f85434aa700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853c0b33b0 con 0x7f853c0afe00 2023-06-23T18:45:22.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.562+0000 7f85434aa700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853c0aece0 con 0x7f853c070930 2023-06-23T18:45:22.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.562+0000 7f8541246700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f853c06b0e0 0x7f853c1d4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:22.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.562+0000 7f8541246700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f853c06b0e0 0x7f853c1d4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57002/0 (socket says 172.21.15.52:57002) 2023-06-23T18:45:22.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.562+0000 7f8541246700 1 -- 172.21.15.52:0/238642763 learned_addr learned my addr 172.21.15.52:0/238642763 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:22.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.562+0000 7f8540a45700 1 --2- 172.21.15.52:0/238642763 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f853c070930 0x7f853c0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:22.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.562+0000 7f8541a47700 1 --2- 172.21.15.52:0/238642763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f853c0afe00 0x7f853c0b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:22.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.562+0000 7f8541246700 1 -- 172.21.15.52:0/238642763 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f853c070930 msgr2=0x7f853c0b4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:22.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.562+0000 7f8541246700 1 --2- 172.21.15.52:0/238642763 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f853c070930 0x7f853c0b4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.562+0000 7f8541246700 1 -- 172.21.15.52:0/238642763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f853c0afe00 msgr2=0x7f853c0b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:22.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.562+0000 7f8541246700 1 --2- 172.21.15.52:0/238642763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f853c0afe00 0x7f853c0b52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.562+0000 7f8541246700 1 -- 172.21.15.52:0/238642763 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8538009a70 con 0x7f853c06b0e0 2023-06-23T18:45:22.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.562+0000 7f8541246700 1 --2- 172.21.15.52:0/238642763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f853c06b0e0 0x7f853c1d4030 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8538009f60 tx=0x7f8538009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:22.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.562+0000 7f8531ffb700 1 -- 172.21.15.52:0/238642763 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853800cd60 con 0x7f853c06b0e0 2023-06-23T18:45:22.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.562+0000 7f8531ffb700 1 -- 172.21.15.52:0/238642763 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853800f040 con 0x7f853c06b0e0 2023-06-23T18:45:22.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.562+0000 7f85434aa700 1 -- 172.21.15.52:0/238642763 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f852c0094a0 con 0x7f853c06b0e0 2023-06-23T18:45:22.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.562+0000 7f8531ffb700 1 -- 172.21.15.52:0/238642763 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85380146a0 con 0x7f853c06b0e0 2023-06-23T18:45:22.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.563+0000 7f85434aa700 1 -- 172.21.15.52:0/238642763 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f853c1d4c40 con 0x7f853c06b0e0 2023-06-23T18:45:22.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.564+0000 7f85434aa700 1 -- 172.21.15.52:0/238642763 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f853c0b3900 con 0x7f853c06b0e0 2023-06-23T18:45:22.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.564+0000 7f8531ffb700 1 -- 172.21.15.52:0/238642763 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8538014800 con 0x7f853c06b0e0 2023-06-23T18:45:22.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.564+0000 7f8531ffb700 1 --2- 172.21.15.52:0/238642763 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f852006ace0 0x7f852006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:22.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.565+0000 7f8531ffb700 1 -- 172.21.15.52:0/238642763 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f853808a0b0 con 0x7f853c06b0e0 2023-06-23T18:45:22.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.565+0000 7f8540a45700 1 --2- 172.21.15.52:0/238642763 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f852006ace0 0x7f852006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:22.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.565+0000 7f8540a45700 1 --2- 172.21.15.52:0/238642763 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f852006ace0 0x7f852006d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f852c000c00 tx=0x7f852c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:22.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.569+0000 7f8531ffb700 1 -- 172.21.15.52:0/238642763 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f85380551f0 con 0x7f853c06b0e0 2023-06-23T18:45:22.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.765+0000 7f85434aa700 1 -- 172.21.15.52:0/238642763 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f853c04e1d0 con 0x7f853c06b0e0 2023-06-23T18:45:22.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.766+0000 7f8531ffb700 1 -- 172.21.15.52:0/238642763 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8538058810 con 0x7f853c06b0e0 2023-06-23T18:45:22.771 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2023-06-23T18:45:22.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.768+0000 7f85434aa700 1 -- 172.21.15.52:0/238642763 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f852006ace0 msgr2=0x7f852006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:22.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.768+0000 7f85434aa700 1 --2- 172.21.15.52:0/238642763 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f852006ace0 0x7f852006d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f852c000c00 tx=0x7f852c008030 comp rx=0 tx=0).stop 2023-06-23T18:45:22.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.768+0000 7f85434aa700 1 -- 172.21.15.52:0/238642763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f853c06b0e0 msgr2=0x7f853c1d4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:22.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.768+0000 7f85434aa700 1 --2- 172.21.15.52:0/238642763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f853c06b0e0 0x7f853c1d4030 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8538009f60 tx=0x7f8538009f90 comp rx=0 tx=0).stop 2023-06-23T18:45:22.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.768+0000 7f85434aa700 1 -- 172.21.15.52:0/238642763 shutdown_connections 2023-06-23T18:45:22.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.768+0000 7f85434aa700 1 --2- 172.21.15.52:0/238642763 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f852006ace0 0x7f852006d190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.768+0000 7f85434aa700 1 --2- 172.21.15.52:0/238642763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f853c0afe00 0x7f853c0b52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.768+0000 7f85434aa700 1 --2- 172.21.15.52:0/238642763 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f853c06b0e0 0x7f853c1d4030 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.768+0000 7f85434aa700 1 --2- 172.21.15.52:0/238642763 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f853c070930 0x7f853c0b4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.768+0000 7f85434aa700 1 -- 172.21.15.52:0/238642763 >> 172.21.15.52:0/238642763 conn(0x7f853c0b95c0 msgr2=0x7f853c1d1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:22.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.768+0000 7f85434aa700 1 -- 172.21.15.52:0/238642763 shutdown_connections 2023-06-23T18:45:22.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.768+0000 7f85434aa700 1 -- 172.21.15.52:0/238642763 wait complete. 2023-06-23T18:45:22.785 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T18:45:22.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.909+0000 7f486c580700 1 Processor -- start 2023-06-23T18:45:22.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.909+0000 7f486c580700 1 -- start start 2023-06-23T18:45:22.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.910+0000 7f486c580700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4864071160 0x7f4864147210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:22.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.910+0000 7f486c580700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f486406b610 con 0x7f4864141320 2023-06-23T18:45:22.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.910+0000 7f486c580700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4864147bd0 con 0x7f4864147750 2023-06-23T18:45:22.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.910+0000 7f486c580700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4864071f40 con 0x7f4864071160 2023-06-23T18:45:22.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.910+0000 7f4869b1b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4864071160 0x7f4864147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:22.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.910+0000 7f486a31c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f4864141320 0x7f486406af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37968/0 (socket says 172.21.15.52:37968) 2023-06-23T18:45:22.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.910+0000 7f486a31c700 1 -- 172.21.15.52:0/763098533 learned_addr learned my addr 172.21.15.52:0/763098533 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:22.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.910+0000 7f4869b1b700 1 --2- 172.21.15.52:0/763098533 >> v2:172.21.15.52:3300/0 conn(0x7f4864071160 0x7f4864147210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57008/0 (socket says 172.21.15.52:57008) 2023-06-23T18:45:22.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.911+0000 7f4869b1b700 1 -- 172.21.15.52:0/763098533 >> v1:172.21.15.89:6789/0 conn(0x7f4864147750 legacy=0x7f4864151ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:22.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.911+0000 7f4869b1b700 1 -- 172.21.15.52:0/763098533 >> v1:172.21.15.52:6789/0 conn(0x7f4864141320 legacy=0x7f486406af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:22.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.911+0000 7f4869b1b700 1 -- 172.21.15.52:0/763098533 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486414ab00 con 0x7f4864071160 2023-06-23T18:45:22.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.911+0000 7f486931a700 1 -- 172.21.15.52:0/763098533 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4185072596 0 0) 0x7f486406b610 con 0x7f4864141320 2023-06-23T18:45:22.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.911+0000 7f4869b1b700 1 --2- 172.21.15.52:0/763098533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4864071160 0x7f4864147210 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4860009840 tx=0x7f4860009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee6f2a10ceaca2a0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:22.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.911+0000 7f486931a700 1 -- 172.21.15.52:0/763098533 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860011830 con 0x7f4864071160 2023-06-23T18:45:22.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.911+0000 7f486931a700 1 -- 172.21.15.52:0/763098533 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4860011990 con 0x7f4864071160 2023-06-23T18:45:22.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.911+0000 7f486931a700 1 -- 172.21.15.52:0/763098533 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860011d20 con 0x7f4864071160 2023-06-23T18:45:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.911+0000 7f486c580700 1 -- 172.21.15.52:0/763098533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4864071160 msgr2=0x7f4864147210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.911+0000 7f486c580700 1 --2- 172.21.15.52:0/763098533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4864071160 0x7f4864147210 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4860009840 tx=0x7f4860009b50 comp rx=0 tx=0).stop 2023-06-23T18:45:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.912+0000 7f486c580700 1 -- 172.21.15.52:0/763098533 shutdown_connections 2023-06-23T18:45:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.912+0000 7f486c580700 1 --2- 172.21.15.52:0/763098533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4864071160 0x7f4864147210 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.912+0000 7f486c580700 1 -- 172.21.15.52:0/763098533 >> 172.21.15.52:0/763098533 conn(0x7f48640bcfc0 msgr2=0x7f48640b8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:22.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.912+0000 7f486c580700 1 -- 172.21.15.52:0/763098533 shutdown_connections 2023-06-23T18:45:22.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.912+0000 7f486c580700 1 -- 172.21.15.52:0/763098533 wait complete. 2023-06-23T18:45:22.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.913+0000 7f486c580700 1 Processor -- start 2023-06-23T18:45:22.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.913+0000 7f486c580700 1 -- start start 2023-06-23T18:45:22.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.913+0000 7f486c580700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4864071160 0x7f4864146b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:22.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.913+0000 7f486c580700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4864141320 0x7f4864148b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:22.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.913+0000 7f486c580700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4864147750 0x7f4864145050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:22.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.913+0000 7f486c580700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4864149a20 con 0x7f4864141320 2023-06-23T18:45:22.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.913+0000 7f486c580700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486414a2a0 con 0x7f4864147750 2023-06-23T18:45:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.913+0000 7f486c580700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48641482f0 con 0x7f4864071160 2023-06-23T18:45:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.913+0000 7f4869b1b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4864141320 0x7f4864148b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.913+0000 7f4869b1b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4864141320 0x7f4864148b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57010/0 (socket says 172.21.15.52:57010) 2023-06-23T18:45:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.913+0000 7f4869b1b700 1 -- 172.21.15.52:0/3953405142 learned_addr learned my addr 172.21.15.52:0/3953405142 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.914+0000 7f486a31c700 1 --2- 172.21.15.52:0/3953405142 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4864071160 0x7f4864146b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.914+0000 7f486ab1d700 1 --2- 172.21.15.52:0/3953405142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4864147750 0x7f4864145050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:22.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.914+0000 7f4869b1b700 1 -- 172.21.15.52:0/3953405142 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4864071160 msgr2=0x7f4864146b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.914+0000 7f4869b1b700 1 --2- 172.21.15.52:0/3953405142 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4864071160 0x7f4864146b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.914+0000 7f4869b1b700 1 -- 172.21.15.52:0/3953405142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4864147750 msgr2=0x7f4864145050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.914+0000 7f4869b1b700 1 --2- 172.21.15.52:0/3953405142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4864147750 0x7f4864145050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.914+0000 7f4869b1b700 1 -- 172.21.15.52:0/3953405142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48600094a0 con 0x7f4864141320 2023-06-23T18:45:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.914+0000 7f486ab1d700 1 --2- 172.21.15.52:0/3953405142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4864147750 0x7f4864145050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.914+0000 7f4869b1b700 1 --2- 172.21.15.52:0/3953405142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4864141320 0x7f4864148b60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f486406e900 tx=0x7f4860004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.914+0000 7f4856ffd700 1 -- 172.21.15.52:0/3953405142 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486001a850 con 0x7f4864141320 2023-06-23T18:45:22.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.914+0000 7f4856ffd700 1 -- 172.21.15.52:0/3953405142 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486001a9b0 con 0x7f4864141320 2023-06-23T18:45:22.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.914+0000 7f4856ffd700 1 -- 172.21.15.52:0/3953405142 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486001ad40 con 0x7f4864141320 2023-06-23T18:45:22.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.914+0000 7f486c580700 1 -- 172.21.15.52:0/3953405142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4864149f30 con 0x7f4864141320 2023-06-23T18:45:22.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.914+0000 7f486c580700 1 -- 172.21.15.52:0/3953405142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48640b8ae0 con 0x7f4864141320 2023-06-23T18:45:22.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.915+0000 7f486c580700 1 -- 172.21.15.52:0/3953405142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f486414a450 con 0x7f4864141320 2023-06-23T18:45:22.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.916+0000 7f4856ffd700 1 -- 172.21.15.52:0/3953405142 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4860022070 con 0x7f4864141320 2023-06-23T18:45:22.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.916+0000 7f4856ffd700 1 --2- 172.21.15.52:0/3953405142 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f484806ace0 0x7f484806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:22.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.916+0000 7f4856ffd700 1 -- 172.21.15.52:0/3953405142 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f486008a720 con 0x7f4864141320 2023-06-23T18:45:22.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.916+0000 7f486a31c700 1 --2- 172.21.15.52:0/3953405142 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f484806ace0 0x7f484806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:22.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.917+0000 7f486a31c700 1 --2- 172.21.15.52:0/3953405142 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f484806ace0 0x7f484806d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4858007b10 tx=0x7f4858007a60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:22.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:22.921+0000 7f4856ffd700 1 -- 172.21.15.52:0/3953405142 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f486414a450 con 0x7f4864141320 2023-06-23T18:45:23.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.114+0000 7f486c580700 1 -- 172.21.15.52:0/3953405142 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f486414a450 con 0x7f4864141320 2023-06-23T18:45:23.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.115+0000 7f4856ffd700 1 -- 172.21.15.52:0/3953405142 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4860055860 con 0x7f4864141320 2023-06-23T18:45:23.120 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-06-23T18:45:23.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.116+0000 7f486c580700 1 -- 172.21.15.52:0/3953405142 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f484806ace0 msgr2=0x7f484806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:23.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.116+0000 7f486c580700 1 --2- 172.21.15.52:0/3953405142 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f484806ace0 0x7f484806d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4858007b10 tx=0x7f4858007a60 comp rx=0 tx=0).stop 2023-06-23T18:45:23.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.116+0000 7f486c580700 1 -- 172.21.15.52:0/3953405142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4864141320 msgr2=0x7f4864148b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:23.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.116+0000 7f486c580700 1 --2- 172.21.15.52:0/3953405142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4864141320 0x7f4864148b60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f486406e900 tx=0x7f4860004750 comp rx=0 tx=0).stop 2023-06-23T18:45:23.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.117+0000 7f486c580700 1 -- 172.21.15.52:0/3953405142 shutdown_connections 2023-06-23T18:45:23.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.117+0000 7f486c580700 1 --2- 172.21.15.52:0/3953405142 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f484806ace0 0x7f484806d190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:23.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.117+0000 7f486c580700 1 --2- 172.21.15.52:0/3953405142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4864147750 0x7f4864145050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:23.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.117+0000 7f486c580700 1 --2- 172.21.15.52:0/3953405142 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4864071160 0x7f4864146b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:23.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.117+0000 7f486c580700 1 --2- 172.21.15.52:0/3953405142 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4864141320 0x7f4864148b60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:23.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.117+0000 7f486c580700 1 -- 172.21.15.52:0/3953405142 >> 172.21.15.52:0/3953405142 conn(0x7f48640bcfc0 msgr2=0x7f486406f950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:23.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.117+0000 7f486c580700 1 -- 172.21.15.52:0/3953405142 shutdown_connections 2023-06-23T18:45:23.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.117+0000 7f486c580700 1 -- 172.21.15.52:0/3953405142 wait complete. 2023-06-23T18:45:23.133 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T18:45:23.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.253+0000 7f28a6650700 1 Processor -- start 2023-06-23T18:45:23.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.253+0000 7f28a6650700 1 -- start start 2023-06-23T18:45:23.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.254+0000 7f28a6650700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28a006a0d0 0x7f28a00bc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:23.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.254+0000 7f28a6650700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f28a01444a0 0x7f28a00b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:23.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.254+0000 7f28a6650700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a00b7aa0 con 0x7f28a00b5a20 2023-06-23T18:45:23.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.254+0000 7f28a6650700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a00b5f30 con 0x7f28a01444a0 2023-06-23T18:45:23.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.254+0000 7f28a6650700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a00b6210 con 0x7f28a006a0d0 2023-06-23T18:45:23.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.254+0000 7f2897fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f28a01444a0 0x7f28a00b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:23.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.254+0000 7f2897fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f28a01444a0 0x7f28a00b54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57014/0 (socket says 172.21.15.52:57014) 2023-06-23T18:45:23.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.254+0000 7f2897fff700 1 -- 172.21.15.52:0/523292135 learned_addr learned my addr 172.21.15.52:0/523292135 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:23.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.254+0000 7f289ffff700 1 --2- 172.21.15.52:0/523292135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28a006a0d0 0x7f28a00bc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:23.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.255+0000 7f2897fff700 1 -- 172.21.15.52:0/523292135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28a006a0d0 msgr2=0x7f28a00bc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:23.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.255+0000 7f2897fff700 1 --2- 172.21.15.52:0/523292135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28a006a0d0 0x7f28a00bc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:23.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.255+0000 7f2897fff700 1 -- 172.21.15.52:0/523292135 >> v1:172.21.15.89:6789/0 conn(0x7f28a00b5a20 legacy=0x7f28a00bb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:23.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.255+0000 7f2897fff700 1 -- 172.21.15.52:0/523292135 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a00b64f0 con 0x7f28a01444a0 2023-06-23T18:45:23.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.255+0000 7f2897fff700 1 --2- 172.21.15.52:0/523292135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28a01444a0 0x7f28a00b54e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f28880098f0 tx=0x7f2888009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9871fcbae54926f8 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:23.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.255+0000 7f289f7fe700 1 -- 172.21.15.52:0/523292135 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2888011830 con 0x7f28a01444a0 2023-06-23T18:45:23.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.255+0000 7f289f7fe700 1 -- 172.21.15.52:0/523292135 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2888011990 con 0x7f28a01444a0 2023-06-23T18:45:23.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.255+0000 7f289f7fe700 1 -- 172.21.15.52:0/523292135 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2888011d20 con 0x7f28a01444a0 2023-06-23T18:45:23.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.255+0000 7f28a6650700 1 -- 172.21.15.52:0/523292135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28a01444a0 msgr2=0x7f28a00b54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:23.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.255+0000 7f28a6650700 1 --2- 172.21.15.52:0/523292135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28a01444a0 0x7f28a00b54e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f28880098f0 tx=0x7f2888009c00 comp rx=0 tx=0).stop 2023-06-23T18:45:23.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.256+0000 7f28a6650700 1 -- 172.21.15.52:0/523292135 shutdown_connections 2023-06-23T18:45:23.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.256+0000 7f28a6650700 1 --2- 172.21.15.52:0/523292135 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28a006a0d0 0x7f28a00bc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:23.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.256+0000 7f28a6650700 1 --2- 172.21.15.52:0/523292135 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28a01444a0 0x7f28a00b54e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:23.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.256+0000 7f28a6650700 1 -- 172.21.15.52:0/523292135 >> 172.21.15.52:0/523292135 conn(0x7f28a006bb90 msgr2=0x7f28a006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:23.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.256+0000 7f28a6650700 1 -- 172.21.15.52:0/523292135 shutdown_connections 2023-06-23T18:45:23.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.256+0000 7f28a6650700 1 -- 172.21.15.52:0/523292135 wait complete. 2023-06-23T18:45:23.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.257+0000 7f28a6650700 1 Processor -- start 2023-06-23T18:45:23.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.257+0000 7f28a6650700 1 -- start start 2023-06-23T18:45:23.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.258+0000 7f28a6650700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28a006a0d0 0x7f28a0140800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:23.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.258+0000 7f28a6650700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28a00b5a20 0x7f28a014a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:23.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.258+0000 7f28a6650700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28a01444a0 0x7f28a00b9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:23.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.258+0000 7f28a6650700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a01d3790 con 0x7f28a01444a0 2023-06-23T18:45:23.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.258+0000 7f28a6650700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a00b97a0 con 0x7f28a00b5a20 2023-06-23T18:45:23.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.258+0000 7f28a6650700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a0148ad0 con 0x7f28a006a0d0 2023-06-23T18:45:23.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.258+0000 7f28a4bed700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28a01444a0 0x7f28a00b9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:23.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.258+0000 7f28a4bed700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28a01444a0 0x7f28a00b9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57030/0 (socket says 172.21.15.52:57030) 2023-06-23T18:45:23.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.258+0000 7f28a4bed700 1 -- 172.21.15.52:0/957633044 learned_addr learned my addr 172.21.15.52:0/957633044 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:23.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.258+0000 7f289ffff700 1 --2- 172.21.15.52:0/957633044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28a006a0d0 0x7f28a0140800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:23.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.258+0000 7f2897fff700 1 --2- 172.21.15.52:0/957633044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28a00b5a20 0x7f28a014a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:23.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.258+0000 7f28a4bed700 1 -- 172.21.15.52:0/957633044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28a006a0d0 msgr2=0x7f28a0140800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:23.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.258+0000 7f28a4bed700 1 --2- 172.21.15.52:0/957633044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28a006a0d0 0x7f28a0140800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:23.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.258+0000 7f28a4bed700 1 -- 172.21.15.52:0/957633044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28a00b5a20 msgr2=0x7f28a014a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:23.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.258+0000 7f28a4bed700 1 --2- 172.21.15.52:0/957633044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28a00b5a20 0x7f28a014a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:23.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.258+0000 7f28a4bed700 1 -- 172.21.15.52:0/957633044 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2888009550 con 0x7f28a01444a0 2023-06-23T18:45:23.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.258+0000 7f289ffff700 1 --2- 172.21.15.52:0/957633044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28a006a0d0 0x7f28a0140800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:23.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.259+0000 7f28a4bed700 1 --2- 172.21.15.52:0/957633044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28a01444a0 0x7f28a00b9260 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f289800cbf0 tx=0x7f289800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:23.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.259+0000 7f289d7fa700 1 -- 172.21.15.52:0/957633044 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898003c00 con 0x7f28a01444a0 2023-06-23T18:45:23.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.259+0000 7f289d7fa700 1 -- 172.21.15.52:0/957633044 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2898003d60 con 0x7f28a01444a0 2023-06-23T18:45:23.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.259+0000 7f28a6650700 1 -- 172.21.15.52:0/957633044 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a01d2ac0 con 0x7f28a01444a0 2023-06-23T18:45:23.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.259+0000 7f289d7fa700 1 -- 172.21.15.52:0/957633044 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289800ac20 con 0x7f28a01444a0 2023-06-23T18:45:23.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.259+0000 7f28a6650700 1 -- 172.21.15.52:0/957633044 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a0148760 con 0x7f28a01444a0 2023-06-23T18:45:23.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.260+0000 7f28a6650700 1 -- 172.21.15.52:0/957633044 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a01d2920 con 0x7f28a01444a0 2023-06-23T18:45:23.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.260+0000 7f289d7fa700 1 -- 172.21.15.52:0/957633044 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f28980050d0 con 0x7f28a01444a0 2023-06-23T18:45:23.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.260+0000 7f289d7fa700 1 --2- 172.21.15.52:0/957633044 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f288006ace0 0x7f288006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:23.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.261+0000 7f289d7fa700 1 -- 172.21.15.52:0/957633044 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f28980894b0 con 0x7f28a01444a0 2023-06-23T18:45:23.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.261+0000 7f289ffff700 1 --2- 172.21.15.52:0/957633044 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f288006ace0 0x7f288006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:23.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.261+0000 7f289ffff700 1 --2- 172.21.15.52:0/957633044 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f288006ace0 0x7f288006d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2890009c30 tx=0x7f2890008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:23.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.265+0000 7f289d7fa700 1 -- 172.21.15.52:0/957633044 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f28a01d2920 con 0x7f28a01444a0 2023-06-23T18:45:23.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.503+0000 7f28a6650700 1 -- 172.21.15.52:0/957633044 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28a01d2920 con 0x7f28a01444a0 2023-06-23T18:45:23.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.504+0000 7f289d7fa700 1 -- 172.21.15.52:0/957633044 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3906 (secure 0 0 0) 0x7f28a01d2920 con 0x7f28a01444a0 2023-06-23T18:45:23.509 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:23.509 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/299877491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":299877491},{"type":"v1","addr":"172.21.15.89:6835","nonce":299877491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/2826461143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2826461143},{"type":"v1","addr":"172.21.15.52:6833","nonce":2826461143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T18:44:50.642376+0000","modified":"2023-06-23T18:44:53.679243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/4214822260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4214822260},{"type":"v1","addr":"172.21.15.52:6835","nonce":4214822260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-23T18:45:23.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.505+0000 7f28a6650700 1 -- 172.21.15.52:0/957633044 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f288006ace0 msgr2=0x7f288006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:23.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.505+0000 7f28a6650700 1 --2- 172.21.15.52:0/957633044 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f288006ace0 0x7f288006d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2890009c30 tx=0x7f2890008040 comp rx=0 tx=0).stop 2023-06-23T18:45:23.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.505+0000 7f28a6650700 1 -- 172.21.15.52:0/957633044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28a01444a0 msgr2=0x7f28a00b9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:23.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.505+0000 7f28a6650700 1 --2- 172.21.15.52:0/957633044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28a01444a0 0x7f28a00b9260 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f289800cbf0 tx=0x7f289800a060 comp rx=0 tx=0).stop 2023-06-23T18:45:23.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.506+0000 7f28a6650700 1 -- 172.21.15.52:0/957633044 shutdown_connections 2023-06-23T18:45:23.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.506+0000 7f28a6650700 1 --2- 172.21.15.52:0/957633044 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f288006ace0 0x7f288006d190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:23.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.506+0000 7f28a6650700 1 --2- 172.21.15.52:0/957633044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28a01444a0 0x7f28a00b9260 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:23.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.506+0000 7f28a6650700 1 --2- 172.21.15.52:0/957633044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28a006a0d0 0x7f28a0140800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:23.511 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.506+0000 7f28a6650700 1 --2- 172.21.15.52:0/957633044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f28a00b5a20 0x7f28a014a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:23.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.506+0000 7f28a6650700 1 -- 172.21.15.52:0/957633044 >> 172.21.15.52:0/957633044 conn(0x7f28a006bb90 msgr2=0x7f28a00bf9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:23.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.506+0000 7f28a6650700 1 -- 172.21.15.52:0/957633044 shutdown_connections 2023-06-23T18:45:23.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.506+0000 7f28a6650700 1 -- 172.21.15.52:0/957633044 wait complete. 2023-06-23T18:45:23.512 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2023-06-23T18:45:23.522 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:45:23.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.643+0000 7fe3d65fc700 1 Processor -- start 2023-06-23T18:45:23.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.643+0000 7fe3d65fc700 1 -- start start 2023-06-23T18:45:23.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.643+0000 7fe3d65fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3d0144920 0x7fe3d0155db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:23.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.643+0000 7fe3d65fc700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d00b7aa0 con 0x7fe3d006a0d0 2023-06-23T18:45:23.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.643+0000 7fe3d65fc700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d00b5f30 con 0x7fe3d01444a0 2023-06-23T18:45:23.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.643+0000 7fe3d65fc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d00bcfc0 con 0x7fe3d0144920 2023-06-23T18:45:23.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.643+0000 7fe3cffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe3d006a0d0 0x7fe3d00bc8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37980/0 (socket says 172.21.15.52:37980) 2023-06-23T18:45:23.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.643+0000 7fe3cffff700 1 -- 172.21.15.52:0/2258918801 learned_addr learned my addr 172.21.15.52:0/2258918801 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:23.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.644+0000 7fe3d4b99700 1 --2- 172.21.15.52:0/2258918801 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3d0144920 0x7fe3d0155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:23.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.644+0000 7fe3ceffd700 1 -- 172.21.15.52:0/2258918801 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1591561752 0 0) 0x7fe3d00b7aa0 con 0x7fe3d006a0d0 2023-06-23T18:45:23.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.644+0000 7fe3ceffd700 1 -- 172.21.15.52:0/2258918801 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3b80035b0 con 0x7fe3d006a0d0 2023-06-23T18:45:23.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.644+0000 7fe3d4b99700 1 -- 172.21.15.52:0/2258918801 >> v1:172.21.15.89:6789/0 conn(0x7fe3d01444a0 legacy=0x7fe3d00b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:23.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.644+0000 7fe3ceffd700 1 -- 172.21.15.52:0/2258918801 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1967180735 0 0) 0x7fe3b80035b0 con 0x7fe3d006a0d0 2023-06-23T18:45:23.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.644+0000 7fe3d4b99700 1 -- 172.21.15.52:0/2258918801 >> v1:172.21.15.52:6789/0 conn(0x7fe3d006a0d0 legacy=0x7fe3d00bc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:23.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.644+0000 7fe3d4b99700 1 -- 172.21.15.52:0/2258918801 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d00b6210 con 0x7fe3d0144920 2023-06-23T18:45:23.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.644+0000 7fe3d4b99700 1 --2- 172.21.15.52:0/2258918801 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3d0144920 0x7fe3d0155db0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009dc0 tx=0x7fe3c800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7db1430a0a8d89b6 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:23.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.644+0000 7fe3ceffd700 1 -- 172.21.15.52:0/2258918801 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c800e070 con 0x7fe3d0144920 2023-06-23T18:45:23.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.644+0000 7fe3ceffd700 1 -- 172.21.15.52:0/2258918801 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c8003a20 con 0x7fe3d0144920 2023-06-23T18:45:23.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.644+0000 7fe3ceffd700 1 -- 172.21.15.52:0/2258918801 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c0001670 con 0x7fe3d0144920 2023-06-23T18:45:23.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.645+0000 7fe3d65fc700 1 -- 172.21.15.52:0/2258918801 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3d0144920 msgr2=0x7fe3d0155db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:23.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.645+0000 7fe3d65fc700 1 --2- 172.21.15.52:0/2258918801 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3d0144920 0x7fe3d0155db0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009dc0 tx=0x7fe3c800b330 comp rx=0 tx=0).stop 2023-06-23T18:45:23.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.645+0000 7fe3d65fc700 1 -- 172.21.15.52:0/2258918801 shutdown_connections 2023-06-23T18:45:23.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.645+0000 7fe3d65fc700 1 --2- 172.21.15.52:0/2258918801 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3d0144920 0x7fe3d0155db0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:23.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.645+0000 7fe3d65fc700 1 -- 172.21.15.52:0/2258918801 >> 172.21.15.52:0/2258918801 conn(0x7fe3d006bb90 msgr2=0x7fe3d006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:23.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.645+0000 7fe3d65fc700 1 -- 172.21.15.52:0/2258918801 shutdown_connections 2023-06-23T18:45:23.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.645+0000 7fe3d65fc700 1 -- 172.21.15.52:0/2258918801 wait complete. 2023-06-23T18:45:23.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.646+0000 7fe3d65fc700 1 Processor -- start 2023-06-23T18:45:23.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.646+0000 7fe3d65fc700 1 -- start start 2023-06-23T18:45:23.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.647+0000 7fe3d65fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3d006a0d0 0x7fe3d0149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:23.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.647+0000 7fe3d65fc700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3d01444a0 0x7fe3d0146d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:23.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.647+0000 7fe3d65fc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3d0144920 0x7fe3d0140440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:23.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.647+0000 7fe3d65fc700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d0149d40 con 0x7fe3d01444a0 2023-06-23T18:45:23.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.647+0000 7fe3d65fc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d01477a0 con 0x7fe3d0144920 2023-06-23T18:45:23.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.647+0000 7fe3d65fc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d0147250 con 0x7fe3d006a0d0 2023-06-23T18:45:23.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.647+0000 7fe3cf7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3d01444a0 0x7fe3d0146d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:23.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.647+0000 7fe3cf7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3d01444a0 0x7fe3d0146d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57036/0 (socket says 172.21.15.52:57036) 2023-06-23T18:45:23.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.647+0000 7fe3cf7fe700 1 -- 172.21.15.52:0/3326190025 learned_addr learned my addr 172.21.15.52:0/3326190025 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:23.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.647+0000 7fe3cffff700 1 --2- 172.21.15.52:0/3326190025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3d006a0d0 0x7fe3d0149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:23.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.647+0000 7fe3d4b99700 1 --2- 172.21.15.52:0/3326190025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3d0144920 0x7fe3d0140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:23.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.647+0000 7fe3cf7fe700 1 -- 172.21.15.52:0/3326190025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3d006a0d0 msgr2=0x7fe3d0149800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:23.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.647+0000 7fe3cf7fe700 1 --2- 172.21.15.52:0/3326190025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3d006a0d0 0x7fe3d0149800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:23.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.647+0000 7fe3cf7fe700 1 -- 172.21.15.52:0/3326190025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3d0144920 msgr2=0x7fe3d0140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:23.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.647+0000 7fe3cf7fe700 1 --2- 172.21.15.52:0/3326190025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3d0144920 0x7fe3d0140440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:23.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.647+0000 7fe3cf7fe700 1 -- 172.21.15.52:0/3326190025 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c8009a70 con 0x7fe3d01444a0 2023-06-23T18:45:23.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.647+0000 7fe3d4b99700 1 --2- 172.21.15.52:0/3326190025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3d0144920 0x7fe3d0140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:45:23.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.647+0000 7fe3cf7fe700 1 --2- 172.21.15.52:0/3326190025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3d01444a0 0x7fe3d0146d10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe3c400c780 tx=0x7fe3c400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:23.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.648+0000 7fe3ccff9700 1 -- 172.21.15.52:0/3326190025 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c4005480 con 0x7fe3d01444a0 2023-06-23T18:45:23.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.648+0000 7fe3ccff9700 1 -- 172.21.15.52:0/3326190025 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c4003680 con 0x7fe3d01444a0 2023-06-23T18:45:23.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.648+0000 7fe3ccff9700 1 -- 172.21.15.52:0/3326190025 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c4003a30 con 0x7fe3d01444a0 2023-06-23T18:45:23.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.648+0000 7fe3d65fc700 1 -- 172.21.15.52:0/3326190025 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d01474c0 con 0x7fe3d01444a0 2023-06-23T18:45:23.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.648+0000 7fe3d65fc700 1 -- 172.21.15.52:0/3326190025 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d01451e0 con 0x7fe3d01444a0 2023-06-23T18:45:23.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.649+0000 7fe3d65fc700 1 -- 172.21.15.52:0/3326190025 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d004e1d0 con 0x7fe3d01444a0 2023-06-23T18:45:23.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.649+0000 7fe3ccff9700 1 -- 172.21.15.52:0/3326190025 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe3c4003b90 con 0x7fe3d01444a0 2023-06-23T18:45:23.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.649+0000 7fe3ccff9700 1 --2- 172.21.15.52:0/3326190025 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe3bc06ace0 0x7fe3bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:23.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.650+0000 7fe3ccff9700 1 -- 172.21.15.52:0/3326190025 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe3c4088ec0 con 0x7fe3d01444a0 2023-06-23T18:45:23.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.650+0000 7fe3cffff700 1 --2- 172.21.15.52:0/3326190025 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe3bc06ace0 0x7fe3bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:23.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.650+0000 7fe3cffff700 1 --2- 172.21.15.52:0/3326190025 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe3bc06ace0 0x7fe3bc06d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe3c00011e0 tx=0x7fe3c00014d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:23.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.654+0000 7fe3ccff9700 1 -- 172.21.15.52:0/3326190025 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe3c40540c0 con 0x7fe3d01444a0 2023-06-23T18:45:23.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.857+0000 7fe3d65fc700 1 -- 172.21.15.52:0/3326190025 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3d00b6870 con 0x7fe3d01444a0 2023-06-23T18:45:23.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.858+0000 7fe3ccff9700 1 -- 172.21.15.52:0/3326190025 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7fe3c40576e0 con 0x7fe3d01444a0 2023-06-23T18:45:23.864 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:23.864 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","created":"2023-06-23T18:44:31.918434+0000","modified":"2023-06-23T18:44:51.644330+0000","last_up_change":"2023-06-23T18:44:42.169624+0000","last_in_change":"2023-06-23T18:44:34.510501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-23T18:44:43.346578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-23T18:44:43.829719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:44:48.517897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:44:49.621134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c371fb28-1b15-4e43-8d5a-43e402920ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6812","nonce":1066999520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6815","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6818","nonce":1066999520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6829","nonce":1066999520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6823","nonce":1066999520}]},"public_addr":"172.21.15.52:6812/1066999520","cluster_addr":"172.21.15.52:6818/1066999520","heartbeat_back_addr":"172.21.15.52:6829/1066999520","heartbeat_front_addr":"172.21.15.52:6823/1066999520","state":["exists","up"]},{"osd":1,"uuid":"4a142f04-33eb-47ec-9cc5-b08b44d82658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6813","nonce":2360219751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6819","nonce":2360219751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6830","nonce":2360219751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6825","nonce":2360219751}]},"public_addr":"172.21.15.52:6813/2360219751","cluster_addr":"172.21.15.52:6819/2360219751","heartbeat_back_addr":"172.21.15.52:6830/2360219751","heartbeat_front_addr":"172.21.15.52:6825/2360219751","state":["exists","up"]},{"osd":2,"uuid":"d7bb089d-4c55-4370-ba59-7fe88c39512a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6801","nonce":835073005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6803","nonce":835073005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6807","nonce":835073005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6805","nonce":835073005}]},"public_addr":"172.21.15.52:6801/835073005","cluster_addr":"172.21.15.52:6803/835073005","heartbeat_back_addr":"172.21.15.52:6807/835073005","heartbeat_front_addr":"172.21.15.52:6805/835073005","state":["exists","up"]},{"osd":3,"uuid":"4bcdcdc3-6a8f-468e-877e-57f76079ac3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6811","nonce":2852700864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6817","nonce":2852700864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6831","nonce":2852700864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6824","nonce":2852700864}]},"public_addr":"172.21.15.52:6811/2852700864","cluster_addr":"172.21.15.52:6817/2852700864","heartbeat_back_addr":"172.21.15.52:6831/2852700864","heartbeat_front_addr":"172.21.15.52:6824/2852700864","state":["exists","up"]},{"osd":4,"uuid":"cac63000-ae94-4b08-93e6-a99119640b63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6809","nonce":2538664679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6811","nonce":2538664679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6815","nonce":2538664679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6813","nonce":2538664679}]},"public_addr":"172.21.15.89:6809/2538664679","cluster_addr":"172.21.15.89:6811/2538664679","heartbeat_back_addr":"172.21.15.89:6815/2538664679","heartbeat_front_addr":"172.21.15.89:6813/2538664679","state":["exists","up"]},{"osd":5,"uuid":"45c53102-18a6-4fd7-9c25-8ea5e1ef6851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6801","nonce":1683710352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6803","nonce":1683710352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6807","nonce":1683710352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6805","nonce":1683710352}]},"public_addr":"172.21.15.89:6801/1683710352","cluster_addr":"172.21.15.89:6803/1683710352","heartbeat_back_addr":"172.21.15.89:6807/1683710352","heartbeat_front_addr":"172.21.15.89:6805/1683710352","state":["exists","up"]},{"osd":6,"uuid":"abee09d1-8eba-484f-a25c-871c1fe2e843","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6817","nonce":3890899288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6819","nonce":3890899288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6823","nonce":3890899288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6821","nonce":3890899288}]},"public_addr":"172.21.15.89:6817/3890899288","cluster_addr":"172.21.15.89:6819/3890899288","heartbeat_back_addr":"172.21.15.89:6823/3890899288","heartbeat_front_addr":"172.21.15.89:6821/3890899288","state":["exists","up"]},{"osd":7,"uuid":"5acf9e2e-00dd-4f9b-a7d9-3d820f695de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6825","nonce":2989085420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6827","nonce":2989085420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6831","nonce":2989085420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6829","nonce":2989085420}]},"public_addr":"172.21.15.89:6825/2989085420","cluster_addr":"172.21.15.89:6827/2989085420","heartbeat_back_addr":"172.21.15.89:6831/2989085420","heartbeat_front_addr":"172.21.15.89:6829/2989085420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.663866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.710904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.619347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.660102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.686933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.724635+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.669111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.678740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:45:23.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.861+0000 7fe3d65fc700 1 -- 172.21.15.52:0/3326190025 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe3bc06ace0 msgr2=0x7fe3bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:23.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.861+0000 7fe3d65fc700 1 --2- 172.21.15.52:0/3326190025 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe3bc06ace0 0x7fe3bc06d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe3c00011e0 tx=0x7fe3c00014d0 comp rx=0 tx=0).stop 2023-06-23T18:45:23.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.861+0000 7fe3d65fc700 1 -- 172.21.15.52:0/3326190025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3d01444a0 msgr2=0x7fe3d0146d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:23.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.861+0000 7fe3d65fc700 1 --2- 172.21.15.52:0/3326190025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3d01444a0 0x7fe3d0146d10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe3c400c780 tx=0x7fe3c400cb40 comp rx=0 tx=0).stop 2023-06-23T18:45:23.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.861+0000 7fe3d65fc700 1 -- 172.21.15.52:0/3326190025 shutdown_connections 2023-06-23T18:45:23.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.861+0000 7fe3d65fc700 1 --2- 172.21.15.52:0/3326190025 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe3bc06ace0 0x7fe3bc06d190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:23.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.861+0000 7fe3d65fc700 1 --2- 172.21.15.52:0/3326190025 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3d0144920 0x7fe3d0140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:23.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.861+0000 7fe3d65fc700 1 --2- 172.21.15.52:0/3326190025 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3d006a0d0 0x7fe3d0149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:23.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.861+0000 7fe3d65fc700 1 --2- 172.21.15.52:0/3326190025 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3d01444a0 0x7fe3d0146d10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:23.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.861+0000 7fe3d65fc700 1 -- 172.21.15.52:0/3326190025 >> 172.21.15.52:0/3326190025 conn(0x7fe3d006bb90 msgr2=0x7fe3d01d68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:23.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.861+0000 7fe3d65fc700 1 -- 172.21.15.52:0/3326190025 shutdown_connections 2023-06-23T18:45:23.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.861+0000 7fe3d65fc700 1 -- 172.21.15.52:0/3326190025 wait complete. 2023-06-23T18:45:23.878 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-23T18:45:23.878 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T18:45:24.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.999+0000 7f0dcc175700 1 Processor -- start 2023-06-23T18:45:24.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:23.999+0000 7f0dcc175700 1 -- start start 2023-06-23T18:45:24.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.000+0000 7f0dcc175700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0dc406a0d0 0x7f0dc40bc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:24.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.000+0000 7f0dcc175700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0dc41444a0 0x7f0dc40b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:24.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.000+0000 7f0dcc175700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc40b7aa0 con 0x7f0dc40b5a20 2023-06-23T18:45:24.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.000+0000 7f0dcc175700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc40b5f30 con 0x7f0dc406a0d0 2023-06-23T18:45:24.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.000+0000 7f0dcc175700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc40b6210 con 0x7f0dc41444a0 2023-06-23T18:45:24.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.000+0000 7f0dc9f11700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f0dc406a0d0 0x7f0dc40bc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:24.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.000+0000 7f0dca712700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f0dc40b5a20 0x7f0dc40bb020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:37994/0 (socket says 172.21.15.52:37994) 2023-06-23T18:45:24.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.000+0000 7f0dca712700 1 -- 172.21.15.52:0/4143957134 learned_addr learned my addr 172.21.15.52:0/4143957134 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:24.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.000+0000 7f0dc9710700 1 --2- 172.21.15.52:0/4143957134 >> v2:172.21.15.89:3300/0 conn(0x7f0dc41444a0 0x7f0dc40b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:24.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.000+0000 7f0dc9f11700 1 -- 172.21.15.52:0/4143957134 >> v2:172.21.15.89:3300/0 conn(0x7f0dc41444a0 msgr2=0x7f0dc40b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:24.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.000+0000 7f0dc9f11700 1 --2- 172.21.15.52:0/4143957134 >> v2:172.21.15.89:3300/0 conn(0x7f0dc41444a0 0x7f0dc40b54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:24.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.000+0000 7f0dc9f11700 1 -- 172.21.15.52:0/4143957134 >> v1:172.21.15.52:6789/0 conn(0x7f0dc40b5a20 legacy=0x7f0dc40bb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:24.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.000+0000 7f0dc8f0f700 1 -- 172.21.15.52:0/4143957134 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396203271 0 0) 0x7f0dc40b7aa0 con 0x7f0dc40b5a20 2023-06-23T18:45:24.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.000+0000 7f0dc9f11700 1 -- 172.21.15.52:0/4143957134 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc40b64f0 con 0x7f0dc406a0d0 2023-06-23T18:45:24.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.000+0000 7f0dc9710700 1 --2- 172.21.15.52:0/4143957134 >> v2:172.21.15.89:3300/0 conn(0x7f0dc41444a0 0x7f0dc40b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:45:24.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.001+0000 7f0dc9f11700 1 --2- 172.21.15.52:0/4143957134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dc406a0d0 0x7f0dc40bc8b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4073930 tx=0x7f0db4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0685fbe6757be0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:24.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.001+0000 7f0dc8f0f700 1 -- 172.21.15.52:0/4143957134 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db4011830 con 0x7f0dc406a0d0 2023-06-23T18:45:24.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.001+0000 7f0dc8f0f700 1 -- 172.21.15.52:0/4143957134 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db4011990 con 0x7f0dc406a0d0 2023-06-23T18:45:24.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.001+0000 7f0dc8f0f700 1 -- 172.21.15.52:0/4143957134 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db4011d20 con 0x7f0dc406a0d0 2023-06-23T18:45:24.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.001+0000 7f0dcc175700 1 -- 172.21.15.52:0/4143957134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dc406a0d0 msgr2=0x7f0dc40bc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:24.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.001+0000 7f0dcc175700 1 --2- 172.21.15.52:0/4143957134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dc406a0d0 0x7f0dc40bc8b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4073930 tx=0x7f0db4009b20 comp rx=0 tx=0).stop 2023-06-23T18:45:24.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.001+0000 7f0dcc175700 1 -- 172.21.15.52:0/4143957134 shutdown_connections 2023-06-23T18:45:24.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.001+0000 7f0dcc175700 1 --2- 172.21.15.52:0/4143957134 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dc406a0d0 0x7f0dc40bc8b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:24.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.001+0000 7f0dcc175700 1 --2- 172.21.15.52:0/4143957134 >> v2:172.21.15.89:3300/0 conn(0x7f0dc41444a0 0x7f0dc40b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:24.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.001+0000 7f0dcc175700 1 -- 172.21.15.52:0/4143957134 >> 172.21.15.52:0/4143957134 conn(0x7f0dc406bb90 msgr2=0x7f0dc406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:24.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.001+0000 7f0dcc175700 1 -- 172.21.15.52:0/4143957134 shutdown_connections 2023-06-23T18:45:24.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.001+0000 7f0dcc175700 1 -- 172.21.15.52:0/4143957134 wait complete. 2023-06-23T18:45:24.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.003+0000 7f0dcc175700 1 Processor -- start 2023-06-23T18:45:24.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.003+0000 7f0dcc175700 1 -- start start 2023-06-23T18:45:24.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.004+0000 7f0dcc175700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0dc406a0d0 0x7f0dc41e0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:24.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.004+0000 7f0dcc175700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dc40b5a20 0x7f0dc4140f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:24.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.004+0000 7f0dcc175700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dc41444a0 0x7f0dc4142720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:24.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.004+0000 7f0dcc175700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc41e0370 con 0x7f0dc41444a0 2023-06-23T18:45:24.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.004+0000 7f0dcc175700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc41405e0 con 0x7f0dc40b5a20 2023-06-23T18:45:24.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.004+0000 7f0dcc175700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc41dfd20 con 0x7f0dc406a0d0 2023-06-23T18:45:24.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.004+0000 7f0dca712700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dc41444a0 0x7f0dc4142720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:24.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.004+0000 7f0dca712700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dc41444a0 0x7f0dc4142720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57042/0 (socket says 172.21.15.52:57042) 2023-06-23T18:45:24.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.004+0000 7f0dca712700 1 -- 172.21.15.52:0/2430222461 learned_addr learned my addr 172.21.15.52:0/2430222461 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:24.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.004+0000 7f0dc9f11700 1 --2- 172.21.15.52:0/2430222461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0dc406a0d0 0x7f0dc41e0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:24.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.004+0000 7f0dc9710700 1 --2- 172.21.15.52:0/2430222461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dc40b5a20 0x7f0dc4140f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:24.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.004+0000 7f0dca712700 1 -- 172.21.15.52:0/2430222461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0dc406a0d0 msgr2=0x7f0dc41e0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:24.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.004+0000 7f0dca712700 1 --2- 172.21.15.52:0/2430222461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0dc406a0d0 0x7f0dc41e0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:24.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.004+0000 7f0dca712700 1 -- 172.21.15.52:0/2430222461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dc40b5a20 msgr2=0x7f0dc4140f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:24.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.004+0000 7f0dca712700 1 --2- 172.21.15.52:0/2430222461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dc40b5a20 0x7f0dc4140f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:24.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.004+0000 7f0dca712700 1 -- 172.21.15.52:0/2430222461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db40094a0 con 0x7f0dc41444a0 2023-06-23T18:45:24.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.004+0000 7f0dc9710700 1 --2- 172.21.15.52:0/2430222461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dc40b5a20 0x7f0dc4140f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:24.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.004+0000 7f0dca712700 1 --2- 172.21.15.52:0/2430222461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dc41444a0 0x7f0dc4142720 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc002230 tx=0x7f0dbc00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:24.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.004+0000 7f0dba7fc700 1 -- 172.21.15.52:0/2430222461 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc00ab70 con 0x7f0dc41444a0 2023-06-23T18:45:24.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.005+0000 7f0dba7fc700 1 -- 172.21.15.52:0/2430222461 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc00acf0 con 0x7f0dc41444a0 2023-06-23T18:45:24.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.005+0000 7f0dba7fc700 1 -- 172.21.15.52:0/2430222461 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc007310 con 0x7f0dc41444a0 2023-06-23T18:45:24.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.005+0000 7f0dcc175700 1 -- 172.21.15.52:0/2430222461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc41e0000 con 0x7f0dc41444a0 2023-06-23T18:45:24.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.005+0000 7f0dcc175700 1 -- 172.21.15.52:0/2430222461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc4147740 con 0x7f0dc41444a0 2023-06-23T18:45:24.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.006+0000 7f0dcc175700 1 -- 172.21.15.52:0/2430222461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc41e0520 con 0x7f0dc41444a0 2023-06-23T18:45:24.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.006+0000 7f0dba7fc700 1 -- 172.21.15.52:0/2430222461 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0dbc007470 con 0x7f0dc41444a0 2023-06-23T18:45:24.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.007+0000 7f0dba7fc700 1 --2- 172.21.15.52:0/2430222461 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0da806ace0 0x7f0da806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:24.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.007+0000 7f0dba7fc700 1 -- 172.21.15.52:0/2430222461 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0dbc088fd0 con 0x7f0dc41444a0 2023-06-23T18:45:24.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.007+0000 7f0dc9f11700 1 --2- 172.21.15.52:0/2430222461 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0da806ace0 0x7f0da806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:24.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.008+0000 7f0dc9f11700 1 --2- 172.21.15.52:0/2430222461 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0da806ace0 0x7f0da806d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0db40090b0 tx=0x7f0db4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:24.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.011+0000 7f0dba7fc700 1 -- 172.21.15.52:0/2430222461 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0dc41e0520 con 0x7f0dc41444a0 2023-06-23T18:45:24.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.252+0000 7f0dcc175700 1 -- 172.21.15.52:0/2430222461 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0dc404e1d0 con 0x7f0dc41444a0 2023-06-23T18:45:24.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.253+0000 7f0dba7fc700 1 -- 172.21.15.52:0/2430222461 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3906 (secure 0 0 0) 0x7f0dbc018020 con 0x7f0dc41444a0 2023-06-23T18:45:24.258 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:24.258 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/299877491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":299877491},{"type":"v1","addr":"172.21.15.89:6835","nonce":299877491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/2826461143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2826461143},{"type":"v1","addr":"172.21.15.52:6833","nonce":2826461143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T18:44:50.642376+0000","modified":"2023-06-23T18:44:53.679243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/4214822260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4214822260},{"type":"v1","addr":"172.21.15.52:6835","nonce":4214822260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-23T18:45:24.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.255+0000 7f0dcc175700 1 -- 172.21.15.52:0/2430222461 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0da806ace0 msgr2=0x7f0da806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:24.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.255+0000 7f0dcc175700 1 --2- 172.21.15.52:0/2430222461 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0da806ace0 0x7f0da806d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0db40090b0 tx=0x7f0db4008030 comp rx=0 tx=0).stop 2023-06-23T18:45:24.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.255+0000 7f0dcc175700 1 -- 172.21.15.52:0/2430222461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dc41444a0 msgr2=0x7f0dc4142720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:24.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.255+0000 7f0dcc175700 1 --2- 172.21.15.52:0/2430222461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dc41444a0 0x7f0dc4142720 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc002230 tx=0x7f0dbc00cf50 comp rx=0 tx=0).stop 2023-06-23T18:45:24.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.255+0000 7f0dcc175700 1 -- 172.21.15.52:0/2430222461 shutdown_connections 2023-06-23T18:45:24.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.255+0000 7f0dcc175700 1 --2- 172.21.15.52:0/2430222461 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f0da806ace0 0x7f0da806d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:24.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.255+0000 7f0dcc175700 1 --2- 172.21.15.52:0/2430222461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0dc41444a0 0x7f0dc4142720 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:24.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.255+0000 7f0dcc175700 1 --2- 172.21.15.52:0/2430222461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0dc406a0d0 0x7f0dc41e0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:24.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.255+0000 7f0dcc175700 1 --2- 172.21.15.52:0/2430222461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0dc40b5a20 0x7f0dc4140f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:24.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.255+0000 7f0dcc175700 1 -- 172.21.15.52:0/2430222461 >> 172.21.15.52:0/2430222461 conn(0x7f0dc406bb90 msgr2=0x7f0dc40bb790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:24.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.255+0000 7f0dcc175700 1 -- 172.21.15.52:0/2430222461 shutdown_connections 2023-06-23T18:45:24.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.255+0000 7f0dcc175700 1 -- 172.21.15.52:0/2430222461 wait complete. 2023-06-23T18:45:24.261 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2023-06-23T18:45:24.272 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T18:45:24.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.393+0000 7f3b0a5b2700 1 Processor -- start 2023-06-23T18:45:24.398 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.393+0000 7f3b0a5b2700 1 -- start start 2023-06-23T18:45:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.394+0000 7f3b0a5b2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b040b6c60 0x7f3b0406af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:24.399 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.394+0000 7f3b0a5b2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3b040b8fe0 0x7f3b04154d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:24.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.394+0000 7f3b0a5b2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b040b67d0 con 0x7f3b041446e0 2023-06-23T18:45:24.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.394+0000 7f3b0a5b2700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b040723d0 con 0x7f3b040b8fe0 2023-06-23T18:45:24.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.394+0000 7f3b0a5b2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b040720f0 con 0x7f3b040b6c60 2023-06-23T18:45:24.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.394+0000 7f3b08b4f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3b040b8fe0 0x7f3b04154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:24.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.394+0000 7f3b08b4f700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3b040b8fe0 0x7f3b04154d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57046/0 (socket says 172.21.15.52:57046) 2023-06-23T18:45:24.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.394+0000 7f3b08b4f700 1 -- 172.21.15.52:0/733589183 learned_addr learned my addr 172.21.15.52:0/733589183 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:24.400 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.394+0000 7f3b037fe700 1 --2- 172.21.15.52:0/733589183 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b040b6c60 0x7f3b0406af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:24.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.394+0000 7f3b08b4f700 1 -- 172.21.15.52:0/733589183 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b040b6c60 msgr2=0x7f3b0406af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:24.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.394+0000 7f3b08b4f700 1 --2- 172.21.15.52:0/733589183 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b040b6c60 0x7f3b0406af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:24.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.394+0000 7f3b08b4f700 1 -- 172.21.15.52:0/733589183 >> v1:172.21.15.89:6789/0 conn(0x7f3b041446e0 legacy=0x7f3b0406fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:24.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.394+0000 7f3b08b4f700 1 -- 172.21.15.52:0/733589183 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0406f9d0 con 0x7f3b040b8fe0 2023-06-23T18:45:24.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.395+0000 7f3b08b4f700 1 --2- 172.21.15.52:0/733589183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b040b8fe0 0x7f3b04154d00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3afc009e50 tx=0x7f3afc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3bf7671aef7baff server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:24.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.395+0000 7f3b02ffd700 1 -- 172.21.15.52:0/733589183 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc00e070 con 0x7f3b040b8fe0 2023-06-23T18:45:24.401 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.395+0000 7f3b02ffd700 1 -- 172.21.15.52:0/733589183 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3afc00b910 con 0x7f3b040b8fe0 2023-06-23T18:45:24.402 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.395+0000 7f3b02ffd700 1 -- 172.21.15.52:0/733589183 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc00bcc0 con 0x7f3b040b8fe0 2023-06-23T18:45:24.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.395+0000 7f3b0a5b2700 1 -- 172.21.15.52:0/733589183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b040b8fe0 msgr2=0x7f3b04154d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:24.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.395+0000 7f3b0a5b2700 1 --2- 172.21.15.52:0/733589183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b040b8fe0 0x7f3b04154d00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3afc009e50 tx=0x7f3afc00b330 comp rx=0 tx=0).stop 2023-06-23T18:45:24.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.395+0000 7f3b0a5b2700 1 -- 172.21.15.52:0/733589183 shutdown_connections 2023-06-23T18:45:24.404 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.395+0000 7f3b0a5b2700 1 --2- 172.21.15.52:0/733589183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b040b8fe0 0x7f3b04154d00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:24.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.395+0000 7f3b0a5b2700 1 --2- 172.21.15.52:0/733589183 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b040b6c60 0x7f3b0406af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:24.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.395+0000 7f3b0a5b2700 1 -- 172.21.15.52:0/733589183 >> 172.21.15.52:0/733589183 conn(0x7f3b040bd690 msgr2=0x7f3b040b9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:24.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.395+0000 7f3b0a5b2700 1 -- 172.21.15.52:0/733589183 shutdown_connections 2023-06-23T18:45:24.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.395+0000 7f3b0a5b2700 1 -- 172.21.15.52:0/733589183 wait complete. 2023-06-23T18:45:24.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.396+0000 7f3b0a5b2700 1 Processor -- start 2023-06-23T18:45:24.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.397+0000 7f3b0a5b2700 1 -- start start 2023-06-23T18:45:24.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.397+0000 7f3b0a5b2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b040b6c60 0x7f3b040bb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:24.405 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.397+0000 7f3b0a5b2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b040b8fe0 0x7f3b04140460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:24.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.397+0000 7f3b0a5b2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b041446e0 0x7f3b04138f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:24.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.397+0000 7f3b0a5b2700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b040bbaf0 con 0x7f3b041446e0 2023-06-23T18:45:24.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.397+0000 7f3b0a5b2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0413e9f0 con 0x7f3b040b8fe0 2023-06-23T18:45:24.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.397+0000 7f3b0a5b2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b041409a0 con 0x7f3b040b6c60 2023-06-23T18:45:24.406 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.397+0000 7f3b08b4f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b041446e0 0x7f3b04138f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:24.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.397+0000 7f3b08b4f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b041446e0 0x7f3b04138f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57052/0 (socket says 172.21.15.52:57052) 2023-06-23T18:45:24.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.397+0000 7f3b08b4f700 1 -- 172.21.15.52:0/480823458 learned_addr learned my addr 172.21.15.52:0/480823458 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:24.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.397+0000 7f3b03fff700 1 --2- 172.21.15.52:0/480823458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b040b6c60 0x7f3b040bb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:24.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.398+0000 7f3b037fe700 1 --2- 172.21.15.52:0/480823458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b040b8fe0 0x7f3b04140460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:24.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.398+0000 7f3b08b4f700 1 -- 172.21.15.52:0/480823458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b040b6c60 msgr2=0x7f3b040bb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:24.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.398+0000 7f3b08b4f700 1 --2- 172.21.15.52:0/480823458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b040b6c60 0x7f3b040bb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:24.407 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.398+0000 7f3b08b4f700 1 -- 172.21.15.52:0/480823458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b040b8fe0 msgr2=0x7f3b04140460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:24.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.398+0000 7f3b08b4f700 1 --2- 172.21.15.52:0/480823458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b040b8fe0 0x7f3b04140460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:24.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.398+0000 7f3b08b4f700 1 -- 172.21.15.52:0/480823458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc009b30 con 0x7f3b041446e0 2023-06-23T18:45:24.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.398+0000 7f3b08b4f700 1 --2- 172.21.15.52:0/480823458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b041446e0 0x7f3b04138f70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3afc012000 tx=0x7f3afc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:24.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.398+0000 7f3b00ff9700 1 -- 172.21.15.52:0/480823458 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc004800 con 0x7f3b041446e0 2023-06-23T18:45:24.408 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.398+0000 7f3b00ff9700 1 -- 172.21.15.52:0/480823458 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3afc004960 con 0x7f3b041446e0 2023-06-23T18:45:24.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.398+0000 7f3b0a5b2700 1 -- 172.21.15.52:0/480823458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0413eee0 con 0x7f3b041446e0 2023-06-23T18:45:24.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.398+0000 7f3b00ff9700 1 -- 172.21.15.52:0/480823458 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc01c680 con 0x7f3b041446e0 2023-06-23T18:45:24.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.398+0000 7f3b0a5b2700 1 -- 172.21.15.52:0/480823458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0413f3e0 con 0x7f3b041446e0 2023-06-23T18:45:24.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.399+0000 7f3b0a5b2700 1 -- 172.21.15.52:0/480823458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0404e1d0 con 0x7f3b041446e0 2023-06-23T18:45:24.409 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.399+0000 7f3b00ff9700 1 -- 172.21.15.52:0/480823458 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3afc01c7e0 con 0x7f3b041446e0 2023-06-23T18:45:24.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.400+0000 7f3b00ff9700 1 --2- 172.21.15.52:0/480823458 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3af006ace0 0x7f3af006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:24.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.400+0000 7f3b00ff9700 1 -- 172.21.15.52:0/480823458 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3afc08ac20 con 0x7f3b041446e0 2023-06-23T18:45:24.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.400+0000 7f3b03fff700 1 --2- 172.21.15.52:0/480823458 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3af006ace0 0x7f3af006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:24.410 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.400+0000 7f3b03fff700 1 --2- 172.21.15.52:0/480823458 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3af006ace0 0x7f3af006d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3af4007fd0 tx=0x7f3af4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:24.411 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.404+0000 7f3b00ff9700 1 -- 172.21.15.52:0/480823458 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3afc055cd0 con 0x7f3b041446e0 2023-06-23T18:45:24.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.644+0000 7f3b0a5b2700 1 -- 172.21.15.52:0/480823458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b040ba1b0 con 0x7f3b041446e0 2023-06-23T18:45:24.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.645+0000 7f3b00ff9700 1 -- 172.21.15.52:0/480823458 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+3906 (secure 0 0 0) 0x7f3afc0592f0 con 0x7f3b041446e0 2023-06-23T18:45:24.650 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:24.650 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/299877491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":299877491},{"type":"v1","addr":"172.21.15.89:6835","nonce":299877491}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/2826461143","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":2826461143},{"type":"v1","addr":"172.21.15.52:6833","nonce":2826461143}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T18:44:50.642376+0000","modified":"2023-06-23T18:44:53.679243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6835/4214822260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4214822260},{"type":"v1","addr":"172.21.15.52:6835","nonce":4214822260}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-23T18:45:24.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.647+0000 7f3b0a5b2700 1 -- 172.21.15.52:0/480823458 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3af006ace0 msgr2=0x7f3af006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:24.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.647+0000 7f3b0a5b2700 1 --2- 172.21.15.52:0/480823458 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3af006ace0 0x7f3af006d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3af4007fd0 tx=0x7f3af4009040 comp rx=0 tx=0).stop 2023-06-23T18:45:24.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.647+0000 7f3b0a5b2700 1 -- 172.21.15.52:0/480823458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b041446e0 msgr2=0x7f3b04138f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:24.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.647+0000 7f3b0a5b2700 1 --2- 172.21.15.52:0/480823458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b041446e0 0x7f3b04138f70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3afc012000 tx=0x7f3afc004ad0 comp rx=0 tx=0).stop 2023-06-23T18:45:24.652 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.647+0000 7f3b0a5b2700 1 -- 172.21.15.52:0/480823458 shutdown_connections 2023-06-23T18:45:24.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.647+0000 7f3b0a5b2700 1 --2- 172.21.15.52:0/480823458 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3af006ace0 0x7f3af006d190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:24.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.647+0000 7f3b0a5b2700 1 --2- 172.21.15.52:0/480823458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b041446e0 0x7f3b04138f70 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:24.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.647+0000 7f3b0a5b2700 1 --2- 172.21.15.52:0/480823458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b040b6c60 0x7f3b040bb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:24.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.647+0000 7f3b0a5b2700 1 --2- 172.21.15.52:0/480823458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b040b8fe0 0x7f3b04140460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:24.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.647+0000 7f3b0a5b2700 1 -- 172.21.15.52:0/480823458 >> 172.21.15.52:0/480823458 conn(0x7f3b040bd690 msgr2=0x7f3b04069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:24.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.647+0000 7f3b0a5b2700 1 -- 172.21.15.52:0/480823458 shutdown_connections 2023-06-23T18:45:24.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.647+0000 7f3b0a5b2700 1 -- 172.21.15.52:0/480823458 wait complete. 2023-06-23T18:45:24.654 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 8 2023-06-23T18:45:24.664 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:45:24.790 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.785+0000 7f289a555700 1 Processor -- start 2023-06-23T18:45:24.791 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.785+0000 7f289a555700 1 -- start start 2023-06-23T18:45:24.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.786+0000 7f289a555700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f289406c1f0 0x7f289414b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:24.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.786+0000 7f289a555700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2894070ed0 con 0x7f28940701e0 2023-06-23T18:45:24.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.786+0000 7f289a555700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f289406fa40 con 0x7f28940b0990 2023-06-23T18:45:24.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.786+0000 7f289a555700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28940b7ec0 con 0x7f289406c1f0 2023-06-23T18:45:24.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.786+0000 7f28937fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f28940701e0 0x7f2894145580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:38008/0 (socket says 172.21.15.52:38008) 2023-06-23T18:45:24.793 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.786+0000 7f28937fe700 1 -- 172.21.15.52:0/3464457896 learned_addr learned my addr 172.21.15.52:0/3464457896 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:24.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.786+0000 7f2893fff700 1 --2- 172.21.15.52:0/3464457896 >> v2:172.21.15.89:3300/0 conn(0x7f289406c1f0 0x7f289414b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:24.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.787+0000 7f2892ffd700 1 -- 172.21.15.52:0/3464457896 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909321906 0 0) 0x7f2894070ed0 con 0x7f28940701e0 2023-06-23T18:45:24.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.787+0000 7f2892ffd700 1 -- 172.21.15.52:0/3464457896 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28800035b0 con 0x7f28940701e0 2023-06-23T18:45:24.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.787+0000 7f2892ffd700 1 -- 172.21.15.52:0/3464457896 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055067715 0 0) 0x7f289406fa40 con 0x7f28940b0990 2023-06-23T18:45:24.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.787+0000 7f2892ffd700 1 -- 172.21.15.52:0/3464457896 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2894070ed0 con 0x7f28940b0990 2023-06-23T18:45:24.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.787+0000 7f2893fff700 1 -- 172.21.15.52:0/3464457896 >> v1:172.21.15.89:6789/0 conn(0x7f28940b0990 legacy=0x7f2894152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:24.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.787+0000 7f2892ffd700 1 -- 172.21.15.52:0/3464457896 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1234387927 0 0) 0x7f28800035b0 con 0x7f28940701e0 2023-06-23T18:45:24.794 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.787+0000 7f2893fff700 1 -- 172.21.15.52:0/3464457896 >> v1:172.21.15.52:6789/0 conn(0x7f28940701e0 legacy=0x7f2894145580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:24.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.787+0000 7f2893fff700 1 -- 172.21.15.52:0/3464457896 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2894069ef0 con 0x7f289406c1f0 2023-06-23T18:45:24.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.787+0000 7f2893fff700 1 --2- 172.21.15.52:0/3464457896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f289406c1f0 0x7f289414b9e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2884009840 tx=0x7f2884009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d7df3f55a418225 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:24.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.787+0000 7f2892ffd700 1 -- 172.21.15.52:0/3464457896 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c001670 con 0x7f289406c1f0 2023-06-23T18:45:24.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.787+0000 7f2892ffd700 1 -- 172.21.15.52:0/3464457896 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2884004030 con 0x7f289406c1f0 2023-06-23T18:45:24.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.787+0000 7f2892ffd700 1 -- 172.21.15.52:0/3464457896 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28840043c0 con 0x7f289406c1f0 2023-06-23T18:45:24.795 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.788+0000 7f289a555700 1 -- 172.21.15.52:0/3464457896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f289406c1f0 msgr2=0x7f289414b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:24.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.788+0000 7f289a555700 1 --2- 172.21.15.52:0/3464457896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f289406c1f0 0x7f289414b9e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2884009840 tx=0x7f2884009b50 comp rx=0 tx=0).stop 2023-06-23T18:45:24.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.788+0000 7f289a555700 1 -- 172.21.15.52:0/3464457896 shutdown_connections 2023-06-23T18:45:24.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.788+0000 7f289a555700 1 --2- 172.21.15.52:0/3464457896 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f289406c1f0 0x7f289414b9e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:24.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.788+0000 7f289a555700 1 -- 172.21.15.52:0/3464457896 >> 172.21.15.52:0/3464457896 conn(0x7f28940bdf30 msgr2=0x7f28940b9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:24.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.788+0000 7f289a555700 1 -- 172.21.15.52:0/3464457896 shutdown_connections 2023-06-23T18:45:24.796 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.788+0000 7f289a555700 1 -- 172.21.15.52:0/3464457896 wait complete. 2023-06-23T18:45:24.798 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.789+0000 7f289a555700 1 Processor -- start 2023-06-23T18:45:24.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.789+0000 7f289a555700 1 -- start start 2023-06-23T18:45:24.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.790+0000 7f289a555700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f289406c1f0 0x7f28940b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:24.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.790+0000 7f289a555700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28940701e0 0x7f28941473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:24.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.790+0000 7f289a555700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28940b0990 0x7f28940af1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:24.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.790+0000 7f289a555700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28940af700 con 0x7f28940b0990 2023-06-23T18:45:24.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.790+0000 7f289a555700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2894146610 con 0x7f289406c1f0 2023-06-23T18:45:24.799 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.790+0000 7f289a555700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28941468f0 con 0x7f28940701e0 2023-06-23T18:45:24.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.790+0000 7f2898af2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28940b0990 0x7f28940af1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:24.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.790+0000 7f2898af2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28940b0990 0x7f28940af1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57064/0 (socket says 172.21.15.52:57064) 2023-06-23T18:45:24.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.790+0000 7f2898af2700 1 -- 172.21.15.52:0/3684621587 learned_addr learned my addr 172.21.15.52:0/3684621587 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:24.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.790+0000 7f2893fff700 1 --2- 172.21.15.52:0/3684621587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f289406c1f0 0x7f28940b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:24.800 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.790+0000 7f28937fe700 1 --2- 172.21.15.52:0/3684621587 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28940701e0 0x7f28941473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:24.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.790+0000 7f2898af2700 1 -- 172.21.15.52:0/3684621587 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28940701e0 msgr2=0x7f28941473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:24.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.790+0000 7f2898af2700 1 --2- 172.21.15.52:0/3684621587 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28940701e0 0x7f28941473d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:24.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.790+0000 7f2898af2700 1 -- 172.21.15.52:0/3684621587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f289406c1f0 msgr2=0x7f28940b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:24.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.790+0000 7f2898af2700 1 --2- 172.21.15.52:0/3684621587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f289406c1f0 0x7f28940b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:24.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.790+0000 7f2898af2700 1 -- 172.21.15.52:0/3684621587 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28840094a0 con 0x7f28940b0990 2023-06-23T18:45:24.801 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.790+0000 7f2898af2700 1 --2- 172.21.15.52:0/3684621587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28940b0990 0x7f28940af1c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f288c00cbc0 tx=0x7f288c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:24.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.790+0000 7f2890ff9700 1 -- 172.21.15.52:0/3684621587 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c003c00 con 0x7f28940b0990 2023-06-23T18:45:24.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.790+0000 7f2890ff9700 1 -- 172.21.15.52:0/3684621587 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288c003d60 con 0x7f28940b0990 2023-06-23T18:45:24.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.790+0000 7f2890ff9700 1 -- 172.21.15.52:0/3684621587 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c00aaa0 con 0x7f28940b0990 2023-06-23T18:45:24.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.790+0000 7f289a555700 1 -- 172.21.15.52:0/3684621587 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2894146bd0 con 0x7f28940b0990 2023-06-23T18:45:24.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.791+0000 7f289a555700 1 -- 172.21.15.52:0/3684621587 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28941492f0 con 0x7f28940b0990 2023-06-23T18:45:24.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.792+0000 7f289a555700 1 -- 172.21.15.52:0/3684621587 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f289404e1d0 con 0x7f28940b0990 2023-06-23T18:45:24.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.792+0000 7f2890ff9700 1 -- 172.21.15.52:0/3684621587 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f288c00ac00 con 0x7f28940b0990 2023-06-23T18:45:24.802 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.792+0000 7f2890ff9700 1 --2- 172.21.15.52:0/3684621587 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f287406ace0 0x7f287406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:24.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.792+0000 7f2890ff9700 1 -- 172.21.15.52:0/3684621587 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f288c0893b0 con 0x7f28940b0990 2023-06-23T18:45:24.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.792+0000 7f2893fff700 1 --2- 172.21.15.52:0/3684621587 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f287406ace0 0x7f287406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:24.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.793+0000 7f2893fff700 1 --2- 172.21.15.52:0/3684621587 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f287406ace0 0x7f287406d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f28840090b0 tx=0x7f2884008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:24.803 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.797+0000 7f2890ff9700 1 -- 172.21.15.52:0/3684621587 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f288c0544f0 con 0x7f28940b0990 2023-06-23T18:45:25.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:24.998+0000 7f289a555700 1 -- 172.21.15.52:0/3684621587 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2894071340 con 0x7f28940b0990 2023-06-23T18:45:25.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.000+0000 7f2890ff9700 1 -- 172.21.15.52:0/3684621587 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+18173 (secure 0 0 0) 0x7f2894071340 con 0x7f28940b0990 2023-06-23T18:45:25.005 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:25.005 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","created":"2023-06-23T18:44:31.918434+0000","modified":"2023-06-23T18:44:51.644330+0000","last_up_change":"2023-06-23T18:44:42.169624+0000","last_in_change":"2023-06-23T18:44:34.510501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-23T18:44:43.346578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-23T18:44:43.829719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:44:48.517897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T18:44:49.621134+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c371fb28-1b15-4e43-8d5a-43e402920ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6812","nonce":1066999520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6815","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6818","nonce":1066999520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6829","nonce":1066999520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6823","nonce":1066999520}]},"public_addr":"172.21.15.52:6812/1066999520","cluster_addr":"172.21.15.52:6818/1066999520","heartbeat_back_addr":"172.21.15.52:6829/1066999520","heartbeat_front_addr":"172.21.15.52:6823/1066999520","state":["exists","up"]},{"osd":1,"uuid":"4a142f04-33eb-47ec-9cc5-b08b44d82658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6813","nonce":2360219751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6819","nonce":2360219751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6830","nonce":2360219751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6825","nonce":2360219751}]},"public_addr":"172.21.15.52:6813/2360219751","cluster_addr":"172.21.15.52:6819/2360219751","heartbeat_back_addr":"172.21.15.52:6830/2360219751","heartbeat_front_addr":"172.21.15.52:6825/2360219751","state":["exists","up"]},{"osd":2,"uuid":"d7bb089d-4c55-4370-ba59-7fe88c39512a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6801","nonce":835073005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6803","nonce":835073005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6807","nonce":835073005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6805","nonce":835073005}]},"public_addr":"172.21.15.52:6801/835073005","cluster_addr":"172.21.15.52:6803/835073005","heartbeat_back_addr":"172.21.15.52:6807/835073005","heartbeat_front_addr":"172.21.15.52:6805/835073005","state":["exists","up"]},{"osd":3,"uuid":"4bcdcdc3-6a8f-468e-877e-57f76079ac3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6811","nonce":2852700864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6817","nonce":2852700864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6831","nonce":2852700864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6824","nonce":2852700864}]},"public_addr":"172.21.15.52:6811/2852700864","cluster_addr":"172.21.15.52:6817/2852700864","heartbeat_back_addr":"172.21.15.52:6831/2852700864","heartbeat_front_addr":"172.21.15.52:6824/2852700864","state":["exists","up"]},{"osd":4,"uuid":"cac63000-ae94-4b08-93e6-a99119640b63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6809","nonce":2538664679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6811","nonce":2538664679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6815","nonce":2538664679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6813","nonce":2538664679}]},"public_addr":"172.21.15.89:6809/2538664679","cluster_addr":"172.21.15.89:6811/2538664679","heartbeat_back_addr":"172.21.15.89:6815/2538664679","heartbeat_front_addr":"172.21.15.89:6813/2538664679","state":["exists","up"]},{"osd":5,"uuid":"45c53102-18a6-4fd7-9c25-8ea5e1ef6851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6801","nonce":1683710352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6803","nonce":1683710352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6807","nonce":1683710352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6805","nonce":1683710352}]},"public_addr":"172.21.15.89:6801/1683710352","cluster_addr":"172.21.15.89:6803/1683710352","heartbeat_back_addr":"172.21.15.89:6807/1683710352","heartbeat_front_addr":"172.21.15.89:6805/1683710352","state":["exists","up"]},{"osd":6,"uuid":"abee09d1-8eba-484f-a25c-871c1fe2e843","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6817","nonce":3890899288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6819","nonce":3890899288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6823","nonce":3890899288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6821","nonce":3890899288}]},"public_addr":"172.21.15.89:6817/3890899288","cluster_addr":"172.21.15.89:6819/3890899288","heartbeat_back_addr":"172.21.15.89:6823/3890899288","heartbeat_front_addr":"172.21.15.89:6821/3890899288","state":["exists","up"]},{"osd":7,"uuid":"5acf9e2e-00dd-4f9b-a7d9-3d820f695de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6825","nonce":2989085420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6827","nonce":2989085420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6831","nonce":2989085420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6829","nonce":2989085420}]},"public_addr":"172.21.15.89:6825/2989085420","cluster_addr":"172.21.15.89:6827/2989085420","heartbeat_back_addr":"172.21.15.89:6831/2989085420","heartbeat_front_addr":"172.21.15.89:6829/2989085420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.663866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.710904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.619347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.660102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.686933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.724635+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.669111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.678740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:45:25.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.002+0000 7f289a555700 1 -- 172.21.15.52:0/3684621587 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f287406ace0 msgr2=0x7f287406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:25.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.002+0000 7f289a555700 1 --2- 172.21.15.52:0/3684621587 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f287406ace0 0x7f287406d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f28840090b0 tx=0x7f2884008030 comp rx=0 tx=0).stop 2023-06-23T18:45:25.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.002+0000 7f289a555700 1 -- 172.21.15.52:0/3684621587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28940b0990 msgr2=0x7f28940af1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:25.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.002+0000 7f289a555700 1 --2- 172.21.15.52:0/3684621587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28940b0990 0x7f28940af1c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f288c00cbc0 tx=0x7f288c00ced0 comp rx=0 tx=0).stop 2023-06-23T18:45:25.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.002+0000 7f289a555700 1 -- 172.21.15.52:0/3684621587 shutdown_connections 2023-06-23T18:45:25.007 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.002+0000 7f289a555700 1 --2- 172.21.15.52:0/3684621587 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f287406ace0 0x7f287406d190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:25.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.002+0000 7f289a555700 1 --2- 172.21.15.52:0/3684621587 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f28940b0990 0x7f28940af1c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:25.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.002+0000 7f289a555700 1 --2- 172.21.15.52:0/3684621587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f289406c1f0 0x7f28940b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:25.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.002+0000 7f289a555700 1 --2- 172.21.15.52:0/3684621587 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f28940701e0 0x7f28941473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:25.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.002+0000 7f289a555700 1 -- 172.21.15.52:0/3684621587 >> 172.21.15.52:0/3684621587 conn(0x7f28940bdf30 msgr2=0x7f289414a050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:25.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.002+0000 7f289a555700 1 -- 172.21.15.52:0/3684621587 shutdown_connections 2023-06-23T18:45:25.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.002+0000 7f289a555700 1 -- 172.21.15.52:0/3684621587 wait complete. 2023-06-23T18:45:25.019 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-23T18:45:25.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.141+0000 7f51faa64700 1 Processor -- start 2023-06-23T18:45:25.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.141+0000 7f51faa64700 1 -- start start 2023-06-23T18:45:25.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.142+0000 7f51faa64700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51f41426a0 0x7f51f4071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:25.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.142+0000 7f51faa64700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f51f40b8c70 0x7f51f4148480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:25.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.142+0000 7f51faa64700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f40b53b0 con 0x7f51f41489c0 2023-06-23T18:45:25.149 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.142+0000 7f51faa64700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f40b4750 con 0x7f51f40b8c70 2023-06-23T18:45:25.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.142+0000 7f51faa64700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f4142a70 con 0x7f51f41426a0 2023-06-23T18:45:25.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.142+0000 7f51f3fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f51f40b8c70 0x7f51f4148480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:25.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.142+0000 7f51f3fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f51f40b8c70 0x7f51f4148480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57080/0 (socket says 172.21.15.52:57080) 2023-06-23T18:45:25.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.142+0000 7f51f3fff700 1 -- 172.21.15.52:0/4130097604 learned_addr learned my addr 172.21.15.52:0/4130097604 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:25.150 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.142+0000 7f51f8800700 1 --2- 172.21.15.52:0/4130097604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51f41426a0 0x7f51f4071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:25.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.142+0000 7f51f3fff700 1 -- 172.21.15.52:0/4130097604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51f41426a0 msgr2=0x7f51f4071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:25.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.142+0000 7f51f3fff700 1 --2- 172.21.15.52:0/4130097604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51f41426a0 0x7f51f4071be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:25.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.142+0000 7f51f3fff700 1 -- 172.21.15.52:0/4130097604 >> v1:172.21.15.89:6789/0 conn(0x7f51f41489c0 legacy=0x7f51f414b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:25.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.142+0000 7f51f3fff700 1 -- 172.21.15.52:0/4130097604 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f40b9c30 con 0x7f51f40b8c70 2023-06-23T18:45:25.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.142+0000 7f51f3fff700 1 --2- 172.21.15.52:0/4130097604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f40b8c70 0x7f51f4148480 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f51e00098f0 tx=0x7f51e0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7a1c1015a9f6ce server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:25.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.143+0000 7f51f37fe700 1 -- 172.21.15.52:0/4130097604 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e0004230 con 0x7f51f40b8c70 2023-06-23T18:45:25.151 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.143+0000 7f51f37fe700 1 -- 172.21.15.52:0/4130097604 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e0004390 con 0x7f51f40b8c70 2023-06-23T18:45:25.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.143+0000 7f51f37fe700 1 -- 172.21.15.52:0/4130097604 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e00036a0 con 0x7f51f40b8c70 2023-06-23T18:45:25.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.143+0000 7f51faa64700 1 -- 172.21.15.52:0/4130097604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f40b8c70 msgr2=0x7f51f4148480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:25.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.143+0000 7f51faa64700 1 --2- 172.21.15.52:0/4130097604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f40b8c70 0x7f51f4148480 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f51e00098f0 tx=0x7f51e0009c00 comp rx=0 tx=0).stop 2023-06-23T18:45:25.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.143+0000 7f51faa64700 1 -- 172.21.15.52:0/4130097604 shutdown_connections 2023-06-23T18:45:25.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.143+0000 7f51faa64700 1 --2- 172.21.15.52:0/4130097604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51f41426a0 0x7f51f4071be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:25.152 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.143+0000 7f51faa64700 1 --2- 172.21.15.52:0/4130097604 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f40b8c70 0x7f51f4148480 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:25.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.143+0000 7f51faa64700 1 -- 172.21.15.52:0/4130097604 >> 172.21.15.52:0/4130097604 conn(0x7f51f40bd690 msgr2=0x7f51f40b9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:25.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.143+0000 7f51faa64700 1 -- 172.21.15.52:0/4130097604 shutdown_connections 2023-06-23T18:45:25.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.143+0000 7f51faa64700 1 -- 172.21.15.52:0/4130097604 wait complete. 2023-06-23T18:45:25.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.144+0000 7f51faa64700 1 Processor -- start 2023-06-23T18:45:25.153 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.144+0000 7f51faa64700 1 -- start start 2023-06-23T18:45:25.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.145+0000 7f51faa64700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f40b8c70 0x7f51f41d50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:25.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.145+0000 7f51faa64700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51f41426a0 0x7f51f413b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:25.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.145+0000 7f51faa64700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51f41489c0 0x7f51f41e1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:25.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.145+0000 7f51faa64700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f41d55e0 con 0x7f51f40b8c70 2023-06-23T18:45:25.155 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.145+0000 7f51faa64700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f41d3910 con 0x7f51f41426a0 2023-06-23T18:45:25.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.145+0000 7f51faa64700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f413aaa0 con 0x7f51f41489c0 2023-06-23T18:45:25.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.145+0000 7f51f8800700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f40b8c70 0x7f51f41d50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:25.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.145+0000 7f51f8800700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f40b8c70 0x7f51f41d50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:57082/0 (socket says 172.21.15.52:57082) 2023-06-23T18:45:25.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.145+0000 7f51f8800700 1 -- 172.21.15.52:0/1503433735 learned_addr learned my addr 172.21.15.52:0/1503433735 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:25.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.146+0000 7f51f9001700 1 --2- 172.21.15.52:0/1503433735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51f41489c0 0x7f51f41e1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:25.156 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.146+0000 7f51f8800700 1 -- 172.21.15.52:0/1503433735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51f41489c0 msgr2=0x7f51f41e1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:25.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.146+0000 7f51f3fff700 1 --2- 172.21.15.52:0/1503433735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51f41426a0 0x7f51f413b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:25.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.146+0000 7f51f8800700 1 --2- 172.21.15.52:0/1503433735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51f41489c0 0x7f51f41e1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:25.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.146+0000 7f51f8800700 1 -- 172.21.15.52:0/1503433735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51f41426a0 msgr2=0x7f51f413b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:25.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.146+0000 7f51f8800700 1 --2- 172.21.15.52:0/1503433735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51f41426a0 0x7f51f413b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:25.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.146+0000 7f51f8800700 1 -- 172.21.15.52:0/1503433735 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e0009550 con 0x7f51f40b8c70 2023-06-23T18:45:25.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.146+0000 7f51f8800700 1 --2- 172.21.15.52:0/1503433735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f40b8c70 0x7f51f41d50a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f51e800e810 tx=0x7f51e800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:25.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.146+0000 7f51f17fa700 1 -- 172.21.15.52:0/1503433735 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8013610 con 0x7f51f40b8c70 2023-06-23T18:45:25.157 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.146+0000 7f51f17fa700 1 -- 172.21.15.52:0/1503433735 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e8013770 con 0x7f51f40b8c70 2023-06-23T18:45:25.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.146+0000 7f51faa64700 1 -- 172.21.15.52:0/1503433735 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f4149720 con 0x7f51f40b8c70 2023-06-23T18:45:25.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.146+0000 7f51f17fa700 1 -- 172.21.15.52:0/1503433735 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8013b20 con 0x7f51f40b8c70 2023-06-23T18:45:25.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.146+0000 7f51faa64700 1 -- 172.21.15.52:0/1503433735 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f413a450 con 0x7f51f40b8c70 2023-06-23T18:45:25.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.147+0000 7f51faa64700 1 -- 172.21.15.52:0/1503433735 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f404e1d0 con 0x7f51f40b8c70 2023-06-23T18:45:25.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.147+0000 7f51f17fa700 1 -- 172.21.15.52:0/1503433735 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f51e8013c80 con 0x7f51f40b8c70 2023-06-23T18:45:25.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.148+0000 7f51f17fa700 1 --2- 172.21.15.52:0/1503433735 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f51d806ad10 0x7f51d806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:25.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.148+0000 7f51f17fa700 1 -- 172.21.15.52:0/1503433735 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f51e8089210 con 0x7f51f40b8c70 2023-06-23T18:45:25.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.148+0000 7f51f3fff700 1 --2- 172.21.15.52:0/1503433735 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f51d806ad10 0x7f51d806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:25.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.149+0000 7f51f3fff700 1 --2- 172.21.15.52:0/1503433735 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f51d806ad10 0x7f51d806d1c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f51f41d4130 tx=0x7f51e0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:25.159 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.152+0000 7f51f17fa700 1 -- 172.21.15.52:0/1503433735 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f51e80542d0 con 0x7f51f40b8c70 2023-06-23T18:45:25.397 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.392+0000 7f51faa64700 1 -- 172.21.15.52:0/1503433735 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f51f406b520 con 0x7f51f40b8c70 2023-06-23T18:45:25.876 INFO:tasks.ceph.mon.a.smithi052.stderr:2023-06-23T18:45:25.871+0000 7f03771e5700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-23T18:45:25.884 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.880+0000 7f51f17fa700 1 -- 172.21.15.52:0/1503433735 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f51e80578f0 con 0x7f51f40b8c70 2023-06-23T18:45:25.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.884+0000 7f51faa64700 1 -- 172.21.15.52:0/1503433735 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f51d806ad10 msgr2=0x7f51d806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:25.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.884+0000 7f51faa64700 1 --2- 172.21.15.52:0/1503433735 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f51d806ad10 0x7f51d806d1c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f51f41d4130 tx=0x7f51e0008030 comp rx=0 tx=0).stop 2023-06-23T18:45:25.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.884+0000 7f51faa64700 1 -- 172.21.15.52:0/1503433735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f40b8c70 msgr2=0x7f51f41d50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:25.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.884+0000 7f51faa64700 1 --2- 172.21.15.52:0/1503433735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f40b8c70 0x7f51f41d50a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f51e800e810 tx=0x7f51e800ebd0 comp rx=0 tx=0).stop 2023-06-23T18:45:25.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.884+0000 7f51faa64700 1 -- 172.21.15.52:0/1503433735 shutdown_connections 2023-06-23T18:45:25.889 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.884+0000 7f51faa64700 1 --2- 172.21.15.52:0/1503433735 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f51d806ad10 0x7f51d806d1c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:25.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.884+0000 7f51faa64700 1 --2- 172.21.15.52:0/1503433735 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f51f41489c0 0x7f51f41e1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:25.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.884+0000 7f51faa64700 1 --2- 172.21.15.52:0/1503433735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f51f40b8c70 0x7f51f41d50a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:25.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.884+0000 7f51faa64700 1 --2- 172.21.15.52:0/1503433735 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f51f41426a0 0x7f51f413b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:25.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.884+0000 7f51faa64700 1 -- 172.21.15.52:0/1503433735 >> 172.21.15.52:0/1503433735 conn(0x7f51f40bd690 msgr2=0x7f51f41d4720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:25.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.884+0000 7f51faa64700 1 -- 172.21.15.52:0/1503433735 shutdown_connections 2023-06-23T18:45:25.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:25.884+0000 7f51faa64700 1 -- 172.21.15.52:0/1503433735 wait complete. 2023-06-23T18:45:25.891 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-23T18:45:25.891 INFO:tasks.ceph.mds.c.smithi052.stderr: -9675> 2023-06-23T18:44:55.326+0000 7fdbf03c6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-23T18:45:25.906 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-23T18:45:25.932 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2023-06-23T18:45:26.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.035+0000 7f56b52db700 1 Processor -- start 2023-06-23T18:45:26.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.035+0000 7f56b52db700 1 -- start start 2023-06-23T18:45:26.041 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.036+0000 7f56b52db700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f56b00bb900 0x7f56b0155e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:26.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.036+0000 7f56b52db700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b00be040 con 0x7f56b014a600 2023-06-23T18:45:26.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.036+0000 7f56b52db700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b014aae0 con 0x7f56b00b6870 2023-06-23T18:45:26.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.036+0000 7f56b52db700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b014adc0 con 0x7f56b00bb900 2023-06-23T18:45:26.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.036+0000 7f56af7fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f56b00bb900 0x7f56b0155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:26.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.036+0000 7f56ae7fc700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f56b014a600 0x7f56b00bb1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54358/0 (socket says 172.21.15.52:54358) 2023-06-23T18:45:26.042 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.036+0000 7f56ae7fc700 1 -- 172.21.15.52:0/3596850268 learned_addr learned my addr 172.21.15.52:0/3596850268 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:26.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.036+0000 7f56adffb700 1 -- 172.21.15.52:0/3596850268 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3208732974 0 0) 0x7f56b00be040 con 0x7f56b014a600 2023-06-23T18:45:26.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.036+0000 7f56adffb700 1 -- 172.21.15.52:0/3596850268 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56980035b0 con 0x7f56b014a600 2023-06-23T18:45:26.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.036+0000 7f56af7fe700 1 -- 172.21.15.52:0/3596850268 >> v1:172.21.15.89:6789/0 conn(0x7f56b00b6870 legacy=0x7f56b0144480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:26.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.036+0000 7f56adffb700 1 -- 172.21.15.52:0/3596850268 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023653817 0 0) 0x7f56b014aae0 con 0x7f56b00b6870 2023-06-23T18:45:26.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.036+0000 7f56af7fe700 1 -- 172.21.15.52:0/3596850268 >> v1:172.21.15.52:6789/0 conn(0x7f56b014a600 legacy=0x7f56b00bb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:26.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.036+0000 7f56af7fe700 1 -- 172.21.15.52:0/3596850268 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b014b0a0 con 0x7f56b00bb900 2023-06-23T18:45:26.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.036+0000 7f56af7fe700 1 --2- 172.21.15.52:0/3596850268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56b00bb900 0x7f56b0155e40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f56a8009d90 tx=0x7f56a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf76f034d54ff39e server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:26.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.036+0000 7f56adffb700 1 -- 172.21.15.52:0/3596850268 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a800e070 con 0x7f56b00bb900 2023-06-23T18:45:26.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.036+0000 7f56adffb700 1 -- 172.21.15.52:0/3596850268 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a800bb20 con 0x7f56b00bb900 2023-06-23T18:45:26.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.036+0000 7f56adffb700 1 -- 172.21.15.52:0/3596850268 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a800bed0 con 0x7f56b00bb900 2023-06-23T18:45:26.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.037+0000 7f56b52db700 1 -- 172.21.15.52:0/3596850268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56b00bb900 msgr2=0x7f56b0155e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:26.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.037+0000 7f56b52db700 1 --2- 172.21.15.52:0/3596850268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56b00bb900 0x7f56b0155e40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f56a8009d90 tx=0x7f56a800b330 comp rx=0 tx=0).stop 2023-06-23T18:45:26.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.037+0000 7f56b52db700 1 -- 172.21.15.52:0/3596850268 shutdown_connections 2023-06-23T18:45:26.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.037+0000 7f56b52db700 1 --2- 172.21.15.52:0/3596850268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56b00bb900 0x7f56b0155e40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:26.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.037+0000 7f56b52db700 1 -- 172.21.15.52:0/3596850268 >> 172.21.15.52:0/3596850268 conn(0x7f56b00bd140 msgr2=0x7f56b00bd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:26.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.037+0000 7f56b52db700 1 -- 172.21.15.52:0/3596850268 shutdown_connections 2023-06-23T18:45:26.045 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.037+0000 7f56b52db700 1 -- 172.21.15.52:0/3596850268 wait complete. 2023-06-23T18:45:26.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.038+0000 7f56b52db700 1 Processor -- start 2023-06-23T18:45:26.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.038+0000 7f56b52db700 1 -- start start 2023-06-23T18:45:26.047 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.039+0000 7f56b52db700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56b00b6870 0x7f56b013e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:26.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.039+0000 7f56b52db700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56b00bb900 0x7f56b013b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:26.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.039+0000 7f56b52db700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56b014a600 0x7f56b013cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:26.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.039+0000 7f56b52db700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b01397d0 con 0x7f56b00b6870 2023-06-23T18:45:26.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.039+0000 7f56b52db700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b01478e0 con 0x7f56b014a600 2023-06-23T18:45:26.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.039+0000 7f56b52db700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b013e5b0 con 0x7f56b00bb900 2023-06-23T18:45:26.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.039+0000 7f56aeffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56b00b6870 0x7f56b013e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:26.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.039+0000 7f56aeffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56b00b6870 0x7f56b013e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46154/0 (socket says 172.21.15.52:46154) 2023-06-23T18:45:26.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.039+0000 7f56aeffd700 1 -- 172.21.15.52:0/3376204533 learned_addr learned my addr 172.21.15.52:0/3376204533 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:26.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.039+0000 7f56af7fe700 1 --2- 172.21.15.52:0/3376204533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56b014a600 0x7f56b013cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:26.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.039+0000 7f56ae7fc700 1 --2- 172.21.15.52:0/3376204533 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56b00bb900 0x7f56b013b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:26.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.039+0000 7f56aeffd700 1 -- 172.21.15.52:0/3376204533 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56b00bb900 msgr2=0x7f56b013b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:26.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.039+0000 7f56aeffd700 1 --2- 172.21.15.52:0/3376204533 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56b00bb900 0x7f56b013b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:26.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.039+0000 7f56aeffd700 1 -- 172.21.15.52:0/3376204533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56b014a600 msgr2=0x7f56b013cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:26.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.039+0000 7f56aeffd700 1 --2- 172.21.15.52:0/3376204533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56b014a600 0x7f56b013cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:26.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.039+0000 7f56aeffd700 1 -- 172.21.15.52:0/3376204533 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a8009a70 con 0x7f56b00b6870 2023-06-23T18:45:26.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.039+0000 7f56ae7fc700 1 --2- 172.21.15.52:0/3376204533 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56b00bb900 0x7f56b013b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:26.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.039+0000 7f56aeffd700 1 --2- 172.21.15.52:0/3376204533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56b00b6870 0x7f56b013e070 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f56a00011e0 tx=0x7f56a000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:26.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.040+0000 7f56977fe700 1 -- 172.21.15.52:0/3376204533 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a00054e0 con 0x7f56b00b6870 2023-06-23T18:45:26.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.040+0000 7f56977fe700 1 -- 172.21.15.52:0/3376204533 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a0003680 con 0x7f56b00b6870 2023-06-23T18:45:26.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.040+0000 7f56977fe700 1 -- 172.21.15.52:0/3376204533 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a0003a30 con 0x7f56b00b6870 2023-06-23T18:45:26.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.040+0000 7f56b52db700 1 -- 172.21.15.52:0/3376204533 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b01dfea0 con 0x7f56b00b6870 2023-06-23T18:45:26.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.040+0000 7f56b52db700 1 -- 172.21.15.52:0/3376204533 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b01e0460 con 0x7f56b00b6870 2023-06-23T18:45:26.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.041+0000 7f56b52db700 1 -- 172.21.15.52:0/3376204533 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b01dfd00 con 0x7f56b00b6870 2023-06-23T18:45:26.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.041+0000 7f56977fe700 1 -- 172.21.15.52:0/3376204533 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f56a0003b90 con 0x7f56b00b6870 2023-06-23T18:45:26.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.042+0000 7f56977fe700 1 --2- 172.21.15.52:0/3376204533 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f569c06ace0 0x7f569c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:26.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.042+0000 7f56977fe700 1 -- 172.21.15.52:0/3376204533 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f56a0088940 con 0x7f56b00b6870 2023-06-23T18:45:26.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.042+0000 7f56ae7fc700 1 --2- 172.21.15.52:0/3376204533 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f569c06ace0 0x7f569c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:26.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.042+0000 7f56ae7fc700 1 --2- 172.21.15.52:0/3376204533 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f569c06ace0 0x7f569c06d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f56b013ae40 tx=0x7f56a4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:26.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.046+0000 7f56977fe700 1 -- 172.21.15.52:0/3376204533 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f56b01dfd00 con 0x7f56b00b6870 2023-06-23T18:45:26.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.290+0000 7f56b52db700 1 -- 172.21.15.52:0/3376204533 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f56b01dfd00 con 0x7f56b00b6870 2023-06-23T18:45:26.886 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.882+0000 7f56977fe700 1 -- 172.21.15.52:0/3376204533 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f56b01dfd00 con 0x7f56b00b6870 2023-06-23T18:45:26.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.885+0000 7f56b52db700 1 -- 172.21.15.52:0/3376204533 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f569c06ace0 msgr2=0x7f569c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:26.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.885+0000 7f56b52db700 1 --2- 172.21.15.52:0/3376204533 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f569c06ace0 0x7f569c06d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f56b013ae40 tx=0x7f56a4009040 comp rx=0 tx=0).stop 2023-06-23T18:45:26.890 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.885+0000 7f56b52db700 1 -- 172.21.15.52:0/3376204533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56b00b6870 msgr2=0x7f56b013e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:26.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.885+0000 7f56b52db700 1 --2- 172.21.15.52:0/3376204533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56b00b6870 0x7f56b013e070 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f56a00011e0 tx=0x7f56a000ca30 comp rx=0 tx=0).stop 2023-06-23T18:45:26.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.885+0000 7f56b52db700 1 -- 172.21.15.52:0/3376204533 shutdown_connections 2023-06-23T18:45:26.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.885+0000 7f56b52db700 1 --2- 172.21.15.52:0/3376204533 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f569c06ace0 0x7f569c06d190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:26.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.885+0000 7f56b52db700 1 --2- 172.21.15.52:0/3376204533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56b014a600 0x7f56b013cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:26.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.885+0000 7f56b52db700 1 --2- 172.21.15.52:0/3376204533 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56b00b6870 0x7f56b013e070 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:26.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.885+0000 7f56b52db700 1 --2- 172.21.15.52:0/3376204533 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56b00bb900 0x7f56b013b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:26.891 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.885+0000 7f56b52db700 1 -- 172.21.15.52:0/3376204533 >> 172.21.15.52:0/3376204533 conn(0x7f56b00bd140 msgr2=0x7f56b00bc890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:26.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.885+0000 7f56b52db700 1 -- 172.21.15.52:0/3376204533 shutdown_connections 2023-06-23T18:45:26.892 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:26.885+0000 7f56b52db700 1 -- 172.21.15.52:0/3376204533 wait complete. 2023-06-23T18:45:26.905 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-23T18:45:27.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.078+0000 7f7ca94b2700 1 Processor -- start 2023-06-23T18:45:27.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.078+0000 7f7ca94b2700 1 -- start start 2023-06-23T18:45:27.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.078+0000 7f7ca94b2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca40bb040 0x7f7ca40bb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:27.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.078+0000 7f7ca94b2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca414b140 con 0x7f7ca41444a0 2023-06-23T18:45:27.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.078+0000 7f7ca94b2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca40b8280 con 0x7f7ca40b69d0 2023-06-23T18:45:27.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.078+0000 7f7ca94b2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca414a620 con 0x7f7ca40bb040 2023-06-23T18:45:27.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.079+0000 7f7ca37fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7ca41444a0 0x7f7ca4154ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54360/0 (socket says 172.21.15.52:54360) 2023-06-23T18:45:27.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.079+0000 7f7ca37fe700 1 -- 172.21.15.52:0/1630604449 learned_addr learned my addr 172.21.15.52:0/1630604449 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:27.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.079+0000 7f7ca27fc700 1 --2- 172.21.15.52:0/1630604449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca40bb040 0x7f7ca40bb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:27.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.079+0000 7f7ca1ffb700 1 -- 172.21.15.52:0/1630604449 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2821964919 0 0) 0x7f7ca414b140 con 0x7f7ca41444a0 2023-06-23T18:45:27.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.079+0000 7f7ca1ffb700 1 -- 172.21.15.52:0/1630604449 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c8c0035b0 con 0x7f7ca41444a0 2023-06-23T18:45:27.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.079+0000 7f7ca1ffb700 1 -- 172.21.15.52:0/1630604449 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 286547709 0 0) 0x7f7ca40b8280 con 0x7f7ca40b69d0 2023-06-23T18:45:27.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.079+0000 7f7ca1ffb700 1 -- 172.21.15.52:0/1630604449 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ca414b140 con 0x7f7ca40b69d0 2023-06-23T18:45:27.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.079+0000 7f7ca1ffb700 1 -- 172.21.15.52:0/1630604449 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 314894048 0 0) 0x7f7c8c0035b0 con 0x7f7ca41444a0 2023-06-23T18:45:27.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.079+0000 7f7ca1ffb700 1 -- 172.21.15.52:0/1630604449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca40bb040 msgr2=0x7f7ca40bb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:27.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.079+0000 7f7ca1ffb700 1 --2- 172.21.15.52:0/1630604449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca40bb040 0x7f7ca40bb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:27.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.079+0000 7f7ca1ffb700 1 -- 172.21.15.52:0/1630604449 >> v1:172.21.15.89:6789/0 conn(0x7f7ca40b69d0 legacy=0x7f7ca40b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:27.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.079+0000 7f7ca1ffb700 1 -- 172.21.15.52:0/1630604449 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca414a810 con 0x7f7ca41444a0 2023-06-23T18:45:27.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.079+0000 7f7ca1ffb700 1 -- 172.21.15.52:0/1630604449 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7f7c9c0019f0 con 0x7f7ca41444a0 2023-06-23T18:45:27.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.079+0000 7f7ca27fc700 1 --2- 172.21.15.52:0/1630604449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca40bb040 0x7f7ca40bb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:45:27.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.079+0000 7f7ca1ffb700 1 -- 172.21.15.52:0/1630604449 >> v1:172.21.15.52:6789/0 conn(0x7f7ca41444a0 legacy=0x7f7ca4154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:27.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.079+0000 7f7ca1ffb700 1 --2- 172.21.15.52:0/1630604449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c8c003bc0 0x7f7c8c003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:27.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.079+0000 7f7ca1ffb700 1 --2- 172.21.15.52:0/1630604449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c8c004850 0x7f7c8c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:27.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.079+0000 7f7ca1ffb700 1 --2- 172.21.15.52:0/1630604449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca40bb040 0x7f7c8c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:27.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.079+0000 7f7ca1ffb700 1 -- 172.21.15.52:0/1630604449 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c00bb30 con 0x7f7c8c003bc0 2023-06-23T18:45:27.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.079+0000 7f7ca1ffb700 1 -- 172.21.15.52:0/1630604449 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c00bca0 con 0x7f7c8c004850 2023-06-23T18:45:27.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.079+0000 7f7ca1ffb700 1 -- 172.21.15.52:0/1630604449 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8c00be60 con 0x7f7ca40bb040 2023-06-23T18:45:27.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.079+0000 7f7ca2ffd700 1 --2- 172.21.15.52:0/1630604449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c8c003bc0 0x7f7c8c003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:27.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.079+0000 7f7ca27fc700 1 --2- 172.21.15.52:0/1630604449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c8c004850 0x7f7c8c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:27.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.079+0000 7f7ca37fe700 1 --2- 172.21.15.52:0/1630604449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca40bb040 0x7f7c8c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:27.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.080+0000 7f7ca2ffd700 1 -- 172.21.15.52:0/1630604449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca40bb040 msgr2=0x7f7c8c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:27.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.080+0000 7f7ca2ffd700 1 --2- 172.21.15.52:0/1630604449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca40bb040 0x7f7c8c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:27.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.080+0000 7f7ca2ffd700 1 -- 172.21.15.52:0/1630604449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c8c004850 msgr2=0x7f7c8c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:27.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.080+0000 7f7ca2ffd700 1 --2- 172.21.15.52:0/1630604449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c8c004850 0x7f7c8c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:27.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.080+0000 7f7ca2ffd700 1 -- 172.21.15.52:0/1630604449 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c940094a0 con 0x7f7c8c003bc0 2023-06-23T18:45:27.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.080+0000 7f7ca2ffd700 1 --2- 172.21.15.52:0/1630604449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c8c003bc0 0x7f7c8c003fb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7c98001940 tx=0x7f7c8c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69542a5884013b5e server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:27.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.080+0000 7f7ca1ffb700 1 -- 172.21.15.52:0/1630604449 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c98001430 con 0x7f7c8c003bc0 2023-06-23T18:45:27.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.080+0000 7f7ca1ffb700 1 -- 172.21.15.52:0/1630604449 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c98001d70 con 0x7f7c8c003bc0 2023-06-23T18:45:27.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.080+0000 7f7ca1ffb700 1 -- 172.21.15.52:0/1630604449 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c98005510 con 0x7f7c8c003bc0 2023-06-23T18:45:27.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.080+0000 7f7ca94b2700 1 -- 172.21.15.52:0/1630604449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c8c003bc0 msgr2=0x7f7c8c003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:27.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.080+0000 7f7ca94b2700 1 --2- 172.21.15.52:0/1630604449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c8c003bc0 0x7f7c8c003fb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7c98001940 tx=0x7f7c8c005880 comp rx=0 tx=0).stop 2023-06-23T18:45:27.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.080+0000 7f7ca37fe700 1 -- 172.21.15.52:0/1630604449 reap_dead start 2023-06-23T18:45:27.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.081+0000 7f7ca94b2700 1 -- 172.21.15.52:0/1630604449 shutdown_connections 2023-06-23T18:45:27.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.081+0000 7f7ca94b2700 1 -- 172.21.15.52:0/1630604449 >> 172.21.15.52:0/1630604449 conn(0x7f7ca40bd140 msgr2=0x7f7ca40bd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:27.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.081+0000 7f7ca94b2700 1 -- 172.21.15.52:0/1630604449 shutdown_connections 2023-06-23T18:45:27.091 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.081+0000 7f7ca94b2700 1 -- 172.21.15.52:0/1630604449 wait complete. 2023-06-23T18:45:27.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.082+0000 7f7ca94b2700 1 Processor -- start 2023-06-23T18:45:27.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.082+0000 7f7ca94b2700 1 -- start start 2023-06-23T18:45:27.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.083+0000 7f7ca94b2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c8c003bc0 0x7f7ca41491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:27.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.083+0000 7f7ca94b2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ca41d5060 0x7f7ca41e30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:27.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.083+0000 7f7ca94b2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca41d54d0 0x7f7ca41e35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:27.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.083+0000 7f7ca94b2700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca41496f0 con 0x7f7c8c003bc0 2023-06-23T18:45:27.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.083+0000 7f7ca94b2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca4138730 con 0x7f7ca41d5060 2023-06-23T18:45:27.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.083+0000 7f7ca94b2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca41d4b80 con 0x7f7ca41d54d0 2023-06-23T18:45:27.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.083+0000 7f7ca2ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c8c003bc0 0x7f7ca41491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:27.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.083+0000 7f7ca2ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c8c003bc0 0x7f7ca41491b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46174/0 (socket says 172.21.15.52:46174) 2023-06-23T18:45:27.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.083+0000 7f7ca2ffd700 1 -- 172.21.15.52:0/3180047731 learned_addr learned my addr 172.21.15.52:0/3180047731 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:27.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.083+0000 7f7ca27fc700 1 --2- 172.21.15.52:0/3180047731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ca41d5060 0x7f7ca41e30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:27.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.083+0000 7f7ca37fe700 1 --2- 172.21.15.52:0/3180047731 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca41d54d0 0x7f7ca41e35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:27.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.083+0000 7f7ca2ffd700 1 -- 172.21.15.52:0/3180047731 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca41d54d0 msgr2=0x7f7ca41e35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:27.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.083+0000 7f7ca2ffd700 1 --2- 172.21.15.52:0/3180047731 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca41d54d0 0x7f7ca41e35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:27.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.083+0000 7f7ca2ffd700 1 -- 172.21.15.52:0/3180047731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ca41d5060 msgr2=0x7f7ca41e30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:27.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.083+0000 7f7ca2ffd700 1 --2- 172.21.15.52:0/3180047731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ca41d5060 0x7f7ca41e30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:27.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.083+0000 7f7ca2ffd700 1 -- 172.21.15.52:0/3180047731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca41389d0 con 0x7f7c8c003bc0 2023-06-23T18:45:27.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.084+0000 7f7ca2ffd700 1 --2- 172.21.15.52:0/3180047731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c8c003bc0 0x7f7ca41491b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00bc70 tx=0x7f7c980012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:27.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.084+0000 7f7c8b7fe700 1 -- 172.21.15.52:0/3180047731 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c98006c70 con 0x7f7c8c003bc0 2023-06-23T18:45:27.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.084+0000 7f7c8b7fe700 1 -- 172.21.15.52:0/3180047731 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c98006dd0 con 0x7f7c8c003bc0 2023-06-23T18:45:27.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.084+0000 7f7ca94b2700 1 -- 172.21.15.52:0/3180047731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca4138cb0 con 0x7f7c8c003bc0 2023-06-23T18:45:27.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.084+0000 7f7c8b7fe700 1 -- 172.21.15.52:0/3180047731 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c98007280 con 0x7f7c8c003bc0 2023-06-23T18:45:27.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.084+0000 7f7ca94b2700 1 -- 172.21.15.52:0/3180047731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca40b9b20 con 0x7f7c8c003bc0 2023-06-23T18:45:27.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.085+0000 7f7ca94b2700 1 -- 172.21.15.52:0/3180047731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca41d4d40 con 0x7f7c8c003bc0 2023-06-23T18:45:27.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.085+0000 7f7c8b7fe700 1 -- 172.21.15.52:0/3180047731 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7c980073e0 con 0x7f7c8c003bc0 2023-06-23T18:45:27.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.086+0000 7f7c8b7fe700 1 --2- 172.21.15.52:0/3180047731 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7c9006ad10 0x7f7c9006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:27.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.086+0000 7f7c8b7fe700 1 -- 172.21.15.52:0/3180047731 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f7c9808a330 con 0x7f7c8c003bc0 2023-06-23T18:45:27.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.086+0000 7f7ca27fc700 1 --2- 172.21.15.52:0/3180047731 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7c9006ad10 0x7f7c9006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:27.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.086+0000 7f7ca27fc700 1 --2- 172.21.15.52:0/3180047731 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7c9006ad10 0x7f7c9006d1c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4071b70 tx=0x7f7c94008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:27.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.090+0000 7f7c8b7fe700 1 -- 172.21.15.52:0/3180047731 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7c98055410 con 0x7f7c8c003bc0 2023-06-23T18:45:27.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.288+0000 7f7ca94b2700 1 -- 172.21.15.52:0/3180047731 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7ca404e1d0 con 0x7f7c8c003bc0 2023-06-23T18:45:27.893 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.888+0000 7f7c8b7fe700 1 -- 172.21.15.52:0/3180047731 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7c98058a30 con 0x7f7c8c003bc0 2023-06-23T18:45:27.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.893+0000 7f7ca94b2700 1 -- 172.21.15.52:0/3180047731 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7c9006ad10 msgr2=0x7f7c9006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:27.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.893+0000 7f7ca94b2700 1 --2- 172.21.15.52:0/3180047731 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7c9006ad10 0x7f7c9006d1c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4071b70 tx=0x7f7c94008040 comp rx=0 tx=0).stop 2023-06-23T18:45:27.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.893+0000 7f7ca94b2700 1 -- 172.21.15.52:0/3180047731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c8c003bc0 msgr2=0x7f7ca41491b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:27.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.893+0000 7f7ca94b2700 1 --2- 172.21.15.52:0/3180047731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c8c003bc0 0x7f7ca41491b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00bc70 tx=0x7f7c980012d0 comp rx=0 tx=0).stop 2023-06-23T18:45:27.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.893+0000 7f7ca94b2700 1 -- 172.21.15.52:0/3180047731 shutdown_connections 2023-06-23T18:45:27.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.893+0000 7f7ca94b2700 1 --2- 172.21.15.52:0/3180047731 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7c9006ad10 0x7f7c9006d1c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:27.898 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.893+0000 7f7ca94b2700 1 --2- 172.21.15.52:0/3180047731 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ca41d54d0 0x7f7ca41e35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:27.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.893+0000 7f7ca94b2700 1 --2- 172.21.15.52:0/3180047731 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7c8c003bc0 0x7f7ca41491b0 secure :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00bc70 tx=0x7f7c980012d0 comp rx=0 tx=0).stop 2023-06-23T18:45:27.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.893+0000 7f7ca94b2700 1 --2- 172.21.15.52:0/3180047731 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ca41d5060 0x7f7ca41e30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:27.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.893+0000 7f7ca94b2700 1 -- 172.21.15.52:0/3180047731 >> 172.21.15.52:0/3180047731 conn(0x7f7ca40bd140 msgr2=0x7f7ca4142250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:27.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.893+0000 7f7ca94b2700 1 -- 172.21.15.52:0/3180047731 shutdown_connections 2023-06-23T18:45:27.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:27.893+0000 7f7ca94b2700 1 -- 172.21.15.52:0/3180047731 wait complete. 2023-06-23T18:45:27.899 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2023-06-23T18:45:27.913 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-23T18:45:27.996 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:45:27.998 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:45:28.000 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:45:28.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.044+0000 7f75b2659700 1 Processor -- start 2023-06-23T18:45:28.049 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.044+0000 7f75b2659700 1 -- start start 2023-06-23T18:45:28.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.045+0000 7f75b2659700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75ac0b69d0 0x7f75ac0b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:28.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.045+0000 7f75b2659700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75ac0bb490 0x7f75ac154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:28.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.045+0000 7f75b2659700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ac14b140 con 0x7f75ac0bb040 2023-06-23T18:45:28.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.045+0000 7f75b2659700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ac14a620 con 0x7f75ac0bb490 2023-06-23T18:45:28.051 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.045+0000 7f75b2659700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0bb910 con 0x7f75ac0b69d0 2023-06-23T18:45:28.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.046+0000 7f75b0bf6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75ac0bb490 0x7f75ac154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:28.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.046+0000 7f75b0bf6700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f75ac0bb490 0x7f75ac154ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46184/0 (socket says 172.21.15.52:46184) 2023-06-23T18:45:28.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.046+0000 7f75b0bf6700 1 -- 172.21.15.52:0/3575575392 learned_addr learned my addr 172.21.15.52:0/3575575392 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:28.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.046+0000 7f75abfff700 1 --2- 172.21.15.52:0/3575575392 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75ac0b69d0 0x7f75ac0b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:28.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.046+0000 7f75b0bf6700 1 -- 172.21.15.52:0/3575575392 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75ac0b69d0 msgr2=0x7f75ac0b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:28.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.046+0000 7f75b0bf6700 1 --2- 172.21.15.52:0/3575575392 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75ac0b69d0 0x7f75ac0b5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:28.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.046+0000 7f75b0bf6700 1 -- 172.21.15.52:0/3575575392 >> v1:172.21.15.89:6789/0 conn(0x7f75ac0bb040 legacy=0x7f75ac1444a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:28.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.046+0000 7f75b0bf6700 1 -- 172.21.15.52:0/3575575392 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ac0b8280 con 0x7f75ac0bb490 2023-06-23T18:45:28.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.046+0000 7f75b0bf6700 1 --2- 172.21.15.52:0/3575575392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75ac0bb490 0x7f75ac154ea0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f75a4009e50 tx=0x7f75a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d621da3b3c0064 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:28.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.046+0000 7f75aaffd700 1 -- 172.21.15.52:0/3575575392 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a400e070 con 0x7f75ac0bb490 2023-06-23T18:45:28.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.046+0000 7f75aaffd700 1 -- 172.21.15.52:0/3575575392 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a400b910 con 0x7f75ac0bb490 2023-06-23T18:45:28.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.046+0000 7f75aaffd700 1 -- 172.21.15.52:0/3575575392 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a400bcc0 con 0x7f75ac0bb490 2023-06-23T18:45:28.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.047+0000 7f75b2659700 1 -- 172.21.15.52:0/3575575392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75ac0bb490 msgr2=0x7f75ac154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:28.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.047+0000 7f75b2659700 1 --2- 172.21.15.52:0/3575575392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75ac0bb490 0x7f75ac154ea0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f75a4009e50 tx=0x7f75a400b330 comp rx=0 tx=0).stop 2023-06-23T18:45:28.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.047+0000 7f75b2659700 1 -- 172.21.15.52:0/3575575392 shutdown_connections 2023-06-23T18:45:28.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.047+0000 7f75b2659700 1 --2- 172.21.15.52:0/3575575392 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75ac0bb490 0x7f75ac154ea0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:28.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.047+0000 7f75b2659700 1 --2- 172.21.15.52:0/3575575392 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75ac0b69d0 0x7f75ac0b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:28.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.047+0000 7f75b2659700 1 -- 172.21.15.52:0/3575575392 >> 172.21.15.52:0/3575575392 conn(0x7f75ac0bd140 msgr2=0x7f75ac0bd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.047+0000 7f75b2659700 1 -- 172.21.15.52:0/3575575392 shutdown_connections 2023-06-23T18:45:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.047+0000 7f75b2659700 1 -- 172.21.15.52:0/3575575392 wait complete. 2023-06-23T18:45:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.048+0000 7f75b2659700 1 Processor -- start 2023-06-23T18:45:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.049+0000 7f75b2659700 1 -- start start 2023-06-23T18:45:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.049+0000 7f75b2659700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75ac0b69d0 0x7f75ac146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.049+0000 7f75b2659700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75ac0bb040 0x7f75ac14be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.049+0000 7f75b2659700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75ac0bb490 0x7f75ac14c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:28.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.049+0000 7f75b2659700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac146ed0 con 0x7f75ac0b69d0 2023-06-23T18:45:28.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.049+0000 7f75b2659700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac1450f0 con 0x7f75ac0bb490 2023-06-23T18:45:28.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.049+0000 7f75b2659700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac1453d0 con 0x7f75ac0bb040 2023-06-23T18:45:28.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.049+0000 7f75abfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75ac0b69d0 0x7f75ac146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:28.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.049+0000 7f75abfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75ac0b69d0 0x7f75ac146990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46196/0 (socket says 172.21.15.52:46196) 2023-06-23T18:45:28.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.049+0000 7f75abfff700 1 -- 172.21.15.52:0/1655092280 learned_addr learned my addr 172.21.15.52:0/1655092280 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:28.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.050+0000 7f75ab7fe700 1 --2- 172.21.15.52:0/1655092280 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75ac0bb040 0x7f75ac14be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:28.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.050+0000 7f75b0bf6700 1 --2- 172.21.15.52:0/1655092280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75ac0bb490 0x7f75ac14c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:28.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.050+0000 7f75abfff700 1 -- 172.21.15.52:0/1655092280 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75ac0bb040 msgr2=0x7f75ac14be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:28.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.050+0000 7f75abfff700 1 --2- 172.21.15.52:0/1655092280 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75ac0bb040 0x7f75ac14be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:28.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.050+0000 7f75abfff700 1 -- 172.21.15.52:0/1655092280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75ac0bb490 msgr2=0x7f75ac14c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:28.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.050+0000 7f75abfff700 1 --2- 172.21.15.52:0/1655092280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75ac0bb490 0x7f75ac14c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:28.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.050+0000 7f75abfff700 1 -- 172.21.15.52:0/1655092280 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a4009b30 con 0x7f75ac0b69d0 2023-06-23T18:45:28.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.050+0000 7f75ab7fe700 1 --2- 172.21.15.52:0/1655092280 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75ac0bb040 0x7f75ac14be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:45:28.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.050+0000 7f75abfff700 1 --2- 172.21.15.52:0/1655092280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75ac0b69d0 0x7f75ac146990 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f759c00e870 tx=0x7f759c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:28.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.050+0000 7f75a8ff9700 1 -- 172.21.15.52:0/1655092280 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c009590 con 0x7f75ac0b69d0 2023-06-23T18:45:28.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.050+0000 7f75a8ff9700 1 -- 172.21.15.52:0/1655092280 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759c00ee70 con 0x7f75ac0b69d0 2023-06-23T18:45:28.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.050+0000 7f75b2659700 1 -- 172.21.15.52:0/1655092280 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ac1456b0 con 0x7f75ac0b69d0 2023-06-23T18:45:28.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.050+0000 7f75a8ff9700 1 -- 172.21.15.52:0/1655092280 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c00ca50 con 0x7f75ac0b69d0 2023-06-23T18:45:28.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.050+0000 7f75b2659700 1 -- 172.21.15.52:0/1655092280 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ac141970 con 0x7f75ac0b69d0 2023-06-23T18:45:28.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.051+0000 7f75b2659700 1 -- 172.21.15.52:0/1655092280 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75ac04e1d0 con 0x7f75ac0b69d0 2023-06-23T18:45:28.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.052+0000 7f75a8ff9700 1 -- 172.21.15.52:0/1655092280 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f759c00cbb0 con 0x7f75ac0b69d0 2023-06-23T18:45:28.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.052+0000 7f75a8ff9700 1 --2- 172.21.15.52:0/1655092280 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f759806ace0 0x7f759806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:28.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.052+0000 7f75a8ff9700 1 -- 172.21.15.52:0/1655092280 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5710+0+0 (secure 0 0 0) 0x7f759c0892f0 con 0x7f75ac0b69d0 2023-06-23T18:45:28.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.052+0000 7f75ab7fe700 1 --2- 172.21.15.52:0/1655092280 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f759806ace0 0x7f759806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:28.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.053+0000 7f75ab7fe700 1 --2- 172.21.15.52:0/1655092280 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f759806ace0 0x7f759806d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f75ac14e2a0 tx=0x7f75a0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:28.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.056+0000 7f75a8ff9700 1 -- 172.21.15.52:0/1655092280 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f759c057f90 con 0x7f75ac0b69d0 2023-06-23T18:45:28.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.251+0000 7f75b2659700 1 -- 172.21.15.52:0/1655092280 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f75ac142a00 con 0x7f75ac0b69d0 2023-06-23T18:45:28.894 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.889+0000 7f75a8ff9700 1 -- 172.21.15.52:0/1655092280 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f759c00ce60 con 0x7f75ac0b69d0 2023-06-23T18:45:28.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.894+0000 7f75b2659700 1 -- 172.21.15.52:0/1655092280 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f759806ace0 msgr2=0x7f759806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:28.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.894+0000 7f75b2659700 1 --2- 172.21.15.52:0/1655092280 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f759806ace0 0x7f759806d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f75ac14e2a0 tx=0x7f75a0009040 comp rx=0 tx=0).stop 2023-06-23T18:45:28.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.894+0000 7f75b2659700 1 -- 172.21.15.52:0/1655092280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75ac0b69d0 msgr2=0x7f75ac146990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:28.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.894+0000 7f75b2659700 1 --2- 172.21.15.52:0/1655092280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75ac0b69d0 0x7f75ac146990 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f759c00e870 tx=0x7f759c00ec30 comp rx=0 tx=0).stop 2023-06-23T18:45:28.899 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.894+0000 7f75b2659700 1 -- 172.21.15.52:0/1655092280 shutdown_connections 2023-06-23T18:45:28.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.894+0000 7f75b2659700 1 --2- 172.21.15.52:0/1655092280 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f759806ace0 0x7f759806d190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:28.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.894+0000 7f75b2659700 1 --2- 172.21.15.52:0/1655092280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75ac0bb490 0x7f75ac14c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:28.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.894+0000 7f75b2659700 1 --2- 172.21.15.52:0/1655092280 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f75ac0b69d0 0x7f75ac146990 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:28.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.894+0000 7f75b2659700 1 --2- 172.21.15.52:0/1655092280 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75ac0bb040 0x7f75ac14be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:28.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.894+0000 7f75b2659700 1 -- 172.21.15.52:0/1655092280 >> 172.21.15.52:0/1655092280 conn(0x7f75ac0bd140 msgr2=0x7f75ac0bc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:28.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.894+0000 7f75b2659700 1 -- 172.21.15.52:0/1655092280 shutdown_connections 2023-06-23T18:45:28.900 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:28.894+0000 7f75b2659700 1 -- 172.21.15.52:0/1655092280 wait complete. 2023-06-23T18:45:28.901 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2023-06-23T18:45:28.915 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-23T18:45:28.915 INFO:tasks.ceph.mds.a:Stopping old one... 2023-06-23T18:45:28.915 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-23T18:45:28.915 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T18:45:28.916 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-23T18:45:28.916 INFO:tasks.ceph.mds.c:Stopping old one... 2023-06-23T18:45:28.916 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-23T18:45:28.916 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T18:45:28.917 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-23T18:45:28.917 INFO:tasks.ceph.mds.b:Stopping old one... 2023-06-23T18:45:28.917 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-23T18:45:28.917 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T18:45:28.925 INFO:tasks.ceph.mds.a:Stopped 2023-06-23T18:45:28.925 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-23T18:45:28.927 INFO:tasks.ceph.mds.c:Stopped 2023-06-23T18:45:28.927 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-23T18:45:28.928 INFO:tasks.ceph.mds.b:Stopped 2023-06-23T18:45:28.928 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-23T18:45:28.968 INFO:tasks.ceph.mds.a:Started 2023-06-23T18:45:28.969 DEBUG:teuthology.parallel:result is None 2023-06-23T18:45:28.970 INFO:tasks.ceph.mds.c:Started 2023-06-23T18:45:28.970 DEBUG:teuthology.parallel:result is None 2023-06-23T18:45:28.970 INFO:tasks.ceph.mds.b:Started 2023-06-23T18:45:28.971 DEBUG:teuthology.parallel:result is None 2023-06-23T18:45:28.971 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-06-23T18:45:29.056 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-06-23T18:45:29.064 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2023-06-23T18:45:29.065 INFO:tasks.ceph.mds.c.smithi052.stdout:starting mds.c at 2023-06-23T18:45:29.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.115+0000 7f20e63a2700 1 Processor -- start 2023-06-23T18:45:29.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.115+0000 7f20e63a2700 1 -- start start 2023-06-23T18:45:29.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.115+0000 7f20e63a2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f20e01489a0 0x7f20e01421b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:29.121 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.115+0000 7f20e63a2700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e014c490 con 0x7f20e0141d10 2023-06-23T18:45:29.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.115+0000 7f20e63a2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e00b7cb0 con 0x7f20e00b7530 2023-06-23T18:45:29.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.115+0000 7f20e63a2700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e014bb60 con 0x7f20e01489a0 2023-06-23T18:45:29.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.116+0000 7f20df7fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f20e0141d10 0x7f20e0148290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54376/0 (socket says 172.21.15.52:54376) 2023-06-23T18:45:29.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.116+0000 7f20df7fe700 1 -- 172.21.15.52:0/3013927164 learned_addr learned my addr 172.21.15.52:0/3013927164 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:29.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.116+0000 7f20e493f700 1 --2- 172.21.15.52:0/3013927164 >> v2:172.21.15.89:3300/0 conn(0x7f20e01489a0 0x7f20e01421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:29.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.116+0000 7f20deffd700 1 -- 172.21.15.52:0/3013927164 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555043813 0 0) 0x7f20e014c490 con 0x7f20e0141d10 2023-06-23T18:45:29.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.116+0000 7f20deffd700 1 -- 172.21.15.52:0/3013927164 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20c80035b0 con 0x7f20e0141d10 2023-06-23T18:45:29.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.116+0000 7f20e493f700 1 -- 172.21.15.52:0/3013927164 >> v1:172.21.15.89:6789/0 conn(0x7f20e00b7530 legacy=0x7f20e00b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:29.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.116+0000 7f20deffd700 1 -- 172.21.15.52:0/3013927164 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1448133748 0 0) 0x7f20c80035b0 con 0x7f20e0141d10 2023-06-23T18:45:29.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.116+0000 7f20e493f700 1 -- 172.21.15.52:0/3013927164 >> v1:172.21.15.52:6789/0 conn(0x7f20e0141d10 legacy=0x7f20e0148290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:29.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.116+0000 7f20e493f700 1 -- 172.21.15.52:0/3013927164 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e014be40 con 0x7f20e01489a0 2023-06-23T18:45:29.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.116+0000 7f20e493f700 1 --2- 172.21.15.52:0/3013927164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20e01489a0 0x7f20e01421b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009d90 tx=0x7f20d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c290443210b2b25 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:29.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.117+0000 7f20deffd700 1 -- 172.21.15.52:0/3013927164 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d800e070 con 0x7f20e01489a0 2023-06-23T18:45:29.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.117+0000 7f20deffd700 1 -- 172.21.15.52:0/3013927164 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d8003a20 con 0x7f20e01489a0 2023-06-23T18:45:29.123 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.117+0000 7f20deffd700 1 -- 172.21.15.52:0/3013927164 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d4001670 con 0x7f20e01489a0 2023-06-23T18:45:29.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.117+0000 7f20e63a2700 1 -- 172.21.15.52:0/3013927164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20e01489a0 msgr2=0x7f20e01421b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:29.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.117+0000 7f20e63a2700 1 --2- 172.21.15.52:0/3013927164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20e01489a0 0x7f20e01421b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009d90 tx=0x7f20d800b330 comp rx=0 tx=0).stop 2023-06-23T18:45:29.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.117+0000 7f20e63a2700 1 -- 172.21.15.52:0/3013927164 shutdown_connections 2023-06-23T18:45:29.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.117+0000 7f20e63a2700 1 --2- 172.21.15.52:0/3013927164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20e01489a0 0x7f20e01421b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:29.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.117+0000 7f20e63a2700 1 -- 172.21.15.52:0/3013927164 >> 172.21.15.52:0/3013927164 conn(0x7f20e006d210 msgr2=0x7f20e006d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:29.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.117+0000 7f20e63a2700 1 -- 172.21.15.52:0/3013927164 shutdown_connections 2023-06-23T18:45:29.126 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.117+0000 7f20e63a2700 1 -- 172.21.15.52:0/3013927164 wait complete. 2023-06-23T18:45:29.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.118+0000 7f20e63a2700 1 Processor -- start 2023-06-23T18:45:29.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.118+0000 7f20e63a2700 1 -- start start 2023-06-23T18:45:29.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.119+0000 7f20e63a2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20e00b7530 0x7f20e01498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:29.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.119+0000 7f20e63a2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20e0141d10 0x7f20e014a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:29.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.119+0000 7f20e63a2700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e01489a0 0x7f20e0137f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:29.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.119+0000 7f20e63a2700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e0134230 con 0x7f20e01489a0 2023-06-23T18:45:29.127 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.119+0000 7f20e63a2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e0134480 con 0x7f20e00b7530 2023-06-23T18:45:29.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.119+0000 7f20e63a2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e0149410 con 0x7f20e0141d10 2023-06-23T18:45:29.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.119+0000 7f20e493f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e01489a0 0x7f20e0137f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:29.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.119+0000 7f20e493f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e01489a0 0x7f20e0137f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46230/0 (socket says 172.21.15.52:46230) 2023-06-23T18:45:29.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.119+0000 7f20e493f700 1 -- 172.21.15.52:0/1057641969 learned_addr learned my addr 172.21.15.52:0/1057641969 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:29.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.119+0000 7f20df7fe700 1 --2- 172.21.15.52:0/1057641969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20e0141d10 0x7f20e014a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:29.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.119+0000 7f20e493f700 1 -- 172.21.15.52:0/1057641969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20e0141d10 msgr2=0x7f20e014a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:29.128 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.119+0000 7f20e493f700 1 --2- 172.21.15.52:0/1057641969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20e0141d10 0x7f20e014a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:29.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.119+0000 7f20e493f700 1 -- 172.21.15.52:0/1057641969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20e00b7530 msgr2=0x7f20e01498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:29.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.119+0000 7f20e493f700 1 --2- 172.21.15.52:0/1057641969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20e00b7530 0x7f20e01498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:29.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.119+0000 7f20e493f700 1 -- 172.21.15.52:0/1057641969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d8009a70 con 0x7f20e01489a0 2023-06-23T18:45:29.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.120+0000 7f20e493f700 1 --2- 172.21.15.52:0/1057641969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e01489a0 0x7f20e0137f30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f20d800b370 tx=0x7f20d8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:29.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.120+0000 7f20dcff9700 1 -- 172.21.15.52:0/1057641969 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d80046f0 con 0x7f20e01489a0 2023-06-23T18:45:29.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.120+0000 7f20dcff9700 1 -- 172.21.15.52:0/1057641969 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d8004850 con 0x7f20e01489a0 2023-06-23T18:45:29.129 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.120+0000 7f20e63a2700 1 -- 172.21.15.52:0/1057641969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e014ad40 con 0x7f20e01489a0 2023-06-23T18:45:29.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.120+0000 7f20dcff9700 1 -- 172.21.15.52:0/1057641969 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d8012670 con 0x7f20e01489a0 2023-06-23T18:45:29.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.120+0000 7f20e63a2700 1 -- 172.21.15.52:0/1057641969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e0147f00 con 0x7f20e01489a0 2023-06-23T18:45:29.130 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.121+0000 7f20e63a2700 1 -- 172.21.15.52:0/1057641969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e004e1d0 con 0x7f20e01489a0 2023-06-23T18:45:29.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.121+0000 7f20dcff9700 1 -- 172.21.15.52:0/1057641969 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f20d80127d0 con 0x7f20e01489a0 2023-06-23T18:45:29.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.122+0000 7f20dcff9700 1 --2- 172.21.15.52:0/1057641969 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f20cc06ad10 0x7f20cc06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:29.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.122+0000 7f20dcff9700 1 -- 172.21.15.52:0/1057641969 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f20d808a740 con 0x7f20e01489a0 2023-06-23T18:45:29.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.122+0000 7f20dffff700 1 --2- 172.21.15.52:0/1057641969 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f20cc06ad10 0x7f20cc06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:29.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.122+0000 7f20dffff700 1 --2- 172.21.15.52:0/1057641969 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f20cc06ad10 0x7f20cc06d1c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f20d0000f60 tx=0x7f20d0007a40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:29.131 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.126+0000 7f20dcff9700 1 -- 172.21.15.52:0/1057641969 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f20d8055b80 con 0x7f20e01489a0 2023-06-23T18:45:29.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:29.345+0000 7f20e63a2700 1 -- 172.21.15.52:0/1057641969 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f20e00b8100 con 0x7f20e01489a0 2023-06-23T18:45:30.104 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.099+0000 7f20dcff9700 1 -- 172.21.15.52:0/1057641969 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) v1 ==== 97+0+0 (secure 0 0 0) 0x7f20d80591a0 con 0x7f20e01489a0 2023-06-23T18:45:30.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.102+0000 7f20e63a2700 1 -- 172.21.15.52:0/1057641969 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f20cc06ad10 msgr2=0x7f20cc06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:30.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.102+0000 7f20e63a2700 1 --2- 172.21.15.52:0/1057641969 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f20cc06ad10 0x7f20cc06d1c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f20d0000f60 tx=0x7f20d0007a40 comp rx=0 tx=0).stop 2023-06-23T18:45:30.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.102+0000 7f20e63a2700 1 -- 172.21.15.52:0/1057641969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e01489a0 msgr2=0x7f20e0137f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:30.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.102+0000 7f20e63a2700 1 --2- 172.21.15.52:0/1057641969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e01489a0 0x7f20e0137f30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f20d800b370 tx=0x7f20d8004ad0 comp rx=0 tx=0).stop 2023-06-23T18:45:30.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.102+0000 7f20e63a2700 1 -- 172.21.15.52:0/1057641969 shutdown_connections 2023-06-23T18:45:30.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.102+0000 7f20e63a2700 1 --2- 172.21.15.52:0/1057641969 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f20cc06ad10 0x7f20cc06d1c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:30.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.102+0000 7f20e63a2700 1 --2- 172.21.15.52:0/1057641969 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f20e01489a0 0x7f20e0137f30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:30.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.102+0000 7f20e63a2700 1 --2- 172.21.15.52:0/1057641969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20e00b7530 0x7f20e01498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:30.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.102+0000 7f20e63a2700 1 --2- 172.21.15.52:0/1057641969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20e0141d10 0x7f20e014a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:30.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.102+0000 7f20e63a2700 1 -- 172.21.15.52:0/1057641969 >> 172.21.15.52:0/1057641969 conn(0x7f20e006d210 msgr2=0x7f20e006d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:30.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.102+0000 7f20e63a2700 1 -- 172.21.15.52:0/1057641969 shutdown_connections 2023-06-23T18:45:30.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.102+0000 7f20e63a2700 1 -- 172.21.15.52:0/1057641969 wait complete. 2023-06-23T18:45:30.109 INFO:teuthology.orchestra.run.smithi052.stderr: removed all blocklist entries 2023-06-23T18:45:30.122 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-06-23T18:45:30.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.250+0000 7f7a9f815700 1 Processor -- start 2023-06-23T18:45:30.255 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.250+0000 7f7a9f815700 1 -- start start 2023-06-23T18:45:30.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.251+0000 7f7a9f815700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7a980bb0a0 0x7f7a9806b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:30.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.251+0000 7f7a9f815700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a980bb970 con 0x7f7a980b84f0 2023-06-23T18:45:30.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.251+0000 7f7a9f815700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a980b8900 con 0x7f7a9814df30 2023-06-23T18:45:30.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.251+0000 7f7a9f815700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a9806b600 con 0x7f7a980bb0a0 2023-06-23T18:45:30.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.251+0000 7f7a9cdb0700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7a980b84f0 0x7f7a981442a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54388/0 (socket says 172.21.15.52:54388) 2023-06-23T18:45:30.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.251+0000 7f7a9cdb0700 1 -- 172.21.15.52:0/850229913 learned_addr learned my addr 172.21.15.52:0/850229913 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:30.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.251+0000 7f7a9d5b1700 1 --2- 172.21.15.52:0/850229913 >> v2:172.21.15.89:3300/0 conn(0x7f7a980bb0a0 0x7f7a9806b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:30.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.252+0000 7f7a8ffff700 1 -- 172.21.15.52:0/850229913 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127603314 0 0) 0x7f7a980bb970 con 0x7f7a980b84f0 2023-06-23T18:45:30.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.252+0000 7f7a8ffff700 1 -- 172.21.15.52:0/850229913 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a840035b0 con 0x7f7a980b84f0 2023-06-23T18:45:30.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.252+0000 7f7a8ffff700 1 -- 172.21.15.52:0/850229913 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2798790381 0 0) 0x7f7a840035b0 con 0x7f7a980b84f0 2023-06-23T18:45:30.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.252+0000 7f7a8ffff700 1 -- 172.21.15.52:0/850229913 >> v2:172.21.15.89:3300/0 conn(0x7f7a980bb0a0 msgr2=0x7f7a9806b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:30.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.252+0000 7f7a8ffff700 1 --2- 172.21.15.52:0/850229913 >> v2:172.21.15.89:3300/0 conn(0x7f7a980bb0a0 0x7f7a9806b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:30.259 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.252+0000 7f7a8ffff700 1 -- 172.21.15.52:0/850229913 >> v1:172.21.15.89:6789/0 conn(0x7f7a9814df30 legacy=0x7f7a9814a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:30.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.252+0000 7f7a8ffff700 1 -- 172.21.15.52:0/850229913 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9806cfa0 con 0x7f7a980b84f0 2023-06-23T18:45:30.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.252+0000 7f7a8ffff700 1 -- 172.21.15.52:0/850229913 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7f7a88001670 con 0x7f7a980b84f0 2023-06-23T18:45:30.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.252+0000 7f7a9d5b1700 1 --2- 172.21.15.52:0/850229913 >> v2:172.21.15.89:3300/0 conn(0x7f7a980bb0a0 0x7f7a9806b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:45:30.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.252+0000 7f7a8ffff700 1 -- 172.21.15.52:0/850229913 >> v1:172.21.15.52:6789/0 conn(0x7f7a980b84f0 legacy=0x7f7a981442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:30.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.252+0000 7f7a8ffff700 1 --2- 172.21.15.52:0/850229913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a84003a00 0x7f7a84003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:30.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.252+0000 7f7a8ffff700 1 --2- 172.21.15.52:0/850229913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a840043f0 0x7f7a840048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:30.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.252+0000 7f7a8ffff700 1 --2- 172.21.15.52:0/850229913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a840050b0 0x7f7a8400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:30.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.252+0000 7f7a8ffff700 1 -- 172.21.15.52:0/850229913 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8400c000 con 0x7f7a84003a00 2023-06-23T18:45:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.252+0000 7f7a8ffff700 1 -- 172.21.15.52:0/850229913 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8400c140 con 0x7f7a840050b0 2023-06-23T18:45:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.252+0000 7f7a8ffff700 1 -- 172.21.15.52:0/850229913 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8400c300 con 0x7f7a840043f0 2023-06-23T18:45:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.252+0000 7f7a9d5b1700 1 --2- 172.21.15.52:0/850229913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a84003a00 0x7f7a84003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.252+0000 7f7a9cdb0700 1 --2- 172.21.15.52:0/850229913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a840043f0 0x7f7a840048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.252+0000 7f7a9ddb2700 1 --2- 172.21.15.52:0/850229913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a840050b0 0x7f7a8400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.252+0000 7f7a9d5b1700 1 -- 172.21.15.52:0/850229913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a840043f0 msgr2=0x7f7a840048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:30.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.252+0000 7f7a9d5b1700 1 --2- 172.21.15.52:0/850229913 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a840043f0 0x7f7a840048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.252+0000 7f7a9d5b1700 1 -- 172.21.15.52:0/850229913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a840050b0 msgr2=0x7f7a8400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.252+0000 7f7a9d5b1700 1 --2- 172.21.15.52:0/850229913 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a840050b0 0x7f7a8400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.252+0000 7f7a9d5b1700 1 -- 172.21.15.52:0/850229913 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a840035b0 con 0x7f7a84003a00 2023-06-23T18:45:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.252+0000 7f7a9ddb2700 1 -- 172.21.15.52:0/850229913 reap_dead start 2023-06-23T18:45:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.253+0000 7f7a9d5b1700 1 --2- 172.21.15.52:0/850229913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a84003a00 0x7f7a84003dd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7a94009d30 tx=0x7f7a84005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d26d20faae28e6 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.253+0000 7f7a8ffff700 1 -- 172.21.15.52:0/850229913 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a94009e80 con 0x7f7a84003a00 2023-06-23T18:45:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.253+0000 7f7a8ffff700 1 -- 172.21.15.52:0/850229913 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9400e9a0 con 0x7f7a84003a00 2023-06-23T18:45:30.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.253+0000 7f7a8ffff700 1 -- 172.21.15.52:0/850229913 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9400ed10 con 0x7f7a84003a00 2023-06-23T18:45:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.253+0000 7f7a9f815700 1 -- 172.21.15.52:0/850229913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a84003a00 msgr2=0x7f7a84003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.253+0000 7f7a9f815700 1 --2- 172.21.15.52:0/850229913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a84003a00 0x7f7a84003dd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7a94009d30 tx=0x7f7a84005880 comp rx=0 tx=0).stop 2023-06-23T18:45:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.253+0000 7f7a9f815700 1 -- 172.21.15.52:0/850229913 shutdown_connections 2023-06-23T18:45:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.253+0000 7f7a9f815700 1 --2- 172.21.15.52:0/850229913 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a84003a00 0x7f7a84003dd0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:30.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.253+0000 7f7a9f815700 1 -- 172.21.15.52:0/850229913 >> 172.21.15.52:0/850229913 conn(0x7f7a9806d210 msgr2=0x7f7a9806d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.253+0000 7f7a9f815700 1 -- 172.21.15.52:0/850229913 shutdown_connections 2023-06-23T18:45:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.253+0000 7f7a9f815700 1 -- 172.21.15.52:0/850229913 wait complete. 2023-06-23T18:45:30.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.255+0000 7f7a9f815700 1 Processor -- start 2023-06-23T18:45:30.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.255+0000 7f7a9f815700 1 -- start start 2023-06-23T18:45:30.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.255+0000 7f7a9f815700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a84003a00 0x7f7a980ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:30.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.255+0000 7f7a9f815700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a981e2cd0 0x7f7a981e3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:30.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.255+0000 7f7a9f815700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a981df270 0x7f7a981df710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:30.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.255+0000 7f7a9f815700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a980b49b0 con 0x7f7a84003a00 2023-06-23T18:45:30.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.255+0000 7f7a9f815700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a980ace10 con 0x7f7a981df270 2023-06-23T18:45:30.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.255+0000 7f7a9f815700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a980b4b90 con 0x7f7a981e2cd0 2023-06-23T18:45:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.255+0000 7f7a9d5b1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a84003a00 0x7f7a980ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.255+0000 7f7a9d5b1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a84003a00 0x7f7a980ac8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46240/0 (socket says 172.21.15.52:46240) 2023-06-23T18:45:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.255+0000 7f7a9d5b1700 1 -- 172.21.15.52:0/3905388288 learned_addr learned my addr 172.21.15.52:0/3905388288 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.255+0000 7f7a9ddb2700 1 --2- 172.21.15.52:0/3905388288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a981df270 0x7f7a981df710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.255+0000 7f7a9cdb0700 1 --2- 172.21.15.52:0/3905388288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a981e2cd0 0x7f7a981e3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.256+0000 7f7a9d5b1700 1 -- 172.21.15.52:0/3905388288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a981e2cd0 msgr2=0x7f7a981e3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.256+0000 7f7a9d5b1700 1 --2- 172.21.15.52:0/3905388288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a981e2cd0 0x7f7a981e3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:30.267 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.256+0000 7f7a9d5b1700 1 -- 172.21.15.52:0/3905388288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a981df270 msgr2=0x7f7a981df710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.256+0000 7f7a9d5b1700 1 --2- 172.21.15.52:0/3905388288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a981df270 0x7f7a981df710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.256+0000 7f7a9d5b1700 1 -- 172.21.15.52:0/3905388288 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a981e3660 con 0x7f7a84003a00 2023-06-23T18:45:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.256+0000 7f7a9ddb2700 1 --2- 172.21.15.52:0/3905388288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a981df270 0x7f7a981df710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.256+0000 7f7a9d5b1700 1 --2- 172.21.15.52:0/3905388288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a84003a00 0x7f7a980ac8d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400e790 tx=0x7f7a940047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.256+0000 7f7a8dffb700 1 -- 172.21.15.52:0/3905388288 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a94003ab0 con 0x7f7a84003a00 2023-06-23T18:45:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.256+0000 7f7a8dffb700 1 -- 172.21.15.52:0/3905388288 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a94003c10 con 0x7f7a84003a00 2023-06-23T18:45:30.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.256+0000 7f7a8dffb700 1 -- 172.21.15.52:0/3905388288 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a94009e80 con 0x7f7a84003a00 2023-06-23T18:45:30.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.256+0000 7f7a9f815700 1 -- 172.21.15.52:0/3905388288 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a98147f10 con 0x7f7a84003a00 2023-06-23T18:45:30.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.256+0000 7f7a9f815700 1 -- 172.21.15.52:0/3905388288 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a981e27d0 con 0x7f7a84003a00 2023-06-23T18:45:30.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.257+0000 7f7a9f815700 1 -- 172.21.15.52:0/3905388288 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a981e2990 con 0x7f7a84003a00 2023-06-23T18:45:30.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.257+0000 7f7a8dffb700 1 -- 172.21.15.52:0/3905388288 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a94013470 con 0x7f7a84003a00 2023-06-23T18:45:30.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.258+0000 7f7a8dffb700 1 --2- 172.21.15.52:0/3905388288 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7a7c06ace0 0x7f7a7c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:30.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.258+0000 7f7a8dffb700 1 -- 172.21.15.52:0/3905388288 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7a9408ac00 con 0x7f7a84003a00 2023-06-23T18:45:30.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.258+0000 7f7a9cdb0700 1 --2- 172.21.15.52:0/3905388288 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7a7c06ace0 0x7f7a7c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:30.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.259+0000 7f7a9cdb0700 1 --2- 172.21.15.52:0/3905388288 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7a7c06ace0 0x7f7a7c06d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7a980b75d0 tx=0x7f7a88009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:30.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.262+0000 7f7a8dffb700 1 -- 172.21.15.52:0/3905388288 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7a94091080 con 0x7f7a84003a00 2023-06-23T18:45:30.543 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.538+0000 7f7a9f815700 1 -- 172.21.15.52:0/3905388288 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7a98147d70 con 0x7f7a84003a00 2023-06-23T18:45:30.544 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.539+0000 7f7a8dffb700 1 -- 172.21.15.52:0/3905388288 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+5491 (secure 0 0 0) 0x7f7a98147d70 con 0x7f7a84003a00 2023-06-23T18:45:30.544 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:30.544 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-06-23T18:45:30.544 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_dump": [ 2023-06-23T18:45:30.545 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-06-23T18:45:30.545 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.a", 2023-06-23T18:45:30.545 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDw55VkDiPWLxAAyWF0WbHh1ZGWjqLdPyu0kw==", 2023-06-23T18:45:30.545 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-06-23T18:45:30.545 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-06-23T18:45:30.545 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-06-23T18:45:30.545 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-06-23T18:45:30.546 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-06-23T18:45:30.546 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-06-23T18:45:30.546 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-06-23T18:45:30.546 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-06-23T18:45:30.546 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.b", 2023-06-23T18:45:30.546 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDx55Vkv/5TARAAFsNqKs7VgeqgphjxMcMy8g==", 2023-06-23T18:45:30.546 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-06-23T18:45:30.546 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-06-23T18:45:30.547 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-06-23T18:45:30.547 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-06-23T18:45:30.547 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-06-23T18:45:30.547 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-06-23T18:45:30.547 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-06-23T18:45:30.547 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-06-23T18:45:30.547 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mds.c", 2023-06-23T18:45:30.548 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDw55VkQPaMNxAAWwo0dmNhFSanIW0qXHhufg==", 2023-06-23T18:45:30.548 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-06-23T18:45:30.548 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-06-23T18:45:30.548 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-06-23T18:45:30.548 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-06-23T18:45:30.548 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-06-23T18:45:30.548 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-06-23T18:45:30.548 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-06-23T18:45:30.549 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-06-23T18:45:30.549 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.0", 2023-06-23T18:45:30.549 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDy55VkjB60HRAAek9wA3mUSGy4lIwOOWo+yw==", 2023-06-23T18:45:30.549 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-06-23T18:45:30.549 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-06-23T18:45:30.549 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-06-23T18:45:30.549 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-06-23T18:45:30.550 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-06-23T18:45:30.550 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-06-23T18:45:30.550 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-06-23T18:45:30.550 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.1", 2023-06-23T18:45:30.550 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD155VkRXtpHBAA+liUao5Oc2AVnXe6N3wMjw==", 2023-06-23T18:45:30.550 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-06-23T18:45:30.550 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-06-23T18:45:30.550 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-06-23T18:45:30.551 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-06-23T18:45:30.551 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-06-23T18:45:30.551 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-06-23T18:45:30.551 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-06-23T18:45:30.551 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.2", 2023-06-23T18:45:30.551 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD455VkF4AsGxAA3nuZaaTp7JVdMYaN24iEFA==", 2023-06-23T18:45:30.551 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-06-23T18:45:30.552 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-06-23T18:45:30.552 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-06-23T18:45:30.552 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-06-23T18:45:30.552 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-06-23T18:45:30.552 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-06-23T18:45:30.552 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-06-23T18:45:30.552 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.3", 2023-06-23T18:45:30.552 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQD755VkVYIvGhAAG5SgmCIbV42HY6HZOzKL5w==", 2023-06-23T18:45:30.553 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-06-23T18:45:30.553 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-06-23T18:45:30.553 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-06-23T18:45:30.553 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-06-23T18:45:30.553 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-06-23T18:45:30.553 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-06-23T18:45:30.553 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-06-23T18:45:30.553 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.4", 2023-06-23T18:45:30.554 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAB6JVkHT3lGRAAf/G/BfF8v+g/reaTJwpvmw==", 2023-06-23T18:45:30.554 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-06-23T18:45:30.554 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-06-23T18:45:30.554 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-06-23T18:45:30.554 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-06-23T18:45:30.554 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-06-23T18:45:30.554 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-06-23T18:45:30.554 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-06-23T18:45:30.555 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.5", 2023-06-23T18:45:30.555 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAE6JVkUD1IGBAAzjL1Wr/afpTHvpEZfGzOBA==", 2023-06-23T18:45:30.555 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-06-23T18:45:30.555 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-06-23T18:45:30.555 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-06-23T18:45:30.555 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-06-23T18:45:30.555 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-06-23T18:45:30.556 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-06-23T18:45:30.556 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-06-23T18:45:30.556 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.6", 2023-06-23T18:45:30.556 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAH6JVkVkrLFhAA3daVtv5TTUkHGJiUqvUoVw==", 2023-06-23T18:45:30.556 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-06-23T18:45:30.556 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-06-23T18:45:30.556 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-06-23T18:45:30.556 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-06-23T18:45:30.557 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-06-23T18:45:30.557 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-06-23T18:45:30.557 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-06-23T18:45:30.557 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "osd.7", 2023-06-23T18:45:30.557 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAK6JVkzXpLFRAA2EMtuhxTF6dZ3wrdmse+HA==", 2023-06-23T18:45:30.557 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-06-23T18:45:30.557 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow profile osd", 2023-06-23T18:45:30.558 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile osd", 2023-06-23T18:45:30.558 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-06-23T18:45:30.558 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-06-23T18:45:30.558 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-06-23T18:45:30.558 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-06-23T18:45:30.558 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.0", 2023-06-23T18:45:30.558 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDx55Vkbva3CRAABdlhryMtWjf5jsU2sSwuwg==", 2023-06-23T18:45:30.558 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-06-23T18:45:30.559 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow", 2023-06-23T18:45:30.559 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow r", 2023-06-23T18:45:30.559 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow rw", 2023-06-23T18:45:30.559 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow rwx" 2023-06-23T18:45:30.559 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-06-23T18:45:30.559 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-06-23T18:45:30.559 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-06-23T18:45:30.559 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.admin", 2023-06-23T18:45:30.560 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDv55Vk7zkJNRAAYA/HBsuOH1+OlGB5HbXC3Q==", 2023-06-23T18:45:30.560 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-06-23T18:45:30.560 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-06-23T18:45:30.560 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": "allow *", 2023-06-23T18:45:30.560 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow *", 2023-06-23T18:45:30.560 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-06-23T18:45:30.560 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-06-23T18:45:30.561 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-06-23T18:45:30.561 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-06-23T18:45:30.561 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-mds", 2023-06-23T18:45:30.561 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAP6JVka/HGNhAA4PxURyrr+f2sjiu5fVchSw==", 2023-06-23T18:45:30.561 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-06-23T18:45:30.561 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-mds" 2023-06-23T18:45:30.561 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-06-23T18:45:30.561 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-06-23T18:45:30.562 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-06-23T18:45:30.562 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-mgr", 2023-06-23T18:45:30.562 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAP6JVkwf/GNhAA29GXwbJ23ftv6dk0UseRWQ==", 2023-06-23T18:45:30.562 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-06-23T18:45:30.562 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-mgr" 2023-06-23T18:45:30.562 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-06-23T18:45:30.562 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-06-23T18:45:30.563 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-06-23T18:45:30.563 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-osd", 2023-06-23T18:45:30.563 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAP6JVkeQrHNhAADqs3N6cb97++uQDlfQzVMg==", 2023-06-23T18:45:30.563 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-06-23T18:45:30.563 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-osd" 2023-06-23T18:45:30.563 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-06-23T18:45:30.563 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-06-23T18:45:30.563 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-06-23T18:45:30.564 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-rbd", 2023-06-23T18:45:30.564 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAP6JVk/CfHNhAAnulbfrDeOVb4utSYempvFg==", 2023-06-23T18:45:30.564 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-06-23T18:45:30.564 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-rbd" 2023-06-23T18:45:30.564 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-06-23T18:45:30.564 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-06-23T18:45:30.564 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-06-23T18:45:30.564 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-06-23T18:45:30.565 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAP6JVkjjHHNhAALG5jNXVrdXRf/dBnRMRhyQ==", 2023-06-23T18:45:30.565 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-06-23T18:45:30.565 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-06-23T18:45:30.565 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-06-23T18:45:30.565 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-06-23T18:45:30.565 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-06-23T18:45:30.565 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "client.bootstrap-rgw", 2023-06-23T18:45:30.566 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQAP6JVk4DvHNhAA4L7IykcyZSkTqLQj4yZHCQ==", 2023-06-23T18:45:30.566 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-06-23T18:45:30.566 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile bootstrap-rgw" 2023-06-23T18:45:30.566 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-06-23T18:45:30.566 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-06-23T18:45:30.566 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-06-23T18:45:30.566 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.x", 2023-06-23T18:45:30.566 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDw55Vkx2DuKxAApmEU7ym6eJO69g1gk9tp4g==", 2023-06-23T18:45:30.567 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-06-23T18:45:30.567 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-06-23T18:45:30.567 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2023-06-23T18:45:30.567 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-06-23T18:45:30.567 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-06-23T18:45:30.567 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-06-23T18:45:30.567 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-06-23T18:45:30.568 INFO:teuthology.orchestra.run.smithi052.stdout: "entity": "mgr.y", 2023-06-23T18:45:30.568 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "AQDw55Vk7IQ3JxAAzfHr63bx3pWejXUKmJC6VQ==", 2023-06-23T18:45:30.568 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": { 2023-06-23T18:45:30.568 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": "allow *", 2023-06-23T18:45:30.568 INFO:teuthology.orchestra.run.smithi052.stdout: "mon": "allow profile mgr", 2023-06-23T18:45:30.568 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": "allow *" 2023-06-23T18:45:30.568 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-06-23T18:45:30.568 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-06-23T18:45:30.569 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2023-06-23T18:45:30.569 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-06-23T18:45:30.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.541+0000 7f7a9f815700 1 -- 172.21.15.52:0/3905388288 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7a7c06ace0 msgr2=0x7f7a7c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:30.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.541+0000 7f7a9f815700 1 --2- 172.21.15.52:0/3905388288 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7a7c06ace0 0x7f7a7c06d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7a980b75d0 tx=0x7f7a88009040 comp rx=0 tx=0).stop 2023-06-23T18:45:30.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.541+0000 7f7a9f815700 1 -- 172.21.15.52:0/3905388288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a84003a00 msgr2=0x7f7a980ac8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:30.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.541+0000 7f7a9f815700 1 --2- 172.21.15.52:0/3905388288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a84003a00 0x7f7a980ac8d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400e790 tx=0x7f7a940047c0 comp rx=0 tx=0).stop 2023-06-23T18:45:30.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.541+0000 7f7a9f815700 1 -- 172.21.15.52:0/3905388288 shutdown_connections 2023-06-23T18:45:30.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.541+0000 7f7a9f815700 1 --2- 172.21.15.52:0/3905388288 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7a7c06ace0 0x7f7a7c06d190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:30.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.541+0000 7f7a9f815700 1 --2- 172.21.15.52:0/3905388288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a981df270 0x7f7a981df710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:30.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.541+0000 7f7a9f815700 1 --2- 172.21.15.52:0/3905388288 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7a84003a00 0x7f7a980ac8d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:30.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.541+0000 7f7a9f815700 1 --2- 172.21.15.52:0/3905388288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a981e2cd0 0x7f7a981e3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:30.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.541+0000 7f7a9f815700 1 -- 172.21.15.52:0/3905388288 >> 172.21.15.52:0/3905388288 conn(0x7f7a9806d210 msgr2=0x7f7a98071410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:30.571 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.541+0000 7f7a9f815700 1 -- 172.21.15.52:0/3905388288 shutdown_connections 2023-06-23T18:45:30.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.541+0000 7f7a9f815700 1 -- 172.21.15.52:0/3905388288 wait complete. 2023-06-23T18:45:30.572 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-06-23T18:45:30.699 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.695+0000 7fc9a5fee700 1 Processor -- start 2023-06-23T18:45:30.700 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.695+0000 7fc9a5fee700 1 -- start start 2023-06-23T18:45:30.701 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.695+0000 7fc9a5fee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9a00b68a0 0x7fc9a00b8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:30.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.695+0000 7fc9a5fee700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc9a0152da0 0x7fc9a0155180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:30.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.695+0000 7fc9a5fee700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a00b5810 con 0x7fc9a014ae20 2023-06-23T18:45:30.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.695+0000 7fc9a5fee700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a00b7fe0 con 0x7fc9a0152da0 2023-06-23T18:45:30.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.695+0000 7fc9a5fee700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a014a620 con 0x7fc9a00b68a0 2023-06-23T18:45:30.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.696+0000 7fc99f7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9a00b68a0 0x7fc9a00b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:30.702 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.696+0000 7fc99ffff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc9a0152da0 0x7fc9a0155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:30.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.696+0000 7fc99f7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9a00b68a0 0x7fc9a00b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.52:55884/0 (socket says 172.21.15.52:55884) 2023-06-23T18:45:30.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.696+0000 7fc99f7fe700 1 -- 172.21.15.52:0/4090797664 learned_addr learned my addr 172.21.15.52:0/4090797664 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:30.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.696+0000 7fc99effd700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc9a014ae20 0x7fc9a00badf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.52:46176/0 (socket says 172.21.15.52:46176) 2023-06-23T18:45:30.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.696+0000 7fc99e7fc700 1 -- 172.21.15.52:0/4090797664 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158432566 0 0) 0x7fc9a00b5810 con 0x7fc9a014ae20 2023-06-23T18:45:30.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.696+0000 7fc99f7fe700 1 -- 172.21.15.52:0/4090797664 >> v2:172.21.15.89:3300/0 conn(0x7fc9a0152da0 msgr2=0x7fc9a0155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:30.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.696+0000 7fc99f7fe700 1 --2- 172.21.15.52:0/4090797664 >> v2:172.21.15.89:3300/0 conn(0x7fc9a0152da0 0x7fc9a0155180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:30.703 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.696+0000 7fc99f7fe700 1 -- 172.21.15.52:0/4090797664 >> v1:172.21.15.89:6789/0 conn(0x7fc9a014ae20 legacy=0x7fc9a00badf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:30.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.696+0000 7fc99f7fe700 1 -- 172.21.15.52:0/4090797664 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a014a900 con 0x7fc9a00b68a0 2023-06-23T18:45:30.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.696+0000 7fc99ffff700 1 --2- 172.21.15.52:0/4090797664 >> v2:172.21.15.89:3300/0 conn(0x7fc9a0152da0 0x7fc9a0155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:45:30.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.696+0000 7fc99f7fe700 1 --2- 172.21.15.52:0/4090797664 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9a00b68a0 0x7fc9a00b8400 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc990009920 tx=0x7fc990009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a67e1698a60e434 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:30.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.696+0000 7fc99e7fc700 1 -- 172.21.15.52:0/4090797664 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990011830 con 0x7fc9a00b68a0 2023-06-23T18:45:30.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.696+0000 7fc99e7fc700 1 -- 172.21.15.52:0/4090797664 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc990011990 con 0x7fc9a00b68a0 2023-06-23T18:45:30.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.696+0000 7fc99e7fc700 1 -- 172.21.15.52:0/4090797664 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990011d20 con 0x7fc9a00b68a0 2023-06-23T18:45:30.704 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.697+0000 7fc9a5fee700 1 -- 172.21.15.52:0/4090797664 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9a00b68a0 msgr2=0x7fc9a00b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:30.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.697+0000 7fc9a5fee700 1 --2- 172.21.15.52:0/4090797664 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9a00b68a0 0x7fc9a00b8400 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc990009920 tx=0x7fc990009c30 comp rx=0 tx=0).stop 2023-06-23T18:45:30.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.697+0000 7fc9a5fee700 1 -- 172.21.15.52:0/4090797664 shutdown_connections 2023-06-23T18:45:30.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.697+0000 7fc9a5fee700 1 --2- 172.21.15.52:0/4090797664 >> v2:172.21.15.89:3300/0 conn(0x7fc9a0152da0 0x7fc9a0155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:30.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.697+0000 7fc9a5fee700 1 --2- 172.21.15.52:0/4090797664 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9a00b68a0 0x7fc9a00b8400 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:30.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.697+0000 7fc9a5fee700 1 -- 172.21.15.52:0/4090797664 >> 172.21.15.52:0/4090797664 conn(0x7fc9a0069ef0 msgr2=0x7fc9a00713a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:30.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.697+0000 7fc9a5fee700 1 -- 172.21.15.52:0/4090797664 shutdown_connections 2023-06-23T18:45:30.705 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.697+0000 7fc9a5fee700 1 -- 172.21.15.52:0/4090797664 wait complete. 2023-06-23T18:45:30.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.698+0000 7fc9a5fee700 1 Processor -- start 2023-06-23T18:45:30.707 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.698+0000 7fc9a5fee700 1 -- start start 2023-06-23T18:45:30.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.699+0000 7fc9a5fee700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9a00b68a0 0x7fc9a006caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:30.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.699+0000 7fc9a5fee700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9a014ae20 0x7fc9a006ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:30.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.699+0000 7fc9a5fee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9a0152da0 0x7fc9a01e3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:30.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.699+0000 7fc9a5fee700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a0147400 con 0x7fc9a014ae20 2023-06-23T18:45:30.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.699+0000 7fc9a5fee700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a006aed0 con 0x7fc9a00b68a0 2023-06-23T18:45:30.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.699+0000 7fc9a5fee700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a006b1b0 con 0x7fc9a0152da0 2023-06-23T18:45:30.708 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.699+0000 7fc99effd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9a014ae20 0x7fc9a006ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:30.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.699+0000 7fc99effd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9a014ae20 0x7fc9a006ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46250/0 (socket says 172.21.15.52:46250) 2023-06-23T18:45:30.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.699+0000 7fc99effd700 1 -- 172.21.15.52:0/579663163 learned_addr learned my addr 172.21.15.52:0/579663163 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:30.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.699+0000 7fc99f7fe700 1 --2- 172.21.15.52:0/579663163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9a00b68a0 0x7fc9a006caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:30.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.699+0000 7fc99ffff700 1 --2- 172.21.15.52:0/579663163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9a0152da0 0x7fc9a01e3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:30.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.699+0000 7fc99effd700 1 -- 172.21.15.52:0/579663163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9a0152da0 msgr2=0x7fc9a01e3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:30.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.699+0000 7fc99effd700 1 --2- 172.21.15.52:0/579663163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9a0152da0 0x7fc9a01e3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:30.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.699+0000 7fc99effd700 1 -- 172.21.15.52:0/579663163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9a00b68a0 msgr2=0x7fc9a006caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:30.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.699+0000 7fc99effd700 1 --2- 172.21.15.52:0/579663163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9a00b68a0 0x7fc9a006caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:30.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.699+0000 7fc99effd700 1 -- 172.21.15.52:0/579663163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc998009a70 con 0x7fc9a014ae20 2023-06-23T18:45:30.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.699+0000 7fc99effd700 1 --2- 172.21.15.52:0/579663163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9a014ae20 0x7fc9a006ba00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc9880011e0 tx=0x7fc98800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:30.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.700+0000 7fc997fff700 1 -- 172.21.15.52:0/579663163 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc988004c80 con 0x7fc9a014ae20 2023-06-23T18:45:30.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.700+0000 7fc997fff700 1 -- 172.21.15.52:0/579663163 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc988004e00 con 0x7fc9a014ae20 2023-06-23T18:45:30.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.700+0000 7fc9a5fee700 1 -- 172.21.15.52:0/579663163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc990009550 con 0x7fc9a014ae20 2023-06-23T18:45:30.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.700+0000 7fc997fff700 1 -- 172.21.15.52:0/579663163 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc988007310 con 0x7fc9a014ae20 2023-06-23T18:45:30.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.700+0000 7fc9a5fee700 1 -- 172.21.15.52:0/579663163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a006cfe0 con 0x7fc9a014ae20 2023-06-23T18:45:30.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.701+0000 7fc9a5fee700 1 -- 172.21.15.52:0/579663163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a004e1d0 con 0x7fc9a014ae20 2023-06-23T18:45:30.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.701+0000 7fc997fff700 1 -- 172.21.15.52:0/579663163 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc988007470 con 0x7fc9a014ae20 2023-06-23T18:45:30.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.701+0000 7fc997fff700 1 --2- 172.21.15.52:0/579663163 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc98006ace0 0x7fc98006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:30.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.702+0000 7fc997fff700 1 -- 172.21.15.52:0/579663163 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc988088dc0 con 0x7fc9a014ae20 2023-06-23T18:45:30.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.702+0000 7fc99f7fe700 1 --2- 172.21.15.52:0/579663163 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc98006ace0 0x7fc98006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:30.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.702+0000 7fc99f7fe700 1 --2- 172.21.15.52:0/579663163 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc98006ace0 0x7fc98006d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc990000c00 tx=0x7fc990008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:30.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.706+0000 7fc997fff700 1 -- 172.21.15.52:0/579663163 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc9880541d0 con 0x7fc9a014ae20 2023-06-23T18:45:30.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.987+0000 7fc9a5fee700 1 -- 172.21.15.52:0/579663163 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fc9a006d1e0 con 0x7fc9a014ae20 2023-06-23T18:45:30.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.990+0000 7fc997fff700 1 -- 172.21.15.52:0/579663163 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc9880577f0 con 0x7fc9a014ae20 2023-06-23T18:45:30.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.992+0000 7fc9a5fee700 1 -- 172.21.15.52:0/579663163 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc98006ace0 msgr2=0x7fc98006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:30.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.992+0000 7fc9a5fee700 1 --2- 172.21.15.52:0/579663163 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc98006ace0 0x7fc98006d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc990000c00 tx=0x7fc990008030 comp rx=0 tx=0).stop 2023-06-23T18:45:30.997 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.992+0000 7fc9a5fee700 1 -- 172.21.15.52:0/579663163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9a014ae20 msgr2=0x7fc9a006ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:30.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.992+0000 7fc9a5fee700 1 --2- 172.21.15.52:0/579663163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9a014ae20 0x7fc9a006ba00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc9880011e0 tx=0x7fc98800ca30 comp rx=0 tx=0).stop 2023-06-23T18:45:30.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.992+0000 7fc9a5fee700 1 -- 172.21.15.52:0/579663163 shutdown_connections 2023-06-23T18:45:30.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.992+0000 7fc9a5fee700 1 --2- 172.21.15.52:0/579663163 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc98006ace0 0x7fc98006d190 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:30.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.992+0000 7fc9a5fee700 1 --2- 172.21.15.52:0/579663163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9a0152da0 0x7fc9a01e3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:30.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.992+0000 7fc9a5fee700 1 --2- 172.21.15.52:0/579663163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9a00b68a0 0x7fc9a006caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:30.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.992+0000 7fc9a5fee700 1 --2- 172.21.15.52:0/579663163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc9a014ae20 0x7fc9a006ba00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:30.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.992+0000 7fc9a5fee700 1 -- 172.21.15.52:0/579663163 >> 172.21.15.52:0/579663163 conn(0x7fc9a0069ef0 msgr2=0x7fc9a006d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:30.998 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.992+0000 7fc9a5fee700 1 -- 172.21.15.52:0/579663163 shutdown_connections 2023-06-23T18:45:30.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:30.992+0000 7fc9a5fee700 1 -- 172.21.15.52:0/579663163 wait complete. 2023-06-23T18:45:31.009 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-06-23T18:45:31.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.131+0000 7fb17c687700 1 Processor -- start 2023-06-23T18:45:31.136 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.131+0000 7fb17c687700 1 -- start start 2023-06-23T18:45:31.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.132+0000 7fb17c687700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb17406a0d0 0x7fb1740bc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:31.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.132+0000 7fb17c687700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1740b64a0 con 0x7fb1740b7540 2023-06-23T18:45:31.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.132+0000 7fb17c687700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1740b7d90 con 0x7fb1740b6930 2023-06-23T18:45:31.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.132+0000 7fb17c687700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1740b55a0 con 0x7fb17406a0d0 2023-06-23T18:45:31.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.132+0000 7fb17a423700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb17406a0d0 0x7fb1740bc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:31.138 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.132+0000 7fb179c22700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb1740b7540 0x7fb17414de60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54400/0 (socket says 172.21.15.52:54400) 2023-06-23T18:45:31.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.132+0000 7fb179c22700 1 -- 172.21.15.52:0/3329211584 learned_addr learned my addr 172.21.15.52:0/3329211584 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:31.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.133+0000 7fb17a423700 1 -- 172.21.15.52:0/3329211584 >> v1:172.21.15.89:6789/0 conn(0x7fb1740b6930 legacy=0x7fb174147b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:31.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.133+0000 7fb17a423700 1 -- 172.21.15.52:0/3329211584 >> v1:172.21.15.52:6789/0 conn(0x7fb1740b7540 legacy=0x7fb17414de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:31.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.133+0000 7fb17a423700 1 -- 172.21.15.52:0/3329211584 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1740b5880 con 0x7fb17406a0d0 2023-06-23T18:45:31.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.133+0000 7fb179421700 1 -- 172.21.15.52:0/3329211584 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828230910 0 0) 0x7fb1740b64a0 con 0x7fb1740b7540 2023-06-23T18:45:31.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.133+0000 7fb17a423700 1 --2- 172.21.15.52:0/3329211584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17406a0d0 0x7fb1740bc980 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb170009840 tx=0x7fb170009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d83ffca1435f7c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:31.139 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.133+0000 7fb179421700 1 -- 172.21.15.52:0/3329211584 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb170011830 con 0x7fb17406a0d0 2023-06-23T18:45:31.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.133+0000 7fb179421700 1 -- 172.21.15.52:0/3329211584 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb170011990 con 0x7fb17406a0d0 2023-06-23T18:45:31.140 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.133+0000 7fb179421700 1 -- 172.21.15.52:0/3329211584 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb170011d20 con 0x7fb17406a0d0 2023-06-23T18:45:31.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.134+0000 7fb17c687700 1 -- 172.21.15.52:0/3329211584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17406a0d0 msgr2=0x7fb1740bc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:31.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.134+0000 7fb17c687700 1 --2- 172.21.15.52:0/3329211584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17406a0d0 0x7fb1740bc980 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb170009840 tx=0x7fb170009b50 comp rx=0 tx=0).stop 2023-06-23T18:45:31.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.134+0000 7fb17c687700 1 -- 172.21.15.52:0/3329211584 shutdown_connections 2023-06-23T18:45:31.142 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.134+0000 7fb17c687700 1 --2- 172.21.15.52:0/3329211584 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17406a0d0 0x7fb1740bc980 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:31.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.134+0000 7fb17c687700 1 -- 172.21.15.52:0/3329211584 >> 172.21.15.52:0/3329211584 conn(0x7fb17406bb20 msgr2=0x7fb17406bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:31.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.134+0000 7fb17c687700 1 -- 172.21.15.52:0/3329211584 shutdown_connections 2023-06-23T18:45:31.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.134+0000 7fb17c687700 1 -- 172.21.15.52:0/3329211584 wait complete. 2023-06-23T18:45:31.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.135+0000 7fb17c687700 1 Processor -- start 2023-06-23T18:45:31.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.135+0000 7fb17c687700 1 -- start start 2023-06-23T18:45:31.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.135+0000 7fb17c687700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17406a0d0 0x7fb1741435b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:31.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.135+0000 7fb17c687700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1740b6930 0x7fb1741e3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:31.143 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.135+0000 7fb17c687700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1740b7540 0x7fb17414abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:31.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.136+0000 7fb17c687700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb174143af0 con 0x7fb17406a0d0 2023-06-23T18:45:31.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.136+0000 7fb17c687700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1740ba170 con 0x7fb1740b7540 2023-06-23T18:45:31.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.136+0000 7fb17c687700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1740ba3c0 con 0x7fb1740b6930 2023-06-23T18:45:31.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.136+0000 7fb17a423700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17406a0d0 0x7fb1741435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:31.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.136+0000 7fb17a423700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17406a0d0 0x7fb1741435b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46268/0 (socket says 172.21.15.52:46268) 2023-06-23T18:45:31.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.136+0000 7fb17a423700 1 -- 172.21.15.52:0/680625531 learned_addr learned my addr 172.21.15.52:0/680625531 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:31.144 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.136+0000 7fb17ac24700 1 --2- 172.21.15.52:0/680625531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1740b7540 0x7fb17414abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:31.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.136+0000 7fb179c22700 1 --2- 172.21.15.52:0/680625531 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1740b6930 0x7fb1741e3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:31.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.136+0000 7fb17a423700 1 -- 172.21.15.52:0/680625531 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1740b6930 msgr2=0x7fb1741e3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:31.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.136+0000 7fb17a423700 1 --2- 172.21.15.52:0/680625531 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1740b6930 0x7fb1741e3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:31.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.136+0000 7fb17a423700 1 -- 172.21.15.52:0/680625531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1740b7540 msgr2=0x7fb17414abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:31.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.136+0000 7fb17a423700 1 --2- 172.21.15.52:0/680625531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1740b7540 0x7fb17414abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:31.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.136+0000 7fb17a423700 1 -- 172.21.15.52:0/680625531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1700094a0 con 0x7fb17406a0d0 2023-06-23T18:45:31.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.136+0000 7fb179c22700 1 --2- 172.21.15.52:0/680625531 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1740b6930 0x7fb1741e3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:31.145 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.136+0000 7fb17a423700 1 --2- 172.21.15.52:0/680625531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17406a0d0 0x7fb1741435b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb1700090b0 tx=0x7fb170004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:31.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.136+0000 7fb166ffd700 1 -- 172.21.15.52:0/680625531 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17001a810 con 0x7fb17406a0d0 2023-06-23T18:45:31.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.136+0000 7fb166ffd700 1 -- 172.21.15.52:0/680625531 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17001a970 con 0x7fb17406a0d0 2023-06-23T18:45:31.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.136+0000 7fb166ffd700 1 -- 172.21.15.52:0/680625531 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17001ace0 con 0x7fb17406a0d0 2023-06-23T18:45:31.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.137+0000 7fb17c687700 1 -- 172.21.15.52:0/680625531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1740b5ce0 con 0x7fb17406a0d0 2023-06-23T18:45:31.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.137+0000 7fb17c687700 1 -- 172.21.15.52:0/680625531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb174148b50 con 0x7fb17406a0d0 2023-06-23T18:45:31.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.138+0000 7fb17c687700 1 -- 172.21.15.52:0/680625531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb174148ec0 con 0x7fb17406a0d0 2023-06-23T18:45:31.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.138+0000 7fb166ffd700 1 -- 172.21.15.52:0/680625531 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb170022070 con 0x7fb17406a0d0 2023-06-23T18:45:31.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.139+0000 7fb166ffd700 1 --2- 172.21.15.52:0/680625531 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fb15806ace0 0x7fb15806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:31.147 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.139+0000 7fb166ffd700 1 -- 172.21.15.52:0/680625531 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb17008a1c0 con 0x7fb17406a0d0 2023-06-23T18:45:31.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.139+0000 7fb179c22700 1 --2- 172.21.15.52:0/680625531 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fb15806ace0 0x7fb15806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:31.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.139+0000 7fb179c22700 1 --2- 172.21.15.52:0/680625531 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fb15806ace0 0x7fb15806d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb174146380 tx=0x7fb168007ce0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:31.148 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.143+0000 7fb166ffd700 1 -- 172.21.15.52:0/680625531 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb170055660 con 0x7fb17406a0d0 2023-06-23T18:45:31.426 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.420+0000 7fb17c687700 1 -- 172.21.15.52:0/680625531 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fb1740a6800 con 0x7fb17406a0d0 2023-06-23T18:45:31.429 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.423+0000 7fb166ffd700 1 -- 172.21.15.52:0/680625531 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb170058c80 con 0x7fb17406a0d0 2023-06-23T18:45:31.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.425+0000 7fb17c687700 1 -- 172.21.15.52:0/680625531 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fb15806ace0 msgr2=0x7fb15806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:31.431 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.425+0000 7fb17c687700 1 --2- 172.21.15.52:0/680625531 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fb15806ace0 0x7fb15806d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb174146380 tx=0x7fb168007ce0 comp rx=0 tx=0).stop 2023-06-23T18:45:31.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.425+0000 7fb17c687700 1 -- 172.21.15.52:0/680625531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17406a0d0 msgr2=0x7fb1741435b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:31.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.425+0000 7fb17c687700 1 --2- 172.21.15.52:0/680625531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17406a0d0 0x7fb1741435b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb1700090b0 tx=0x7fb170004750 comp rx=0 tx=0).stop 2023-06-23T18:45:31.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.425+0000 7fb17c687700 1 -- 172.21.15.52:0/680625531 shutdown_connections 2023-06-23T18:45:31.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.425+0000 7fb17c687700 1 --2- 172.21.15.52:0/680625531 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fb15806ace0 0x7fb15806d190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:31.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.425+0000 7fb17c687700 1 --2- 172.21.15.52:0/680625531 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1740b7540 0x7fb17414abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:31.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.425+0000 7fb17c687700 1 --2- 172.21.15.52:0/680625531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb17406a0d0 0x7fb1741435b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:31.432 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.425+0000 7fb17c687700 1 --2- 172.21.15.52:0/680625531 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1740b6930 0x7fb1741e3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:31.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.426+0000 7fb17c687700 1 -- 172.21.15.52:0/680625531 >> 172.21.15.52:0/680625531 conn(0x7fb17406bb20 msgr2=0x7fb174146a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:31.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.426+0000 7fb17c687700 1 -- 172.21.15.52:0/680625531 shutdown_connections 2023-06-23T18:45:31.433 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.426+0000 7fb17c687700 1 -- 172.21.15.52:0/680625531 wait complete. 2023-06-23T18:45:31.443 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-06-23T18:45:31.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.564+0000 7fab965b7700 1 Processor -- start 2023-06-23T18:45:31.570 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.564+0000 7fab965b7700 1 -- start start 2023-06-23T18:45:31.572 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.565+0000 7fab965b7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab900b7540 0x7fab900bc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:31.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.565+0000 7fab965b7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fab900b6930 0x7fab90147b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:31.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.565+0000 7fab965b7700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab900b64a0 con 0x7fab9006a0d0 2023-06-23T18:45:31.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.565+0000 7fab965b7700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab900b7d90 con 0x7fab900b6930 2023-06-23T18:45:31.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.565+0000 7fab965b7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab900b55a0 con 0x7fab900b7540 2023-06-23T18:45:31.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.565+0000 7fab8ffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fab9006a0d0 0x7fab9014de60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54416/0 (socket says 172.21.15.52:54416) 2023-06-23T18:45:31.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.565+0000 7fab8ffff700 1 -- 172.21.15.52:0/113623719 learned_addr learned my addr 172.21.15.52:0/113623719 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:31.573 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.565+0000 7fab94b54700 1 --2- 172.21.15.52:0/113623719 >> v2:172.21.15.89:3300/0 conn(0x7fab900b6930 0x7fab90147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:31.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.565+0000 7fab8f7fe700 1 --2- 172.21.15.52:0/113623719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab900b7540 0x7fab900bc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:31.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.565+0000 7fab8effd700 1 -- 172.21.15.52:0/113623719 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2656645507 0 0) 0x7fab900b64a0 con 0x7fab9006a0d0 2023-06-23T18:45:31.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.565+0000 7fab8effd700 1 -- 172.21.15.52:0/113623719 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab7c0035b0 con 0x7fab9006a0d0 2023-06-23T18:45:31.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.565+0000 7fab8effd700 1 -- 172.21.15.52:0/113623719 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 124322079 0 0) 0x7fab7c0035b0 con 0x7fab9006a0d0 2023-06-23T18:45:31.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.565+0000 7fab8effd700 1 -- 172.21.15.52:0/113623719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab900b7540 msgr2=0x7fab900bc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:31.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.565+0000 7fab8effd700 1 --2- 172.21.15.52:0/113623719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab900b7540 0x7fab900bc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:31.574 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.565+0000 7fab8effd700 1 -- 172.21.15.52:0/113623719 >> v2:172.21.15.89:3300/0 conn(0x7fab900b6930 msgr2=0x7fab90147b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:31.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.565+0000 7fab8effd700 1 --2- 172.21.15.52:0/113623719 >> v2:172.21.15.89:3300/0 conn(0x7fab900b6930 0x7fab90147b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:31.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.565+0000 7fab8effd700 1 -- 172.21.15.52:0/113623719 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab900b5880 con 0x7fab9006a0d0 2023-06-23T18:45:31.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.565+0000 7fab8effd700 1 -- 172.21.15.52:0/113623719 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7fab80001670 con 0x7fab9006a0d0 2023-06-23T18:45:31.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.566+0000 7fab8effd700 1 -- 172.21.15.52:0/113623719 >> v1:172.21.15.52:6789/0 conn(0x7fab9006a0d0 legacy=0x7fab9014de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:31.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.566+0000 7fab8effd700 1 --2- 172.21.15.52:0/113623719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab7c003a00 0x7fab7c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:31.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.566+0000 7fab8effd700 1 --2- 172.21.15.52:0/113623719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab900b7540 0x7fab7c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:31.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.566+0000 7fab8effd700 1 --2- 172.21.15.52:0/113623719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab7c004d90 0x7fab7c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:31.575 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.566+0000 7fab8effd700 1 -- 172.21.15.52:0/113623719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab900b7d90 con 0x7fab7c004d90 2023-06-23T18:45:31.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.566+0000 7fab8effd700 1 -- 172.21.15.52:0/113623719 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab900b55a0 con 0x7fab7c003a00 2023-06-23T18:45:31.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.566+0000 7fab8effd700 1 -- 172.21.15.52:0/113623719 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c00ba10 con 0x7fab900b7540 2023-06-23T18:45:31.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.566+0000 7fab94b54700 1 --2- 172.21.15.52:0/113623719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab7c004d90 0x7fab7c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:31.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.566+0000 7fab8ffff700 1 --2- 172.21.15.52:0/113623719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab7c003a00 0x7fab7c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:31.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.566+0000 7fab8f7fe700 1 --2- 172.21.15.52:0/113623719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab900b7540 0x7fab7c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:31.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.566+0000 7fab94b54700 1 -- 172.21.15.52:0/113623719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab900b7540 msgr2=0x7fab7c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:31.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.566+0000 7fab94b54700 1 --2- 172.21.15.52:0/113623719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab900b7540 0x7fab7c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:31.576 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.566+0000 7fab94b54700 1 -- 172.21.15.52:0/113623719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab7c003a00 msgr2=0x7fab7c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:31.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.566+0000 7fab94b54700 1 --2- 172.21.15.52:0/113623719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab7c003a00 0x7fab7c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:31.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.566+0000 7fab94b54700 1 -- 172.21.15.52:0/113623719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7c0035b0 con 0x7fab7c004d90 2023-06-23T18:45:31.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.566+0000 7fab94b54700 1 --2- 172.21.15.52:0/113623719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab7c004d90 0x7fab7c005200 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fab88009fc0 tx=0x7fab7c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8ef88e0a8847d5 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:31.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.566+0000 7fab8effd700 1 -- 172.21.15.52:0/113623719 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8800ebd0 con 0x7fab7c004d90 2023-06-23T18:45:31.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.566+0000 7fab8effd700 1 -- 172.21.15.52:0/113623719 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8800f040 con 0x7fab7c004d90 2023-06-23T18:45:31.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.566+0000 7fab8effd700 1 -- 172.21.15.52:0/113623719 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab88014480 con 0x7fab7c004d90 2023-06-23T18:45:31.577 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.567+0000 7fab965b7700 1 -- 172.21.15.52:0/113623719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab7c004d90 msgr2=0x7fab7c005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:31.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.567+0000 7fab965b7700 1 --2- 172.21.15.52:0/113623719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab7c004d90 0x7fab7c005200 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fab88009fc0 tx=0x7fab7c005880 comp rx=0 tx=0).stop 2023-06-23T18:45:31.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.567+0000 7fab94b54700 1 -- 172.21.15.52:0/113623719 reap_dead start 2023-06-23T18:45:31.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.567+0000 7fab965b7700 1 -- 172.21.15.52:0/113623719 shutdown_connections 2023-06-23T18:45:31.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.567+0000 7fab965b7700 1 -- 172.21.15.52:0/113623719 >> 172.21.15.52:0/113623719 conn(0x7fab9006bb20 msgr2=0x7fab9006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:31.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.567+0000 7fab965b7700 1 -- 172.21.15.52:0/113623719 shutdown_connections 2023-06-23T18:45:31.578 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.567+0000 7fab965b7700 1 -- 172.21.15.52:0/113623719 wait complete. 2023-06-23T18:45:31.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.568+0000 7fab965b7700 1 Processor -- start 2023-06-23T18:45:31.580 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.568+0000 7fab965b7700 1 -- start start 2023-06-23T18:45:31.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.569+0000 7fab965b7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab7c004d90 0x7fab90148a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:31.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.569+0000 7fab965b7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab9014b430 0x7fab900b8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:31.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.569+0000 7fab965b7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab900b8a60 0x7fab901e3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:31.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.569+0000 7fab965b7700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab90148fc0 con 0x7fab900b8a60 2023-06-23T18:45:31.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.569+0000 7fab965b7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9014a2d0 con 0x7fab9014b430 2023-06-23T18:45:31.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.569+0000 7fab965b7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab900b8eb0 con 0x7fab7c004d90 2023-06-23T18:45:31.581 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.569+0000 7fab94b54700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab900b8a60 0x7fab901e3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:31.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.569+0000 7fab94b54700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab900b8a60 0x7fab901e3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46290/0 (socket says 172.21.15.52:46290) 2023-06-23T18:45:31.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.569+0000 7fab94b54700 1 -- 172.21.15.52:0/103911578 learned_addr learned my addr 172.21.15.52:0/103911578 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:31.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.569+0000 7fab8f7fe700 1 --2- 172.21.15.52:0/103911578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab9014b430 0x7fab900b8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:31.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.569+0000 7fab8ffff700 1 --2- 172.21.15.52:0/103911578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab7c004d90 0x7fab90148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:31.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.569+0000 7fab94b54700 1 -- 172.21.15.52:0/103911578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab7c004d90 msgr2=0x7fab90148a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:31.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.569+0000 7fab94b54700 1 --2- 172.21.15.52:0/103911578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab7c004d90 0x7fab90148a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:31.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.569+0000 7fab94b54700 1 -- 172.21.15.52:0/103911578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab9014b430 msgr2=0x7fab900b8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:31.582 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.569+0000 7fab94b54700 1 --2- 172.21.15.52:0/103911578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab9014b430 0x7fab900b8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:31.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.569+0000 7fab94b54700 1 -- 172.21.15.52:0/103911578 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab900b5ce0 con 0x7fab900b8a60 2023-06-23T18:45:31.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.569+0000 7fab8f7fe700 1 --2- 172.21.15.52:0/103911578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab9014b430 0x7fab900b8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:31.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.569+0000 7fab94b54700 1 --2- 172.21.15.52:0/103911578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab900b8a60 0x7fab901e3360 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fab88009f60 tx=0x7fab88009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:31.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.569+0000 7fab8cff9700 1 -- 172.21.15.52:0/103911578 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab88007000 con 0x7fab900b8a60 2023-06-23T18:45:31.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.569+0000 7fab8cff9700 1 -- 172.21.15.52:0/103911578 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab88004470 con 0x7fab900b8a60 2023-06-23T18:45:31.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.569+0000 7fab965b7700 1 -- 172.21.15.52:0/103911578 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab901d0c50 con 0x7fab900b8a60 2023-06-23T18:45:31.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.570+0000 7fab8cff9700 1 -- 172.21.15.52:0/103911578 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab88004820 con 0x7fab900b8a60 2023-06-23T18:45:31.583 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.570+0000 7fab965b7700 1 -- 172.21.15.52:0/103911578 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab9014a850 con 0x7fab900b8a60 2023-06-23T18:45:31.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.570+0000 7fab965b7700 1 -- 172.21.15.52:0/103911578 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab900a6800 con 0x7fab900b8a60 2023-06-23T18:45:31.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.571+0000 7fab8cff9700 1 -- 172.21.15.52:0/103911578 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fab88024070 con 0x7fab900b8a60 2023-06-23T18:45:31.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.571+0000 7fab8cff9700 1 --2- 172.21.15.52:0/103911578 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fab7006ace0 0x7fab7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:31.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.571+0000 7fab8cff9700 1 -- 172.21.15.52:0/103911578 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fab8808abc0 con 0x7fab900b8a60 2023-06-23T18:45:31.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.572+0000 7fab8ffff700 1 --2- 172.21.15.52:0/103911578 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fab7006ace0 0x7fab7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:31.584 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.572+0000 7fab8ffff700 1 --2- 172.21.15.52:0/103911578 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fab7006ace0 0x7fab7006d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fab80000c00 tx=0x7fab80009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:31.585 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.576+0000 7fab8cff9700 1 -- 172.21.15.52:0/103911578 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fab88055fd0 con 0x7fab900b8a60 2023-06-23T18:45:31.855 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.850+0000 7fab965b7700 1 -- 172.21.15.52:0/103911578 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fab900b8240 con 0x7fab900b8a60 2023-06-23T18:45:31.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.853+0000 7fab8cff9700 1 -- 172.21.15.52:0/103911578 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fab900b8240 con 0x7fab900b8a60 2023-06-23T18:45:31.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.855+0000 7fab965b7700 1 -- 172.21.15.52:0/103911578 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fab7006ace0 msgr2=0x7fab7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:31.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.855+0000 7fab965b7700 1 --2- 172.21.15.52:0/103911578 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fab7006ace0 0x7fab7006d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fab80000c00 tx=0x7fab80009040 comp rx=0 tx=0).stop 2023-06-23T18:45:31.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.855+0000 7fab965b7700 1 -- 172.21.15.52:0/103911578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab900b8a60 msgr2=0x7fab901e3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:31.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.855+0000 7fab965b7700 1 --2- 172.21.15.52:0/103911578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab900b8a60 0x7fab901e3360 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fab88009f60 tx=0x7fab88009750 comp rx=0 tx=0).stop 2023-06-23T18:45:31.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.855+0000 7fab965b7700 1 -- 172.21.15.52:0/103911578 shutdown_connections 2023-06-23T18:45:31.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.855+0000 7fab965b7700 1 --2- 172.21.15.52:0/103911578 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fab7006ace0 0x7fab7006d190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:31.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.855+0000 7fab965b7700 1 --2- 172.21.15.52:0/103911578 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab900b8a60 0x7fab901e3360 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:31.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.855+0000 7fab965b7700 1 --2- 172.21.15.52:0/103911578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab7c004d90 0x7fab90148a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:31.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.855+0000 7fab965b7700 1 --2- 172.21.15.52:0/103911578 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab9014b430 0x7fab900b8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:31.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.855+0000 7fab965b7700 1 -- 172.21.15.52:0/103911578 >> 172.21.15.52:0/103911578 conn(0x7fab9006bb20 msgr2=0x7fab900be650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:31.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.855+0000 7fab965b7700 1 -- 172.21.15.52:0/103911578 shutdown_connections 2023-06-23T18:45:31.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.855+0000 7fab965b7700 1 -- 172.21.15.52:0/103911578 wait complete. 2023-06-23T18:45:31.873 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-06-23T18:45:32.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.995+0000 7f3ead868700 1 Processor -- start 2023-06-23T18:45:32.001 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.995+0000 7f3ead868700 1 -- start start 2023-06-23T18:45:32.002 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.995+0000 7f3ead868700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3ea806a0d0 0x7f3ea80bc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:32.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.995+0000 7f3ead868700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea81444a0 0x7f3ea80b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:32.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.995+0000 7f3ead868700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea80b7aa0 con 0x7f3ea80b5a20 2023-06-23T18:45:32.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.995+0000 7f3ead868700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea80b5f30 con 0x7f3ea806a0d0 2023-06-23T18:45:32.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.995+0000 7f3ead868700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea80b6210 con 0x7f3ea81444a0 2023-06-23T18:45:32.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.995+0000 7f3ea6ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3ea806a0d0 0x7f3ea80bc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:32.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.995+0000 7f3ea6ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3ea806a0d0 0x7f3ea80bc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46304/0 (socket says 172.21.15.52:46304) 2023-06-23T18:45:32.003 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.995+0000 7f3ea6ffd700 1 -- 172.21.15.52:0/3417594119 learned_addr learned my addr 172.21.15.52:0/3417594119 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:32.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.996+0000 7f3ea67fc700 1 --2- 172.21.15.52:0/3417594119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea81444a0 0x7f3ea80b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:32.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.996+0000 7f3ea6ffd700 1 -- 172.21.15.52:0/3417594119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea81444a0 msgr2=0x7f3ea80b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:32.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.996+0000 7f3ea6ffd700 1 --2- 172.21.15.52:0/3417594119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea81444a0 0x7f3ea80b54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:32.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.996+0000 7f3ea6ffd700 1 -- 172.21.15.52:0/3417594119 >> v1:172.21.15.89:6789/0 conn(0x7f3ea80b5a20 legacy=0x7f3ea80bb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:32.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.996+0000 7f3ea6ffd700 1 -- 172.21.15.52:0/3417594119 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea80b64f0 con 0x7f3ea806a0d0 2023-06-23T18:45:32.004 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.996+0000 7f3ea6ffd700 1 --2- 172.21.15.52:0/3417594119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ea806a0d0 0x7f3ea80bc8b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3e980098f0 tx=0x7f3e98009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c31fbf73a62da9e server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:32.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.996+0000 7f3ea5ffb700 1 -- 172.21.15.52:0/3417594119 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e98004230 con 0x7f3ea806a0d0 2023-06-23T18:45:32.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.996+0000 7f3ea5ffb700 1 -- 172.21.15.52:0/3417594119 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e98004390 con 0x7f3ea806a0d0 2023-06-23T18:45:32.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.996+0000 7f3ea5ffb700 1 -- 172.21.15.52:0/3417594119 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e980036a0 con 0x7f3ea806a0d0 2023-06-23T18:45:32.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.997+0000 7f3ead868700 1 -- 172.21.15.52:0/3417594119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ea806a0d0 msgr2=0x7f3ea80bc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:32.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.997+0000 7f3ead868700 1 --2- 172.21.15.52:0/3417594119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ea806a0d0 0x7f3ea80bc8b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3e980098f0 tx=0x7f3e98009c00 comp rx=0 tx=0).stop 2023-06-23T18:45:32.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.997+0000 7f3ead868700 1 -- 172.21.15.52:0/3417594119 shutdown_connections 2023-06-23T18:45:32.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.997+0000 7f3ead868700 1 --2- 172.21.15.52:0/3417594119 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ea806a0d0 0x7f3ea80bc8b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:32.005 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.997+0000 7f3ead868700 1 --2- 172.21.15.52:0/3417594119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea81444a0 0x7f3ea80b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:32.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.997+0000 7f3ead868700 1 -- 172.21.15.52:0/3417594119 >> 172.21.15.52:0/3417594119 conn(0x7f3ea806bb90 msgr2=0x7f3ea806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:32.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.997+0000 7f3ead868700 1 -- 172.21.15.52:0/3417594119 shutdown_connections 2023-06-23T18:45:32.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.997+0000 7f3ead868700 1 -- 172.21.15.52:0/3417594119 wait complete. 2023-06-23T18:45:32.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.998+0000 7f3ead868700 1 Processor -- start 2023-06-23T18:45:32.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.998+0000 7f3ead868700 1 -- start start 2023-06-23T18:45:32.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.999+0000 7f3ead868700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ea806a0d0 0x7f3ea80b8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:32.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.999+0000 7f3ead868700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80b5a20 0x7f3ea81456e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:32.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.999+0000 7f3ead868700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea81444a0 0x7f3ea81e0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:32.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.999+0000 7f3ead868700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea80b9b60 con 0x7f3ea806a0d0 2023-06-23T18:45:32.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.999+0000 7f3ead868700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea80b8890 con 0x7f3ea80b5a20 2023-06-23T18:45:32.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.999+0000 7f3ead868700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea81e08e0 con 0x7f3ea81444a0 2023-06-23T18:45:32.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.999+0000 7f3ea6ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ea806a0d0 0x7f3ea80b8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:32.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.999+0000 7f3ea6ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ea806a0d0 0x7f3ea80b8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46306/0 (socket says 172.21.15.52:46306) 2023-06-23T18:45:32.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.999+0000 7f3ea6ffd700 1 -- 172.21.15.52:0/803165664 learned_addr learned my addr 172.21.15.52:0/803165664 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:32.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.999+0000 7f3ea77fe700 1 --2- 172.21.15.52:0/803165664 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea81444a0 0x7f3ea81e0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:32.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.999+0000 7f3ea67fc700 1 --2- 172.21.15.52:0/803165664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80b5a20 0x7f3ea81456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:32.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.999+0000 7f3ea6ffd700 1 -- 172.21.15.52:0/803165664 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea81444a0 msgr2=0x7f3ea81e0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:32.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.999+0000 7f3ea6ffd700 1 --2- 172.21.15.52:0/803165664 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea81444a0 0x7f3ea81e0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:32.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.999+0000 7f3ea6ffd700 1 -- 172.21.15.52:0/803165664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80b5a20 msgr2=0x7f3ea81456e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:32.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:31.999+0000 7f3ea6ffd700 1 --2- 172.21.15.52:0/803165664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80b5a20 0x7f3ea81456e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:32.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.000+0000 7f3ea6ffd700 1 -- 172.21.15.52:0/803165664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e98009550 con 0x7f3ea806a0d0 2023-06-23T18:45:32.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.000+0000 7f3ea6ffd700 1 --2- 172.21.15.52:0/803165664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ea806a0d0 0x7f3ea80b8350 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3ea808a290 tx=0x7f3e98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:32.011 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.000+0000 7f3e8ffff700 1 -- 172.21.15.52:0/803165664 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e98003e70 con 0x7f3ea806a0d0 2023-06-23T18:45:32.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.000+0000 7f3e8ffff700 1 -- 172.21.15.52:0/803165664 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9801f070 con 0x7f3ea806a0d0 2023-06-23T18:45:32.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.000+0000 7f3e8ffff700 1 -- 172.21.15.52:0/803165664 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9800b8c0 con 0x7f3ea806a0d0 2023-06-23T18:45:32.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.000+0000 7f3ead868700 1 -- 172.21.15.52:0/803165664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea81e0610 con 0x7f3ea806a0d0 2023-06-23T18:45:32.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.000+0000 7f3ead868700 1 -- 172.21.15.52:0/803165664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea80ba020 con 0x7f3ea806a0d0 2023-06-23T18:45:32.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.001+0000 7f3ead868700 1 -- 172.21.15.52:0/803165664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea8145c80 con 0x7f3ea806a0d0 2023-06-23T18:45:32.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.002+0000 7f3e8ffff700 1 -- 172.21.15.52:0/803165664 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3e98021030 con 0x7f3ea806a0d0 2023-06-23T18:45:32.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.002+0000 7f3e8ffff700 1 --2- 172.21.15.52:0/803165664 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3e9406ad10 0x7f3e9406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:32.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.002+0000 7f3e8ffff700 1 -- 172.21.15.52:0/803165664 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3e9808a650 con 0x7f3ea806a0d0 2023-06-23T18:45:32.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.002+0000 7f3ea67fc700 1 --2- 172.21.15.52:0/803165664 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3e9406ad10 0x7f3e9406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:32.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.003+0000 7f3ea67fc700 1 --2- 172.21.15.52:0/803165664 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3e9406ad10 0x7f3e9406d1c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8143a90 tx=0x7f3e9c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:32.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.007+0000 7f3e8ffff700 1 -- 172.21.15.52:0/803165664 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3e98055a50 con 0x7f3ea806a0d0 2023-06-23T18:45:32.292 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.286+0000 7f3ead868700 1 -- 172.21.15.52:0/803165664 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f3ea804e1d0 con 0x7f3ea806a0d0 2023-06-23T18:45:32.295 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.290+0000 7f3e8ffff700 1 -- 172.21.15.52:0/803165664 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3e98059070 con 0x7f3ea806a0d0 2023-06-23T18:45:32.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.292+0000 7f3ead868700 1 -- 172.21.15.52:0/803165664 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3e9406ad10 msgr2=0x7f3e9406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:32.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.292+0000 7f3ead868700 1 --2- 172.21.15.52:0/803165664 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3e9406ad10 0x7f3e9406d1c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8143a90 tx=0x7f3e9c008040 comp rx=0 tx=0).stop 2023-06-23T18:45:32.298 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.292+0000 7f3ead868700 1 -- 172.21.15.52:0/803165664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ea806a0d0 msgr2=0x7f3ea80b8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:32.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.292+0000 7f3ead868700 1 --2- 172.21.15.52:0/803165664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ea806a0d0 0x7f3ea80b8350 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3ea808a290 tx=0x7f3e98004750 comp rx=0 tx=0).stop 2023-06-23T18:45:32.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.292+0000 7f3ead868700 1 -- 172.21.15.52:0/803165664 shutdown_connections 2023-06-23T18:45:32.299 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.292+0000 7f3ead868700 1 --2- 172.21.15.52:0/803165664 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f3e9406ad10 0x7f3e9406d1c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:32.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.292+0000 7f3ead868700 1 --2- 172.21.15.52:0/803165664 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea81444a0 0x7f3ea81e0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:32.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.292+0000 7f3ead868700 1 --2- 172.21.15.52:0/803165664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3ea806a0d0 0x7f3ea80b8350 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:32.300 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.292+0000 7f3ead868700 1 --2- 172.21.15.52:0/803165664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea80b5a20 0x7f3ea81456e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:32.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.292+0000 7f3ead868700 1 -- 172.21.15.52:0/803165664 >> 172.21.15.52:0/803165664 conn(0x7f3ea806bb90 msgr2=0x7f3ea80bf200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:32.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.292+0000 7f3ead868700 1 -- 172.21.15.52:0/803165664 shutdown_connections 2023-06-23T18:45:32.301 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.292+0000 7f3ead868700 1 -- 172.21.15.52:0/803165664 wait complete. 2023-06-23T18:45:32.310 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-06-23T18:45:32.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.430+0000 7fe675c8e700 1 Processor -- start 2023-06-23T18:45:32.436 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.430+0000 7fe675c8e700 1 -- start start 2023-06-23T18:45:32.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.431+0000 7fe675c8e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe6701444a0 0x7fe6700b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:32.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.431+0000 7fe675c8e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe6700b5a20 0x7fe670154da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:32.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.431+0000 7fe675c8e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6700b7aa0 con 0x7fe67006a0d0 2023-06-23T18:45:32.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.431+0000 7fe675c8e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6700bcfc0 con 0x7fe6701444a0 2023-06-23T18:45:32.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.431+0000 7fe675c8e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6700b5f30 con 0x7fe6700b5a20 2023-06-23T18:45:32.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.431+0000 7fe66effd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fe6701444a0 0x7fe6700b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:32.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.431+0000 7fe66f7fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fe67006a0d0 0x7fe6700bc8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54418/0 (socket says 172.21.15.52:54418) 2023-06-23T18:45:32.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.431+0000 7fe66f7fe700 1 -- 172.21.15.52:0/2490598766 learned_addr learned my addr 172.21.15.52:0/2490598766 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:32.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.431+0000 7fe66ffff700 1 --2- 172.21.15.52:0/2490598766 >> v2:172.21.15.89:3300/0 conn(0x7fe6700b5a20 0x7fe670154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:32.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.431+0000 7fe66effd700 1 -- 172.21.15.52:0/2490598766 >> v2:172.21.15.89:3300/0 conn(0x7fe6700b5a20 msgr2=0x7fe670154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:32.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.431+0000 7fe66effd700 1 --2- 172.21.15.52:0/2490598766 >> v2:172.21.15.89:3300/0 conn(0x7fe6700b5a20 0x7fe670154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:32.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.431+0000 7fe66effd700 1 -- 172.21.15.52:0/2490598766 >> v1:172.21.15.52:6789/0 conn(0x7fe67006a0d0 legacy=0x7fe6700bc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:32.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.431+0000 7fe66effd700 1 -- 172.21.15.52:0/2490598766 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6700b6210 con 0x7fe6701444a0 2023-06-23T18:45:32.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.431+0000 7fe66e7fc700 1 -- 172.21.15.52:0/2490598766 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4102167485 0 0) 0x7fe6700b7aa0 con 0x7fe67006a0d0 2023-06-23T18:45:32.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.432+0000 7fe66effd700 1 --2- 172.21.15.52:0/2490598766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6701444a0 0x7fe6700b54e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe67006cc80 tx=0x7fe658009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d4fe4debb63754 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:32.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.432+0000 7fe66e7fc700 1 -- 172.21.15.52:0/2490598766 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe658011830 con 0x7fe6701444a0 2023-06-23T18:45:32.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.432+0000 7fe66e7fc700 1 -- 172.21.15.52:0/2490598766 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe658011990 con 0x7fe6701444a0 2023-06-23T18:45:32.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.432+0000 7fe66e7fc700 1 -- 172.21.15.52:0/2490598766 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe658011d20 con 0x7fe6701444a0 2023-06-23T18:45:32.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.432+0000 7fe675c8e700 1 -- 172.21.15.52:0/2490598766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6701444a0 msgr2=0x7fe6700b54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:32.440 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.432+0000 7fe675c8e700 1 --2- 172.21.15.52:0/2490598766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6701444a0 0x7fe6700b54e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe67006cc80 tx=0x7fe658009b20 comp rx=0 tx=0).stop 2023-06-23T18:45:32.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.432+0000 7fe675c8e700 1 -- 172.21.15.52:0/2490598766 shutdown_connections 2023-06-23T18:45:32.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.432+0000 7fe675c8e700 1 --2- 172.21.15.52:0/2490598766 >> v2:172.21.15.89:3300/0 conn(0x7fe6700b5a20 0x7fe670154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:32.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.432+0000 7fe675c8e700 1 --2- 172.21.15.52:0/2490598766 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe6701444a0 0x7fe6700b54e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:32.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.432+0000 7fe675c8e700 1 -- 172.21.15.52:0/2490598766 >> 172.21.15.52:0/2490598766 conn(0x7fe67006bb90 msgr2=0x7fe67006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:32.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.432+0000 7fe675c8e700 1 -- 172.21.15.52:0/2490598766 shutdown_connections 2023-06-23T18:45:32.441 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.432+0000 7fe675c8e700 1 -- 172.21.15.52:0/2490598766 wait complete. 2023-06-23T18:45:32.443 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.433+0000 7fe675c8e700 1 Processor -- start 2023-06-23T18:45:32.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.434+0000 7fe675c8e700 1 -- start start 2023-06-23T18:45:32.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.434+0000 7fe675c8e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe67006a0d0 0x7fe6701d3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:32.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.434+0000 7fe675c8e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6700b5a20 0x7fe670145110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:32.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.434+0000 7fe675c8e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6701444a0 0x7fe6701d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:32.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.434+0000 7fe675c8e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6701d3ff0 con 0x7fe67006a0d0 2023-06-23T18:45:32.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.434+0000 7fe675c8e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6701d6760 con 0x7fe6700b5a20 2023-06-23T18:45:32.444 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.434+0000 7fe675c8e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6701e01a0 con 0x7fe6701444a0 2023-06-23T18:45:32.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.434+0000 7fe66f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe67006a0d0 0x7fe6701d3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:32.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.434+0000 7fe66f7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe67006a0d0 0x7fe6701d3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46338/0 (socket says 172.21.15.52:46338) 2023-06-23T18:45:32.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.434+0000 7fe66f7fe700 1 -- 172.21.15.52:0/42006675 learned_addr learned my addr 172.21.15.52:0/42006675 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:32.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.434+0000 7fe66effd700 1 --2- 172.21.15.52:0/42006675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6700b5a20 0x7fe670145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:32.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.435+0000 7fe66ffff700 1 --2- 172.21.15.52:0/42006675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6701444a0 0x7fe6701d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:32.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.435+0000 7fe66f7fe700 1 -- 172.21.15.52:0/42006675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6701444a0 msgr2=0x7fe6701d4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:32.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.435+0000 7fe66f7fe700 1 --2- 172.21.15.52:0/42006675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6701444a0 0x7fe6701d4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:32.445 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.435+0000 7fe66f7fe700 1 -- 172.21.15.52:0/42006675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6700b5a20 msgr2=0x7fe670145110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:32.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.435+0000 7fe66f7fe700 1 --2- 172.21.15.52:0/42006675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6700b5a20 0x7fe670145110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:32.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.435+0000 7fe66f7fe700 1 -- 172.21.15.52:0/42006675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6580094a0 con 0x7fe67006a0d0 2023-06-23T18:45:32.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.435+0000 7fe66effd700 1 --2- 172.21.15.52:0/42006675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6700b5a20 0x7fe670145110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:45:32.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.435+0000 7fe66ffff700 1 --2- 172.21.15.52:0/42006675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6701444a0 0x7fe6701d4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:45:32.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.435+0000 7fe66f7fe700 1 --2- 172.21.15.52:0/42006675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe67006a0d0 0x7fe6701d3ab0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe66000c580 tx=0x7fe66000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:32.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.435+0000 7fe667fff700 1 -- 172.21.15.52:0/42006675 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660004c80 con 0x7fe67006a0d0 2023-06-23T18:45:32.446 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.435+0000 7fe667fff700 1 -- 172.21.15.52:0/42006675 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe660004e00 con 0x7fe67006a0d0 2023-06-23T18:45:32.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.435+0000 7fe675c8e700 1 -- 172.21.15.52:0/42006675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6701d4760 con 0x7fe67006a0d0 2023-06-23T18:45:32.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.435+0000 7fe667fff700 1 -- 172.21.15.52:0/42006675 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660007310 con 0x7fe67006a0d0 2023-06-23T18:45:32.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.435+0000 7fe675c8e700 1 -- 172.21.15.52:0/42006675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6701e06d0 con 0x7fe67006a0d0 2023-06-23T18:45:32.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.436+0000 7fe675c8e700 1 -- 172.21.15.52:0/42006675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6701e0d20 con 0x7fe67006a0d0 2023-06-23T18:45:32.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.436+0000 7fe667fff700 1 -- 172.21.15.52:0/42006675 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe660007470 con 0x7fe67006a0d0 2023-06-23T18:45:32.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.437+0000 7fe667fff700 1 --2- 172.21.15.52:0/42006675 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe65006ace0 0x7fe65006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:32.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.437+0000 7fe667fff700 1 -- 172.21.15.52:0/42006675 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe660088e10 con 0x7fe67006a0d0 2023-06-23T18:45:32.447 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.437+0000 7fe66effd700 1 --2- 172.21.15.52:0/42006675 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe65006ace0 0x7fe65006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:32.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.437+0000 7fe66effd700 1 --2- 172.21.15.52:0/42006675 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe65006ace0 0x7fe65006d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe6700a60b0 tx=0x7fe658008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:32.448 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.441+0000 7fe667fff700 1 -- 172.21.15.52:0/42006675 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe660054210 con 0x7fe67006a0d0 2023-06-23T18:45:32.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.716+0000 7fe675c8e700 1 -- 172.21.15.52:0/42006675 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fe67004e1d0 con 0x7fe67006a0d0 2023-06-23T18:45:32.724 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.719+0000 7fe667fff700 1 -- 172.21.15.52:0/42006675 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe660057830 con 0x7fe67006a0d0 2023-06-23T18:45:32.726 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.721+0000 7fe675c8e700 1 -- 172.21.15.52:0/42006675 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe65006ace0 msgr2=0x7fe65006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:32.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.721+0000 7fe675c8e700 1 --2- 172.21.15.52:0/42006675 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe65006ace0 0x7fe65006d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe6700a60b0 tx=0x7fe658008030 comp rx=0 tx=0).stop 2023-06-23T18:45:32.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.721+0000 7fe675c8e700 1 -- 172.21.15.52:0/42006675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe67006a0d0 msgr2=0x7fe6701d3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:32.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.721+0000 7fe675c8e700 1 --2- 172.21.15.52:0/42006675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe67006a0d0 0x7fe6701d3ab0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe66000c580 tx=0x7fe66000c940 comp rx=0 tx=0).stop 2023-06-23T18:45:32.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.721+0000 7fe675c8e700 1 -- 172.21.15.52:0/42006675 shutdown_connections 2023-06-23T18:45:32.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.721+0000 7fe675c8e700 1 --2- 172.21.15.52:0/42006675 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fe65006ace0 0x7fe65006d190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:32.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.721+0000 7fe675c8e700 1 --2- 172.21.15.52:0/42006675 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6701444a0 0x7fe6701d4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:32.727 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.721+0000 7fe675c8e700 1 --2- 172.21.15.52:0/42006675 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe67006a0d0 0x7fe6701d3ab0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:32.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.721+0000 7fe675c8e700 1 --2- 172.21.15.52:0/42006675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6700b5a20 0x7fe670145110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:32.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.721+0000 7fe675c8e700 1 -- 172.21.15.52:0/42006675 >> 172.21.15.52:0/42006675 conn(0x7fe67006bb90 msgr2=0x7fe67006a740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:32.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.721+0000 7fe675c8e700 1 -- 172.21.15.52:0/42006675 shutdown_connections 2023-06-23T18:45:32.728 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.721+0000 7fe675c8e700 1 -- 172.21.15.52:0/42006675 wait complete. 2023-06-23T18:45:32.738 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-06-23T18:45:32.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.859+0000 7f8c033a5700 1 Processor -- start 2023-06-23T18:45:32.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.859+0000 7f8c033a5700 1 -- start start 2023-06-23T18:45:32.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.860+0000 7f8c033a5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8bfc06c250 0x7f8bfc0718a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:32.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.860+0000 7f8c033a5700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bfc0b8950 con 0x7f8bfc071de0 2023-06-23T18:45:32.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.860+0000 7f8c033a5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bfc0b4930 con 0x7f8bfc0b7c60 2023-06-23T18:45:32.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.860+0000 7f8c033a5700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bfc0b8620 con 0x7f8bfc06c250 2023-06-23T18:45:32.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.860+0000 7f8c01141700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8bfc06c250 0x7f8bfc0718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:32.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.860+0000 7f8c00940700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f8bfc071de0 0x7f8bfc1471b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54422/0 (socket says 172.21.15.52:54422) 2023-06-23T18:45:32.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.860+0000 7f8c01141700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f8bfc06c250 0x7f8bfc0718a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46342/0 (socket says 172.21.15.52:46342) 2023-06-23T18:45:32.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.860+0000 7f8c00940700 1 -- 172.21.15.52:0/1021831998 learned_addr learned my addr 172.21.15.52:0/1021831998 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:32.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.861+0000 7f8c01141700 1 -- 172.21.15.52:0/1021831998 >> v1:172.21.15.89:6789/0 conn(0x7f8bfc0b7c60 legacy=0x7f8bfc1519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:32.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.861+0000 7f8c01141700 1 -- 172.21.15.52:0/1021831998 >> v1:172.21.15.52:6789/0 conn(0x7f8bfc071de0 legacy=0x7f8bfc1471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:32.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.861+0000 7f8c01141700 1 -- 172.21.15.52:0/1021831998 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc0b8de0 con 0x7f8bfc06c250 2023-06-23T18:45:32.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.861+0000 7f8beffff700 1 -- 172.21.15.52:0/1021831998 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485674894 0 0) 0x7f8bfc0b8950 con 0x7f8bfc071de0 2023-06-23T18:45:32.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.861+0000 7f8c01141700 1 --2- 172.21.15.52:0/1021831998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bfc06c250 0x7f8bfc0718a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8009840 tx=0x7f8bf8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34cd0f883274c9f server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:32.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.861+0000 7f8beffff700 1 -- 172.21.15.52:0/1021831998 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8011830 con 0x7f8bfc06c250 2023-06-23T18:45:32.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.861+0000 7f8beffff700 1 -- 172.21.15.52:0/1021831998 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf8011990 con 0x7f8bfc06c250 2023-06-23T18:45:32.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.861+0000 7f8beffff700 1 -- 172.21.15.52:0/1021831998 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8011d20 con 0x7f8bfc06c250 2023-06-23T18:45:32.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.861+0000 7f8c033a5700 1 -- 172.21.15.52:0/1021831998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bfc06c250 msgr2=0x7f8bfc0718a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:32.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.861+0000 7f8c033a5700 1 --2- 172.21.15.52:0/1021831998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bfc06c250 0x7f8bfc0718a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8009840 tx=0x7f8bf8009b50 comp rx=0 tx=0).stop 2023-06-23T18:45:32.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.861+0000 7f8c033a5700 1 -- 172.21.15.52:0/1021831998 shutdown_connections 2023-06-23T18:45:32.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.862+0000 7f8c033a5700 1 --2- 172.21.15.52:0/1021831998 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bfc06c250 0x7f8bfc0718a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:32.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.862+0000 7f8c033a5700 1 -- 172.21.15.52:0/1021831998 >> 172.21.15.52:0/1021831998 conn(0x7f8bfc0bdf70 msgr2=0x7f8bfc0b9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:32.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.862+0000 7f8c033a5700 1 -- 172.21.15.52:0/1021831998 shutdown_connections 2023-06-23T18:45:32.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.862+0000 7f8c033a5700 1 -- 172.21.15.52:0/1021831998 wait complete. 2023-06-23T18:45:32.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.863+0000 7f8c033a5700 1 Processor -- start 2023-06-23T18:45:32.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.863+0000 7f8c033a5700 1 -- start start 2023-06-23T18:45:32.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.863+0000 7f8c033a5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bfc06c250 0x7f8bfc143670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:32.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.863+0000 7f8c033a5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bfc071de0 0x7f8bfc142a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:32.872 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.863+0000 7f8c033a5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8bfc0b7c60 0x7f8bfc13f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:32.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.863+0000 7f8c033a5700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc143bb0 con 0x7f8bfc06c250 2023-06-23T18:45:32.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.863+0000 7f8c033a5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc141d40 con 0x7f8bfc071de0 2023-06-23T18:45:32.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.863+0000 7f8c033a5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc142fb0 con 0x7f8bfc0b7c60 2023-06-23T18:45:32.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.863+0000 7f8c01141700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bfc06c250 0x7f8bfc143670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:32.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.863+0000 7f8c01141700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bfc06c250 0x7f8bfc143670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46352/0 (socket says 172.21.15.52:46352) 2023-06-23T18:45:32.873 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.863+0000 7f8c01141700 1 -- 172.21.15.52:0/3841305567 learned_addr learned my addr 172.21.15.52:0/3841305567 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:32.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.864+0000 7f8c00940700 1 --2- 172.21.15.52:0/3841305567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bfc071de0 0x7f8bfc142a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:32.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.864+0000 7f8c01942700 1 --2- 172.21.15.52:0/3841305567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8bfc0b7c60 0x7f8bfc13f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:32.874 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.864+0000 7f8c01141700 1 -- 172.21.15.52:0/3841305567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8bfc0b7c60 msgr2=0x7f8bfc13f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:32.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.864+0000 7f8c01141700 1 --2- 172.21.15.52:0/3841305567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8bfc0b7c60 0x7f8bfc13f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:32.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.864+0000 7f8c01141700 1 -- 172.21.15.52:0/3841305567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bfc071de0 msgr2=0x7f8bfc142a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:32.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.864+0000 7f8c01141700 1 --2- 172.21.15.52:0/3841305567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bfc071de0 0x7f8bfc142a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:32.875 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.864+0000 7f8c01141700 1 -- 172.21.15.52:0/3841305567 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf80094a0 con 0x7f8bfc06c250 2023-06-23T18:45:32.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.864+0000 7f8c00940700 1 --2- 172.21.15.52:0/3841305567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bfc071de0 0x7f8bfc142a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:32.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.864+0000 7f8c01141700 1 --2- 172.21.15.52:0/3841305567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bfc06c250 0x7f8bfc143670 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80090b0 tx=0x7f8bf8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:32.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.864+0000 7f8bedffb700 1 -- 172.21.15.52:0/3841305567 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf801a900 con 0x7f8bfc06c250 2023-06-23T18:45:32.876 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.864+0000 7f8bedffb700 1 -- 172.21.15.52:0/3841305567 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf801aa60 con 0x7f8bfc06c250 2023-06-23T18:45:32.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.864+0000 7f8bedffb700 1 -- 172.21.15.52:0/3841305567 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf801add0 con 0x7f8bfc06c250 2023-06-23T18:45:32.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.865+0000 7f8c033a5700 1 -- 172.21.15.52:0/3841305567 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bfc141f90 con 0x7f8bfc06c250 2023-06-23T18:45:32.877 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.865+0000 7f8c033a5700 1 -- 172.21.15.52:0/3841305567 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bfc142550 con 0x7f8bfc06c250 2023-06-23T18:45:32.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.866+0000 7f8c033a5700 1 -- 172.21.15.52:0/3841305567 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bfc142710 con 0x7f8bfc06c250 2023-06-23T18:45:32.879 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.866+0000 7f8bedffb700 1 -- 172.21.15.52:0/3841305567 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8bf8022070 con 0x7f8bfc06c250 2023-06-23T18:45:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.867+0000 7f8bedffb700 1 --2- 172.21.15.52:0/3841305567 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f8be006ace0 0x7f8be006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.867+0000 7f8bedffb700 1 -- 172.21.15.52:0/3841305567 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8bf808a380 con 0x7f8bfc06c250 2023-06-23T18:45:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.867+0000 7f8c00940700 1 --2- 172.21.15.52:0/3841305567 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f8be006ace0 0x7f8be006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:32.880 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.867+0000 7f8c00940700 1 --2- 172.21.15.52:0/3841305567 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f8be006ace0 0x7f8be006d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc147750 tx=0x7f8bf0007d00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:32.881 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:32.871+0000 7f8bedffb700 1 -- 172.21.15.52:0/3841305567 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8bf8055870 con 0x7f8bfc06c250 2023-06-23T18:45:33.154 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.149+0000 7f8c033a5700 1 -- 172.21.15.52:0/3841305567 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f8bfc1428c0 con 0x7f8bfc06c250 2023-06-23T18:45:33.158 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.152+0000 7f8bedffb700 1 -- 172.21.15.52:0/3841305567 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8bf8058e50 con 0x7f8bfc06c250 2023-06-23T18:45:33.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.154+0000 7f8c033a5700 1 -- 172.21.15.52:0/3841305567 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f8be006ace0 msgr2=0x7f8be006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:33.160 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.154+0000 7f8c033a5700 1 --2- 172.21.15.52:0/3841305567 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f8be006ace0 0x7f8be006d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc147750 tx=0x7f8bf0007d00 comp rx=0 tx=0).stop 2023-06-23T18:45:33.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.154+0000 7f8c033a5700 1 -- 172.21.15.52:0/3841305567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bfc06c250 msgr2=0x7f8bfc143670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:33.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.154+0000 7f8c033a5700 1 --2- 172.21.15.52:0/3841305567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bfc06c250 0x7f8bfc143670 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80090b0 tx=0x7f8bf8004750 comp rx=0 tx=0).stop 2023-06-23T18:45:33.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.154+0000 7f8c033a5700 1 -- 172.21.15.52:0/3841305567 shutdown_connections 2023-06-23T18:45:33.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.154+0000 7f8c033a5700 1 --2- 172.21.15.52:0/3841305567 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f8be006ace0 0x7f8be006d190 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:33.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.154+0000 7f8c033a5700 1 --2- 172.21.15.52:0/3841305567 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8bfc0b7c60 0x7f8bfc13f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:33.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.154+0000 7f8c033a5700 1 --2- 172.21.15.52:0/3841305567 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8bfc06c250 0x7f8bfc143670 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:33.161 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.154+0000 7f8c033a5700 1 --2- 172.21.15.52:0/3841305567 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bfc071de0 0x7f8bfc142a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:33.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.154+0000 7f8c033a5700 1 -- 172.21.15.52:0/3841305567 >> 172.21.15.52:0/3841305567 conn(0x7f8bfc0bdf70 msgr2=0x7f8bfc0ba0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:33.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.155+0000 7f8c033a5700 1 -- 172.21.15.52:0/3841305567 shutdown_connections 2023-06-23T18:45:33.162 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.155+0000 7f8c033a5700 1 -- 172.21.15.52:0/3841305567 wait complete. 2023-06-23T18:45:33.173 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:45:33.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.292+0000 7f7fc91e6700 1 Processor -- start 2023-06-23T18:45:33.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.292+0000 7f7fc91e6700 1 -- start start 2023-06-23T18:45:33.302 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.293+0000 7f7fc91e6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fc41444a0 0x7f7fc40b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:33.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.293+0000 7f7fc91e6700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc40b7aa0 con 0x7f7fc40b5a20 2023-06-23T18:45:33.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.293+0000 7f7fc91e6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc40b5f30 con 0x7f7fc406a0d0 2023-06-23T18:45:33.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.293+0000 7f7fc91e6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc40bcfc0 con 0x7f7fc41444a0 2023-06-23T18:45:33.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.293+0000 7f7fc359e700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7fc40b5a20 0x7f7fc4154da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54430/0 (socket says 172.21.15.52:54430) 2023-06-23T18:45:33.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.293+0000 7f7fc359e700 1 -- 172.21.15.52:0/3236980212 learned_addr learned my addr 172.21.15.52:0/3236980212 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:33.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.293+0000 7f7fc259c700 1 --2- 172.21.15.52:0/3236980212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fc41444a0 0x7f7fc40b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:33.303 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.294+0000 7f7fc1d9b700 1 -- 172.21.15.52:0/3236980212 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609518911 0 0) 0x7f7fc40b7aa0 con 0x7f7fc40b5a20 2023-06-23T18:45:33.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.294+0000 7f7fc1d9b700 1 -- 172.21.15.52:0/3236980212 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fb00035b0 con 0x7f7fc40b5a20 2023-06-23T18:45:33.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.294+0000 7f7fc1d9b700 1 -- 172.21.15.52:0/3236980212 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2364593748 0 0) 0x7f7fc40b5f30 con 0x7f7fc406a0d0 2023-06-23T18:45:33.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.294+0000 7f7fc1d9b700 1 -- 172.21.15.52:0/3236980212 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fc40b7aa0 con 0x7f7fc406a0d0 2023-06-23T18:45:33.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.294+0000 7f7fc1d9b700 1 -- 172.21.15.52:0/3236980212 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1716491372 0 0) 0x7f7fb00035b0 con 0x7f7fc40b5a20 2023-06-23T18:45:33.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.294+0000 7f7fc1d9b700 1 -- 172.21.15.52:0/3236980212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fc41444a0 msgr2=0x7f7fc40b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:33.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.294+0000 7f7fc1d9b700 1 --2- 172.21.15.52:0/3236980212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fc41444a0 0x7f7fc40b54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:33.304 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.294+0000 7f7fc1d9b700 1 -- 172.21.15.52:0/3236980212 >> v1:172.21.15.89:6789/0 conn(0x7f7fc406a0d0 legacy=0x7f7fc40bc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:33.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.294+0000 7f7fc1d9b700 1 -- 172.21.15.52:0/3236980212 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc40b6210 con 0x7f7fc40b5a20 2023-06-23T18:45:33.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.294+0000 7f7fc1d9b700 1 -- 172.21.15.52:0/3236980212 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7f7fbc0019f0 con 0x7f7fc40b5a20 2023-06-23T18:45:33.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.294+0000 7f7fc1d9b700 1 -- 172.21.15.52:0/3236980212 >> v1:172.21.15.52:6789/0 conn(0x7f7fc40b5a20 legacy=0x7f7fc4154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:33.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.294+0000 7f7fc1d9b700 1 --2- 172.21.15.52:0/3236980212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fc41444a0 0x7f7fb0003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:33.305 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.294+0000 7f7fc1d9b700 1 --2- 172.21.15.52:0/3236980212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fb0004120 0x7f7fb0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:33.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.294+0000 7f7fc1d9b700 1 --2- 172.21.15.52:0/3236980212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fb0004d90 0x7f7fb0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:33.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.294+0000 7f7fc1d9b700 1 -- 172.21.15.52:0/3236980212 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc40bcfc0 con 0x7f7fb0004d90 2023-06-23T18:45:33.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.294+0000 7f7fc1d9b700 1 -- 172.21.15.52:0/3236980212 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb000bac0 con 0x7f7fb0004120 2023-06-23T18:45:33.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.294+0000 7f7fc1d9b700 1 -- 172.21.15.52:0/3236980212 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb000bc80 con 0x7f7fc41444a0 2023-06-23T18:45:33.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.294+0000 7f7fc359e700 1 --2- 172.21.15.52:0/3236980212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fb0004d90 0x7f7fb0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:33.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.294+0000 7f7fc2d9d700 1 --2- 172.21.15.52:0/3236980212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fc41444a0 0x7f7fb0003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:33.306 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.294+0000 7f7fc259c700 1 --2- 172.21.15.52:0/3236980212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fb0004120 0x7f7fb0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:33.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.294+0000 7f7fc359e700 1 -- 172.21.15.52:0/3236980212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fc41444a0 msgr2=0x7f7fb0003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:33.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.294+0000 7f7fc359e700 1 --2- 172.21.15.52:0/3236980212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fc41444a0 0x7f7fb0003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:33.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.294+0000 7f7fc359e700 1 -- 172.21.15.52:0/3236980212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fb0004120 msgr2=0x7f7fb0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:33.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.294+0000 7f7fc359e700 1 --2- 172.21.15.52:0/3236980212 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fb0004120 0x7f7fb0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:33.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.294+0000 7f7fc359e700 1 -- 172.21.15.52:0/3236980212 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb00035b0 con 0x7f7fb0004d90 2023-06-23T18:45:33.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.294+0000 7f7fc359e700 1 --2- 172.21.15.52:0/3236980212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fb0004d90 0x7f7fb0005200 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc002230 tx=0x7f7fb0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6708a43534b4a57 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:33.307 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.295+0000 7f7fc1d9b700 1 -- 172.21.15.52:0/3236980212 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc0072d0 con 0x7f7fb0004d90 2023-06-23T18:45:33.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.295+0000 7f7fc1d9b700 1 -- 172.21.15.52:0/3236980212 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fbc007430 con 0x7f7fb0004d90 2023-06-23T18:45:33.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.295+0000 7f7fc1d9b700 1 -- 172.21.15.52:0/3236980212 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc0077c0 con 0x7f7fb0004d90 2023-06-23T18:45:33.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.295+0000 7f7fc91e6700 1 -- 172.21.15.52:0/3236980212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fb0004d90 msgr2=0x7f7fb0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:33.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.295+0000 7f7fc91e6700 1 --2- 172.21.15.52:0/3236980212 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fb0004d90 0x7f7fb0005200 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc002230 tx=0x7f7fb0005880 comp rx=0 tx=0).stop 2023-06-23T18:45:33.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.295+0000 7f7fc359e700 1 -- 172.21.15.52:0/3236980212 reap_dead start 2023-06-23T18:45:33.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.295+0000 7f7fc91e6700 1 -- 172.21.15.52:0/3236980212 shutdown_connections 2023-06-23T18:45:33.308 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.295+0000 7f7fc91e6700 1 -- 172.21.15.52:0/3236980212 >> 172.21.15.52:0/3236980212 conn(0x7f7fc406bb90 msgr2=0x7f7fc406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:33.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.295+0000 7f7fc91e6700 1 -- 172.21.15.52:0/3236980212 shutdown_connections 2023-06-23T18:45:33.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.295+0000 7f7fc91e6700 1 -- 172.21.15.52:0/3236980212 wait complete. 2023-06-23T18:45:33.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.297+0000 7f7fc91e6700 1 Processor -- start 2023-06-23T18:45:33.309 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.297+0000 7f7fc91e6700 1 -- start start 2023-06-23T18:45:33.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.297+0000 7f7fc91e6700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fc41d2c80 0x7f7fc413f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:33.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.297+0000 7f7fc91e6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fc41414b0 0x7f7fc413f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:33.311 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.297+0000 7f7fc91e6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fc41d1570 0x7f7fc41d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:33.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.297+0000 7f7fc91e6700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc40b9df0 con 0x7f7fc41d2c80 2023-06-23T18:45:33.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.297+0000 7f7fc91e6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc41e0d70 con 0x7f7fc41414b0 2023-06-23T18:45:33.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.297+0000 7f7fc91e6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc41d1f50 con 0x7f7fc41d1570 2023-06-23T18:45:33.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.297+0000 7f7fc2d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fc41d2c80 0x7f7fc413f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:33.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.297+0000 7f7fc2d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fc41d2c80 0x7f7fc413f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46380/0 (socket says 172.21.15.52:46380) 2023-06-23T18:45:33.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.297+0000 7f7fc2d9d700 1 -- 172.21.15.52:0/3684112178 learned_addr learned my addr 172.21.15.52:0/3684112178 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:33.312 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.298+0000 7f7fc259c700 1 --2- 172.21.15.52:0/3684112178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fc41414b0 0x7f7fc413f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:33.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.298+0000 7f7fc359e700 1 --2- 172.21.15.52:0/3684112178 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fc41d1570 0x7f7fc41d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:33.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.298+0000 7f7fc2d9d700 1 -- 172.21.15.52:0/3684112178 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fc41d1570 msgr2=0x7f7fc41d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:33.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.298+0000 7f7fc2d9d700 1 --2- 172.21.15.52:0/3684112178 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fc41d1570 0x7f7fc41d1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:33.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.298+0000 7f7fc2d9d700 1 -- 172.21.15.52:0/3684112178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fc41414b0 msgr2=0x7f7fc413f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:33.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.298+0000 7f7fc2d9d700 1 --2- 172.21.15.52:0/3684112178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fc41414b0 0x7f7fc413f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:33.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.298+0000 7f7fc2d9d700 1 -- 172.21.15.52:0/3684112178 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc41e0440 con 0x7f7fc41d2c80 2023-06-23T18:45:33.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.298+0000 7f7fc259c700 1 --2- 172.21.15.52:0/3684112178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fc41414b0 0x7f7fc413f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:45:33.313 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.298+0000 7f7fc2d9d700 1 --2- 172.21.15.52:0/3684112178 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fc41d2c80 0x7f7fc413f450 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7fac00f810 tx=0x7f7fac00fbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:33.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.298+0000 7f7fbb7fe700 1 -- 172.21.15.52:0/3684112178 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac001520 con 0x7f7fc41d2c80 2023-06-23T18:45:33.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.298+0000 7f7fbb7fe700 1 -- 172.21.15.52:0/3684112178 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac0052e0 con 0x7f7fc41d2c80 2023-06-23T18:45:33.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.298+0000 7f7fc91e6700 1 -- 172.21.15.52:0/3684112178 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc41e0720 con 0x7f7fc41d2c80 2023-06-23T18:45:33.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.298+0000 7f7fbb7fe700 1 -- 172.21.15.52:0/3684112178 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac003680 con 0x7f7fc41d2c80 2023-06-23T18:45:33.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.298+0000 7f7fc91e6700 1 -- 172.21.15.52:0/3684112178 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc4147cb0 con 0x7f7fc41d2c80 2023-06-23T18:45:33.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.299+0000 7f7fc91e6700 1 -- 172.21.15.52:0/3684112178 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc404e1d0 con 0x7f7fc41d2c80 2023-06-23T18:45:33.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.299+0000 7f7fbb7fe700 1 -- 172.21.15.52:0/3684112178 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7fac003800 con 0x7f7fc41d2c80 2023-06-23T18:45:33.314 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.300+0000 7f7fbb7fe700 1 --2- 172.21.15.52:0/3684112178 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7fa406ace0 0x7f7fa406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:33.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.300+0000 7f7fbb7fe700 1 -- 172.21.15.52:0/3684112178 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7fac089170 con 0x7f7fc41d2c80 2023-06-23T18:45:33.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.300+0000 7f7fc259c700 1 --2- 172.21.15.52:0/3684112178 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7fa406ace0 0x7f7fa406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:33.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.301+0000 7f7fc259c700 1 --2- 172.21.15.52:0/3684112178 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7fa406ace0 0x7f7fa406d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7fc41d3420 tx=0x7f7fb4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:33.315 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.305+0000 7f7fbb7fe700 1 -- 172.21.15.52:0/3684112178 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7fac0544e0 con 0x7f7fc41d2c80 2023-06-23T18:45:33.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.504+0000 7f7fc91e6700 1 -- 172.21.15.52:0/3684112178 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fc40b6870 con 0x7f7fc41d2c80 2023-06-23T18:45:33.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.505+0000 7f7fbb7fe700 1 -- 172.21.15.52:0/3684112178 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+14533 (secure 0 0 0) 0x7f7fac057b00 con 0x7f7fc41d2c80 2023-06-23T18:45:33.510 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:33.511 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":28,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","created":"2023-06-23T18:44:31.918434+0000","modified":"2023-06-23T18:45:30.096116+0000","last_up_change":"2023-06-23T18:44:42.169624+0000","last_in_change":"2023-06-23T18:44:34.510501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-23T18:44:43.346578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-23T18:44:43.829719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c371fb28-1b15-4e43-8d5a-43e402920ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6812","nonce":1066999520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6815","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6818","nonce":1066999520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6829","nonce":1066999520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6823","nonce":1066999520}]},"public_addr":"172.21.15.52:6812/1066999520","cluster_addr":"172.21.15.52:6818/1066999520","heartbeat_back_addr":"172.21.15.52:6829/1066999520","heartbeat_front_addr":"172.21.15.52:6823/1066999520","state":["exists","up"]},{"osd":1,"uuid":"4a142f04-33eb-47ec-9cc5-b08b44d82658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6813","nonce":2360219751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6819","nonce":2360219751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6830","nonce":2360219751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6825","nonce":2360219751}]},"public_addr":"172.21.15.52:6813/2360219751","cluster_addr":"172.21.15.52:6819/2360219751","heartbeat_back_addr":"172.21.15.52:6830/2360219751","heartbeat_front_addr":"172.21.15.52:6825/2360219751","state":["exists","up"]},{"osd":2,"uuid":"d7bb089d-4c55-4370-ba59-7fe88c39512a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6801","nonce":835073005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6803","nonce":835073005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6807","nonce":835073005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6805","nonce":835073005}]},"public_addr":"172.21.15.52:6801/835073005","cluster_addr":"172.21.15.52:6803/835073005","heartbeat_back_addr":"172.21.15.52:6807/835073005","heartbeat_front_addr":"172.21.15.52:6805/835073005","state":["exists","up"]},{"osd":3,"uuid":"4bcdcdc3-6a8f-468e-877e-57f76079ac3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6811","nonce":2852700864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6817","nonce":2852700864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6831","nonce":2852700864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6824","nonce":2852700864}]},"public_addr":"172.21.15.52:6811/2852700864","cluster_addr":"172.21.15.52:6817/2852700864","heartbeat_back_addr":"172.21.15.52:6831/2852700864","heartbeat_front_addr":"172.21.15.52:6824/2852700864","state":["exists","up"]},{"osd":4,"uuid":"cac63000-ae94-4b08-93e6-a99119640b63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6809","nonce":2538664679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6811","nonce":2538664679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6815","nonce":2538664679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6813","nonce":2538664679}]},"public_addr":"172.21.15.89:6809/2538664679","cluster_addr":"172.21.15.89:6811/2538664679","heartbeat_back_addr":"172.21.15.89:6815/2538664679","heartbeat_front_addr":"172.21.15.89:6813/2538664679","state":["exists","up"]},{"osd":5,"uuid":"45c53102-18a6-4fd7-9c25-8ea5e1ef6851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6801","nonce":1683710352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6803","nonce":1683710352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6807","nonce":1683710352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6805","nonce":1683710352}]},"public_addr":"172.21.15.89:6801/1683710352","cluster_addr":"172.21.15.89:6803/1683710352","heartbeat_back_addr":"172.21.15.89:6807/1683710352","heartbeat_front_addr":"172.21.15.89:6805/1683710352","state":["exists","up"]},{"osd":6,"uuid":"abee09d1-8eba-484f-a25c-871c1fe2e843","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6817","nonce":3890899288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6819","nonce":3890899288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6823","nonce":3890899288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6821","nonce":3890899288}]},"public_addr":"172.21.15.89:6817/3890899288","cluster_addr":"172.21.15.89:6819/3890899288","heartbeat_back_addr":"172.21.15.89:6823/3890899288","heartbeat_front_addr":"172.21.15.89:6821/3890899288","state":["exists","up"]},{"osd":7,"uuid":"5acf9e2e-00dd-4f9b-a7d9-3d820f695de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6825","nonce":2989085420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6827","nonce":2989085420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6831","nonce":2989085420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6829","nonce":2989085420}]},"public_addr":"172.21.15.89:6825/2989085420","cluster_addr":"172.21.15.89:6827/2989085420","heartbeat_back_addr":"172.21.15.89:6831/2989085420","heartbeat_front_addr":"172.21.15.89:6829/2989085420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.663866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.710904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.619347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.660102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.686933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.724635+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.669111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.678740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:45:33.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.507+0000 7f7fc91e6700 1 -- 172.21.15.52:0/3684112178 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7fa406ace0 msgr2=0x7f7fa406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:33.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.507+0000 7f7fc91e6700 1 --2- 172.21.15.52:0/3684112178 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7fa406ace0 0x7f7fa406d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7fc41d3420 tx=0x7f7fb4008040 comp rx=0 tx=0).stop 2023-06-23T18:45:33.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.507+0000 7f7fc91e6700 1 -- 172.21.15.52:0/3684112178 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fc41d2c80 msgr2=0x7f7fc413f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:33.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.507+0000 7f7fc91e6700 1 --2- 172.21.15.52:0/3684112178 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fc41d2c80 0x7f7fc413f450 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7fac00f810 tx=0x7f7fac00fbd0 comp rx=0 tx=0).stop 2023-06-23T18:45:33.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.507+0000 7f7fc91e6700 1 -- 172.21.15.52:0/3684112178 shutdown_connections 2023-06-23T18:45:33.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.507+0000 7f7fc91e6700 1 --2- 172.21.15.52:0/3684112178 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f7fa406ace0 0x7f7fa406d190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:33.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.507+0000 7f7fc91e6700 1 --2- 172.21.15.52:0/3684112178 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fc41d1570 0x7f7fc41d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:33.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.507+0000 7f7fc91e6700 1 --2- 172.21.15.52:0/3684112178 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7fc41d2c80 0x7f7fc413f450 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:33.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.507+0000 7f7fc91e6700 1 --2- 172.21.15.52:0/3684112178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fc41414b0 0x7f7fc413f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:33.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.507+0000 7f7fc91e6700 1 -- 172.21.15.52:0/3684112178 >> 172.21.15.52:0/3684112178 conn(0x7f7fc406bb90 msgr2=0x7f7fc40befb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:33.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.507+0000 7f7fc91e6700 1 -- 172.21.15.52:0/3684112178 shutdown_connections 2023-06-23T18:45:33.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.507+0000 7f7fc91e6700 1 -- 172.21.15.52:0/3684112178 wait complete. 2023-06-23T18:45:33.525 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-23T18:44:43.346578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-23T18:44:43.829719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-23T18:45:33.526 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T18:45:33.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.650+0000 7fba4db04700 1 Processor -- start 2023-06-23T18:45:33.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.650+0000 7fba4db04700 1 -- start start 2023-06-23T18:45:33.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.650+0000 7fba4db04700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fba4806a0d0 0x7fba4806c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:33.658 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.650+0000 7fba4db04700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba480b70e0 con 0x7fba480b9a20 2023-06-23T18:45:33.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.650+0000 7fba4db04700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba4806a960 con 0x7fba4806a4a0 2023-06-23T18:45:33.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.650+0000 7fba4db04700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba4806b090 con 0x7fba4806a0d0 2023-06-23T18:45:33.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.650+0000 7fba47fff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fba480b9a20 0x7fba48154dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:54438/0 (socket says 172.21.15.52:54438) 2023-06-23T18:45:33.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.650+0000 7fba47fff700 1 -- 172.21.15.52:0/1504807253 learned_addr learned my addr 172.21.15.52:0/1504807253 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:33.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.651+0000 7fba477fe700 1 --2- 172.21.15.52:0/1504807253 >> v2:172.21.15.89:3300/0 conn(0x7fba4806a0d0 0x7fba4806c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:33.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.651+0000 7fba467fc700 1 -- 172.21.15.52:0/1504807253 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 500446468 0 0) 0x7fba480b70e0 con 0x7fba480b9a20 2023-06-23T18:45:33.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.651+0000 7fba467fc700 1 -- 172.21.15.52:0/1504807253 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba340035b0 con 0x7fba480b9a20 2023-06-23T18:45:33.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.651+0000 7fba467fc700 1 -- 172.21.15.52:0/1504807253 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 185783139 0 0) 0x7fba340035b0 con 0x7fba480b9a20 2023-06-23T18:45:33.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.651+0000 7fba467fc700 1 -- 172.21.15.52:0/1504807253 >> v2:172.21.15.89:3300/0 conn(0x7fba4806a0d0 msgr2=0x7fba4806c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:33.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.651+0000 7fba467fc700 1 --2- 172.21.15.52:0/1504807253 >> v2:172.21.15.89:3300/0 conn(0x7fba4806a0d0 0x7fba4806c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:33.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.651+0000 7fba467fc700 1 -- 172.21.15.52:0/1504807253 >> v1:172.21.15.89:6789/0 conn(0x7fba4806a4a0 legacy=0x7fba480b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:33.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.651+0000 7fba467fc700 1 -- 172.21.15.52:0/1504807253 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4806bcf0 con 0x7fba480b9a20 2023-06-23T18:45:33.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.651+0000 7fba467fc700 1 -- 172.21.15.52:0/1504807253 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7fba400019f0 con 0x7fba480b9a20 2023-06-23T18:45:33.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.651+0000 7fba467fc700 1 -- 172.21.15.52:0/1504807253 >> v1:172.21.15.52:6789/0 conn(0x7fba480b9a20 legacy=0x7fba48154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:33.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.651+0000 7fba467fc700 1 --2- 172.21.15.52:0/1504807253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba34003a00 0x7fba34003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:33.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.651+0000 7fba467fc700 1 --2- 172.21.15.52:0/1504807253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba34004850 0x7fba34004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:33.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.651+0000 7fba467fc700 1 --2- 172.21.15.52:0/1504807253 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba34005200 0x7fba3400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:33.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.651+0000 7fba467fc700 1 -- 172.21.15.52:0/1504807253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3400c050 con 0x7fba34003a00 2023-06-23T18:45:33.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.651+0000 7fba467fc700 1 -- 172.21.15.52:0/1504807253 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3400c1c0 con 0x7fba34004850 2023-06-23T18:45:33.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.651+0000 7fba467fc700 1 -- 172.21.15.52:0/1504807253 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3400c380 con 0x7fba34005200 2023-06-23T18:45:33.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.651+0000 7fba477fe700 1 --2- 172.21.15.52:0/1504807253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba34003a00 0x7fba34003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:33.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.651+0000 7fba46ffd700 1 --2- 172.21.15.52:0/1504807253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba34004850 0x7fba34004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:33.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.651+0000 7fba47fff700 1 --2- 172.21.15.52:0/1504807253 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba34005200 0x7fba3400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:33.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.651+0000 7fba477fe700 1 -- 172.21.15.52:0/1504807253 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba34005200 msgr2=0x7fba3400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:33.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.651+0000 7fba477fe700 1 --2- 172.21.15.52:0/1504807253 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba34005200 0x7fba3400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:33.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.651+0000 7fba477fe700 1 -- 172.21.15.52:0/1504807253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba34004850 msgr2=0x7fba34004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:33.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.651+0000 7fba477fe700 1 --2- 172.21.15.52:0/1504807253 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba34004850 0x7fba34004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:33.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.651+0000 7fba477fe700 1 -- 172.21.15.52:0/1504807253 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba340035b0 con 0x7fba34003a00 2023-06-23T18:45:33.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.651+0000 7fba47fff700 1 --2- 172.21.15.52:0/1504807253 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba34005200 0x7fba3400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:45:33.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.651+0000 7fba47fff700 1 -- 172.21.15.52:0/1504807253 reap_dead start 2023-06-23T18:45:33.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.652+0000 7fba477fe700 1 --2- 172.21.15.52:0/1504807253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba34003a00 0x7fba34003e10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fba38009b60 tx=0x7fba34005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a2abd986f74b80 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:33.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.652+0000 7fba467fc700 1 -- 172.21.15.52:0/1504807253 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3800e6c0 con 0x7fba34003a00 2023-06-23T18:45:33.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.652+0000 7fba467fc700 1 -- 172.21.15.52:0/1504807253 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3800e820 con 0x7fba34003a00 2023-06-23T18:45:33.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.652+0000 7fba467fc700 1 -- 172.21.15.52:0/1504807253 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3800eb90 con 0x7fba34003a00 2023-06-23T18:45:33.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.652+0000 7fba4db04700 1 -- 172.21.15.52:0/1504807253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba34003a00 msgr2=0x7fba34003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:33.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.652+0000 7fba4db04700 1 --2- 172.21.15.52:0/1504807253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba34003a00 0x7fba34003e10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fba38009b60 tx=0x7fba34005880 comp rx=0 tx=0).stop 2023-06-23T18:45:33.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.652+0000 7fba4db04700 1 -- 172.21.15.52:0/1504807253 shutdown_connections 2023-06-23T18:45:33.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.652+0000 7fba4db04700 1 --2- 172.21.15.52:0/1504807253 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba34003a00 0x7fba34003e10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:33.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.652+0000 7fba4db04700 1 -- 172.21.15.52:0/1504807253 >> 172.21.15.52:0/1504807253 conn(0x7fba480bd420 msgr2=0x7fba480bd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:33.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.652+0000 7fba4db04700 1 -- 172.21.15.52:0/1504807253 shutdown_connections 2023-06-23T18:45:33.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.652+0000 7fba4db04700 1 -- 172.21.15.52:0/1504807253 wait complete. 2023-06-23T18:45:33.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.653+0000 7fba4db04700 1 Processor -- start 2023-06-23T18:45:33.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.654+0000 7fba4db04700 1 -- start start 2023-06-23T18:45:33.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.654+0000 7fba4db04700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba34003a00 0x7fba480b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:33.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.654+0000 7fba4db04700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba481df410 0x7fba48145590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:33.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.654+0000 7fba4db04700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba480b47f0 0x7fba481e2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:33.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.654+0000 7fba4db04700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba480b51c0 con 0x7fba481df410 2023-06-23T18:45:33.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.654+0000 7fba4db04700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba48145140 con 0x7fba480b47f0 2023-06-23T18:45:33.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.654+0000 7fba4db04700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba480b6ba0 con 0x7fba34003a00 2023-06-23T18:45:33.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.654+0000 7fba46ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba481df410 0x7fba48145590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:33.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.654+0000 7fba46ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba481df410 0x7fba48145590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46392/0 (socket says 172.21.15.52:46392) 2023-06-23T18:45:33.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.654+0000 7fba46ffd700 1 -- 172.21.15.52:0/1478402182 learned_addr learned my addr 172.21.15.52:0/1478402182 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:33.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.654+0000 7fba47fff700 1 --2- 172.21.15.52:0/1478402182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba480b47f0 0x7fba481e2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:33.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.654+0000 7fba477fe700 1 --2- 172.21.15.52:0/1478402182 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba34003a00 0x7fba480b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:33.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.655+0000 7fba46ffd700 1 -- 172.21.15.52:0/1478402182 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba34003a00 msgr2=0x7fba480b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:33.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.655+0000 7fba46ffd700 1 --2- 172.21.15.52:0/1478402182 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba34003a00 0x7fba480b5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:33.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.655+0000 7fba46ffd700 1 -- 172.21.15.52:0/1478402182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba480b47f0 msgr2=0x7fba481e2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:33.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.655+0000 7fba46ffd700 1 --2- 172.21.15.52:0/1478402182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba480b47f0 0x7fba481e2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:33.668 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.655+0000 7fba46ffd700 1 -- 172.21.15.52:0/1478402182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba48145ad0 con 0x7fba481df410 2023-06-23T18:45:33.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.655+0000 7fba46ffd700 1 --2- 172.21.15.52:0/1478402182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba481df410 0x7fba48145590 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fba3000f850 tx=0x7fba3000fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:33.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.655+0000 7fba3ffff700 1 -- 172.21.15.52:0/1478402182 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba300052e0 con 0x7fba481df410 2023-06-23T18:45:33.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.655+0000 7fba3ffff700 1 -- 172.21.15.52:0/1478402182 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba30005440 con 0x7fba481df410 2023-06-23T18:45:33.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.655+0000 7fba4db04700 1 -- 172.21.15.52:0/1478402182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba480b3a80 con 0x7fba481df410 2023-06-23T18:45:33.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.655+0000 7fba3ffff700 1 -- 172.21.15.52:0/1478402182 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba300038a0 con 0x7fba481df410 2023-06-23T18:45:33.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.655+0000 7fba4db04700 1 -- 172.21.15.52:0/1478402182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba480b6970 con 0x7fba481df410 2023-06-23T18:45:33.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.656+0000 7fba4db04700 1 -- 172.21.15.52:0/1478402182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba48144f90 con 0x7fba481df410 2023-06-23T18:45:33.669 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.656+0000 7fba3ffff700 1 -- 172.21.15.52:0/1478402182 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fba30003a00 con 0x7fba481df410 2023-06-23T18:45:33.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.657+0000 7fba3ffff700 1 --2- 172.21.15.52:0/1478402182 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fba2806ace0 0x7fba2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:33.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.657+0000 7fba3ffff700 1 -- 172.21.15.52:0/1478402182 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fba30088e80 con 0x7fba481df410 2023-06-23T18:45:33.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.657+0000 7fba477fe700 1 --2- 172.21.15.52:0/1478402182 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fba2806ace0 0x7fba2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:33.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.657+0000 7fba477fe700 1 --2- 172.21.15.52:0/1478402182 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fba2806ace0 0x7fba2806d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fba380090b0 tx=0x7fba3801e040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:33.670 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.661+0000 7fba3ffff700 1 -- 172.21.15.52:0/1478402182 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fba300541f0 con 0x7fba481df410 2023-06-23T18:45:33.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.856+0000 7fba4db04700 1 -- 172.21.15.52:0/1478402182 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fba481452b0 con 0x7fba481df410 2023-06-23T18:45:33.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.857+0000 7fba3ffff700 1 -- 172.21.15.52:0/1478402182 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fba481452b0 con 0x7fba481df410 2023-06-23T18:45:33.863 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-06-23T18:45:33.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.859+0000 7fba4db04700 1 -- 172.21.15.52:0/1478402182 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fba2806ace0 msgr2=0x7fba2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:33.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.859+0000 7fba4db04700 1 --2- 172.21.15.52:0/1478402182 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fba2806ace0 0x7fba2806d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fba380090b0 tx=0x7fba3801e040 comp rx=0 tx=0).stop 2023-06-23T18:45:33.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.859+0000 7fba4db04700 1 -- 172.21.15.52:0/1478402182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba481df410 msgr2=0x7fba48145590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:33.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.859+0000 7fba4db04700 1 --2- 172.21.15.52:0/1478402182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba481df410 0x7fba48145590 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fba3000f850 tx=0x7fba3000fb60 comp rx=0 tx=0).stop 2023-06-23T18:45:33.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.859+0000 7fba4db04700 1 -- 172.21.15.52:0/1478402182 shutdown_connections 2023-06-23T18:45:33.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.859+0000 7fba4db04700 1 --2- 172.21.15.52:0/1478402182 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fba2806ace0 0x7fba2806d190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:33.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.859+0000 7fba4db04700 1 --2- 172.21.15.52:0/1478402182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba480b47f0 0x7fba481e2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:33.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.859+0000 7fba4db04700 1 --2- 172.21.15.52:0/1478402182 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba34003a00 0x7fba480b5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:33.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.859+0000 7fba4db04700 1 --2- 172.21.15.52:0/1478402182 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba481df410 0x7fba48145590 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:33.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.859+0000 7fba4db04700 1 -- 172.21.15.52:0/1478402182 >> 172.21.15.52:0/1478402182 conn(0x7fba480bd420 msgr2=0x7fba480bd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:33.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.859+0000 7fba4db04700 1 -- 172.21.15.52:0/1478402182 shutdown_connections 2023-06-23T18:45:33.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:33.859+0000 7fba4db04700 1 -- 172.21.15.52:0/1478402182 wait complete. 2023-06-23T18:45:33.877 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T18:45:34.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.000+0000 7fdb14724700 1 Processor -- start 2023-06-23T18:45:34.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.000+0000 7fdb14724700 1 -- start start 2023-06-23T18:45:34.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.001+0000 7fdb14724700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb0c0b8c80 0x7fdb0c071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:34.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.001+0000 7fdb14724700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdb0c141220 0x7fdb0c1472e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:34.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.001+0000 7fdb14724700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb0c1416a0 0x7fdb0c147820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:34.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.001+0000 7fdb14724700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0c0b4bb0 con 0x7fdb0c0b8c80 2023-06-23T18:45:34.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.001+0000 7fdb14724700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0c0b8360 con 0x7fdb0c141220 2023-06-23T18:45:34.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.001+0000 7fdb14724700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c0b7da0 con 0x7fdb0c1416a0 2023-06-23T18:45:34.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.001+0000 7fdb124c0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb0c0b8c80 0x7fdb0c071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:34.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.001+0000 7fdb124c0700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb0c0b8c80 0x7fdb0c071240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46396/0 (socket says 172.21.15.52:46396) 2023-06-23T18:45:34.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.001+0000 7fdb124c0700 1 -- 172.21.15.52:0/3362019017 learned_addr learned my addr 172.21.15.52:0/3362019017 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:34.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.001+0000 7fdb11cbf700 1 --2- 172.21.15.52:0/3362019017 >> v2:172.21.15.89:3300/0 conn(0x7fdb0c141220 0x7fdb0c1472e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:34.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.001+0000 7fdb12cc1700 1 --2- 172.21.15.52:0/3362019017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb0c1416a0 0x7fdb0c147820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:34.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.002+0000 7fdb124c0700 1 -- 172.21.15.52:0/3362019017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb0c1416a0 msgr2=0x7fdb0c147820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:34.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.002+0000 7fdb124c0700 1 --2- 172.21.15.52:0/3362019017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb0c1416a0 0x7fdb0c147820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.002+0000 7fdb124c0700 1 -- 172.21.15.52:0/3362019017 >> v2:172.21.15.89:3300/0 conn(0x7fdb0c141220 msgr2=0x7fdb0c1472e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:34.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.002+0000 7fdb124c0700 1 --2- 172.21.15.52:0/3362019017 >> v2:172.21.15.89:3300/0 conn(0x7fdb0c141220 0x7fdb0c1472e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.002+0000 7fdb124c0700 1 -- 172.21.15.52:0/3362019017 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c0b8080 con 0x7fdb0c0b8c80 2023-06-23T18:45:34.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.002+0000 7fdb124c0700 1 --2- 172.21.15.52:0/3362019017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb0c0b8c80 0x7fdb0c071240 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c147220 tx=0x7fdafc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c63b8aefc709df server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:34.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.002+0000 7fdb114be700 1 -- 172.21.15.52:0/3362019017 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc011830 con 0x7fdb0c0b8c80 2023-06-23T18:45:34.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.002+0000 7fdb114be700 1 -- 172.21.15.52:0/3362019017 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdafc011990 con 0x7fdb0c0b8c80 2023-06-23T18:45:34.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.002+0000 7fdb114be700 1 -- 172.21.15.52:0/3362019017 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc011d20 con 0x7fdb0c0b8c80 2023-06-23T18:45:34.012 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.003+0000 7fdb14724700 1 -- 172.21.15.52:0/3362019017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb0c0b8c80 msgr2=0x7fdb0c071240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:34.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.003+0000 7fdb14724700 1 --2- 172.21.15.52:0/3362019017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb0c0b8c80 0x7fdb0c071240 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c147220 tx=0x7fdafc009bd0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.003+0000 7fdb14724700 1 -- 172.21.15.52:0/3362019017 shutdown_connections 2023-06-23T18:45:34.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.003+0000 7fdb14724700 1 --2- 172.21.15.52:0/3362019017 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb0c1416a0 0x7fdb0c147820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.003+0000 7fdb14724700 1 --2- 172.21.15.52:0/3362019017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb0c0b8c80 0x7fdb0c071240 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.003+0000 7fdb14724700 1 --2- 172.21.15.52:0/3362019017 >> v2:172.21.15.89:3300/0 conn(0x7fdb0c141220 0x7fdb0c1472e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.003+0000 7fdb14724700 1 -- 172.21.15.52:0/3362019017 >> 172.21.15.52:0/3362019017 conn(0x7fdb0c0bd420 msgr2=0x7fdb0c0bd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:34.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.003+0000 7fdb14724700 1 -- 172.21.15.52:0/3362019017 shutdown_connections 2023-06-23T18:45:34.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.003+0000 7fdb14724700 1 -- 172.21.15.52:0/3362019017 wait complete. 2023-06-23T18:45:34.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.004+0000 7fdb14724700 1 Processor -- start 2023-06-23T18:45:34.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.004+0000 7fdb14724700 1 -- start start 2023-06-23T18:45:34.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.004+0000 7fdb14724700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb0c0b8c80 0x7fdb0c13dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:34.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.004+0000 7fdb14724700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb0c141220 0x7fdb0c1e2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:34.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.004+0000 7fdb14724700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb0c1416a0 0x7fdb0c13b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:34.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.004+0000 7fdb14724700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c0bc120 con 0x7fdb0c1416a0 2023-06-23T18:45:34.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.004+0000 7fdb14724700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c13e110 con 0x7fdb0c141220 2023-06-23T18:45:34.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.004+0000 7fdb14724700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c1cf8a0 con 0x7fdb0c0b8c80 2023-06-23T18:45:34.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.004+0000 7fdb12cc1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb0c1416a0 0x7fdb0c13b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:34.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.005+0000 7fdb12cc1700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb0c1416a0 0x7fdb0c13b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46400/0 (socket says 172.21.15.52:46400) 2023-06-23T18:45:34.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.005+0000 7fdb12cc1700 1 -- 172.21.15.52:0/2645773003 learned_addr learned my addr 172.21.15.52:0/2645773003 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:34.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.005+0000 7fdb124c0700 1 --2- 172.21.15.52:0/2645773003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb0c0b8c80 0x7fdb0c13dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:34.015 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.005+0000 7fdb11cbf700 1 --2- 172.21.15.52:0/2645773003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb0c141220 0x7fdb0c1e2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:34.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.005+0000 7fdb12cc1700 1 -- 172.21.15.52:0/2645773003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb0c0b8c80 msgr2=0x7fdb0c13dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:34.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.005+0000 7fdb12cc1700 1 --2- 172.21.15.52:0/2645773003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb0c0b8c80 0x7fdb0c13dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.005+0000 7fdb12cc1700 1 -- 172.21.15.52:0/2645773003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb0c141220 msgr2=0x7fdb0c1e2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:34.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.005+0000 7fdb12cc1700 1 --2- 172.21.15.52:0/2645773003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb0c141220 0x7fdb0c1e2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.005+0000 7fdb12cc1700 1 -- 172.21.15.52:0/2645773003 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc009550 con 0x7fdb0c1416a0 2023-06-23T18:45:34.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.005+0000 7fdb12cc1700 1 --2- 172.21.15.52:0/2645773003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb0c1416a0 0x7fdb0c13b610 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400efc0 tx=0x7fdb0400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:34.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.005+0000 7fdb02ffd700 1 -- 172.21.15.52:0/2645773003 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0400cad0 con 0x7fdb0c1416a0 2023-06-23T18:45:34.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.005+0000 7fdb02ffd700 1 -- 172.21.15.52:0/2645773003 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0400f040 con 0x7fdb0c1416a0 2023-06-23T18:45:34.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.005+0000 7fdb02ffd700 1 -- 172.21.15.52:0/2645773003 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0400ce70 con 0x7fdb0c1416a0 2023-06-23T18:45:34.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.005+0000 7fdb14724700 1 -- 172.21.15.52:0/2645773003 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb0c1cf530 con 0x7fdb0c1416a0 2023-06-23T18:45:34.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.005+0000 7fdb14724700 1 -- 172.21.15.52:0/2645773003 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb0c0bc300 con 0x7fdb0c1416a0 2023-06-23T18:45:34.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.006+0000 7fdb14724700 1 -- 172.21.15.52:0/2645773003 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb0c1cf9e0 con 0x7fdb0c1416a0 2023-06-23T18:45:34.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.007+0000 7fdb02ffd700 1 -- 172.21.15.52:0/2645773003 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdb04014480 con 0x7fdb0c1416a0 2023-06-23T18:45:34.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.007+0000 7fdb02ffd700 1 --2- 172.21.15.52:0/2645773003 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdaf006ace0 0x7fdaf006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:34.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.007+0000 7fdb02ffd700 1 -- 172.21.15.52:0/2645773003 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdb040898f0 con 0x7fdb0c1416a0 2023-06-23T18:45:34.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.007+0000 7fdb124c0700 1 --2- 172.21.15.52:0/2645773003 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdaf006ace0 0x7fdaf006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:34.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.008+0000 7fdb124c0700 1 --2- 172.21.15.52:0/2645773003 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdaf006ace0 0x7fdaf006d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdafc009840 tx=0x7fdafc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:34.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.012+0000 7fdb02ffd700 1 -- 172.21.15.52:0/2645773003 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdb0c1cf9e0 con 0x7fdb0c1416a0 2023-06-23T18:45:34.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.208+0000 7fdb14724700 1 -- 172.21.15.52:0/2645773003 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdb0c1cf9e0 con 0x7fdb0c1416a0 2023-06-23T18:45:34.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.208+0000 7fdb02ffd700 1 -- 172.21.15.52:0/2645773003 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdb04018020 con 0x7fdb0c1416a0 2023-06-23T18:45:34.215 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-06-23T18:45:34.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.210+0000 7fdb14724700 1 -- 172.21.15.52:0/2645773003 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdaf006ace0 msgr2=0x7fdaf006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:34.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.210+0000 7fdb14724700 1 --2- 172.21.15.52:0/2645773003 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdaf006ace0 0x7fdaf006d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdafc009840 tx=0x7fdafc008030 comp rx=0 tx=0).stop 2023-06-23T18:45:34.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.210+0000 7fdb14724700 1 -- 172.21.15.52:0/2645773003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb0c1416a0 msgr2=0x7fdb0c13b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:34.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.210+0000 7fdb14724700 1 --2- 172.21.15.52:0/2645773003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb0c1416a0 0x7fdb0c13b610 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400efc0 tx=0x7fdb0400c0c0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.210+0000 7fdb14724700 1 -- 172.21.15.52:0/2645773003 shutdown_connections 2023-06-23T18:45:34.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.210+0000 7fdb14724700 1 --2- 172.21.15.52:0/2645773003 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdaf006ace0 0x7fdaf006d190 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.210+0000 7fdb14724700 1 --2- 172.21.15.52:0/2645773003 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb0c1416a0 0x7fdb0c13b610 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.210+0000 7fdb14724700 1 --2- 172.21.15.52:0/2645773003 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb0c0b8c80 0x7fdb0c13dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.210+0000 7fdb14724700 1 --2- 172.21.15.52:0/2645773003 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb0c141220 0x7fdb0c1e2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.210+0000 7fdb14724700 1 -- 172.21.15.52:0/2645773003 >> 172.21.15.52:0/2645773003 conn(0x7fdb0c0bd420 msgr2=0x7fdb0c1d4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:34.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.210+0000 7fdb14724700 1 -- 172.21.15.52:0/2645773003 shutdown_connections 2023-06-23T18:45:34.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.211+0000 7fdb14724700 1 -- 172.21.15.52:0/2645773003 wait complete. 2023-06-23T18:45:34.228 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-23T18:45:34.353 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.348+0000 7f7966c35700 1 Processor -- start 2023-06-23T18:45:34.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.348+0000 7f7966c35700 1 -- start start 2023-06-23T18:45:34.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.349+0000 7f7966c35700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f796006b0e0 0x7f7960140810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:34.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.349+0000 7f7966c35700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7960140d50 0x7f7960149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:34.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.349+0000 7f7966c35700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79600701a0 con 0x7f796014a310 2023-06-23T18:45:34.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.349+0000 7f7966c35700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7960071540 con 0x7f7960140d50 2023-06-23T18:45:34.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.349+0000 7f7966c35700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79600b8f00 con 0x7f796006b0e0 2023-06-23T18:45:34.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.349+0000 7f79649d1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f796006b0e0 0x7f7960140810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:34.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.349+0000 7f795ffff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7960140d50 0x7f7960149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:34.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.349+0000 7f79649d1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f796006b0e0 0x7f7960140810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.52:56056/0 (socket says 172.21.15.52:56056) 2023-06-23T18:45:34.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.349+0000 7f795ffff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7960140d50 0x7f7960149dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.52:42410/0 (socket says 172.21.15.52:42410) 2023-06-23T18:45:34.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.349+0000 7f79649d1700 1 -- 172.21.15.52:0/845990419 learned_addr learned my addr 172.21.15.52:0/845990419 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:34.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.350+0000 7f795ffff700 1 -- 172.21.15.52:0/845990419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f796006b0e0 msgr2=0x7f7960140810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:34.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.350+0000 7f795ffff700 1 --2- 172.21.15.52:0/845990419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f796006b0e0 0x7f7960140810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.350+0000 7f795ffff700 1 -- 172.21.15.52:0/845990419 >> v1:172.21.15.89:6789/0 conn(0x7f796014a310 legacy=0x7f79600b7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:34.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.350+0000 7f795ffff700 1 -- 172.21.15.52:0/845990419 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79600b91e0 con 0x7f7960140d50 2023-06-23T18:45:34.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.350+0000 7f795f7fe700 1 -- 172.21.15.52:0/845990419 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 247291342 0 0) 0x7f79600701a0 con 0x7f796014a310 2023-06-23T18:45:34.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.350+0000 7f79649d1700 1 --2- 172.21.15.52:0/845990419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f796006b0e0 0x7f7960140810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:45:34.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.350+0000 7f795ffff700 1 --2- 172.21.15.52:0/845990419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7960140d50 0x7f7960149dd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f794c00a9e0 tx=0x7f794c00acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e45201f9f6d108c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:34.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.350+0000 7f795f7fe700 1 -- 172.21.15.52:0/845990419 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c00cb70 con 0x7f7960140d50 2023-06-23T18:45:34.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.350+0000 7f795f7fe700 1 -- 172.21.15.52:0/845990419 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c00ccd0 con 0x7f7960140d50 2023-06-23T18:45:34.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.350+0000 7f795f7fe700 1 -- 172.21.15.52:0/845990419 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c018620 con 0x7f7960140d50 2023-06-23T18:45:34.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.350+0000 7f7966c35700 1 -- 172.21.15.52:0/845990419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7960140d50 msgr2=0x7f7960149dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:34.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.350+0000 7f7966c35700 1 --2- 172.21.15.52:0/845990419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7960140d50 0x7f7960149dd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f794c00a9e0 tx=0x7f794c00acf0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.360 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.351+0000 7f7966c35700 1 -- 172.21.15.52:0/845990419 shutdown_connections 2023-06-23T18:45:34.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.351+0000 7f7966c35700 1 --2- 172.21.15.52:0/845990419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f796006b0e0 0x7f7960140810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.351+0000 7f7966c35700 1 --2- 172.21.15.52:0/845990419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7960140d50 0x7f7960149dd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.351+0000 7f7966c35700 1 -- 172.21.15.52:0/845990419 >> 172.21.15.52:0/845990419 conn(0x7f79600bd690 msgr2=0x7f79600b9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:34.361 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.351+0000 7f7966c35700 1 -- 172.21.15.52:0/845990419 shutdown_connections 2023-06-23T18:45:34.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.351+0000 7f7966c35700 1 -- 172.21.15.52:0/845990419 wait complete. 2023-06-23T18:45:34.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.352+0000 7f7966c35700 1 Processor -- start 2023-06-23T18:45:34.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.352+0000 7f7966c35700 1 -- start start 2023-06-23T18:45:34.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.353+0000 7f7966c35700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f796006b0e0 0x7f79600bbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:34.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.353+0000 7f7966c35700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f796014a310 0x7f79601ddc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:34.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.353+0000 7f7966c35700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7960149460 0x7f79601e0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:34.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.353+0000 7f7966c35700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79600bc1c0 con 0x7f796014a310 2023-06-23T18:45:34.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.353+0000 7f7966c35700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7960141a80 con 0x7f796006b0e0 2023-06-23T18:45:34.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.353+0000 7f7966c35700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7960141130 con 0x7f7960149460 2023-06-23T18:45:34.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.353+0000 7f795ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f796014a310 0x7f79601ddc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:34.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.353+0000 7f795ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f796014a310 0x7f79601ddc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46406/0 (socket says 172.21.15.52:46406) 2023-06-23T18:45:34.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.353+0000 7f795ffff700 1 -- 172.21.15.52:0/3840401556 learned_addr learned my addr 172.21.15.52:0/3840401556 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:34.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.353+0000 7f79649d1700 1 --2- 172.21.15.52:0/3840401556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f796006b0e0 0x7f79600bbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:34.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.353+0000 7f79651d2700 1 --2- 172.21.15.52:0/3840401556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7960149460 0x7f79601e0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:34.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.353+0000 7f795ffff700 1 -- 172.21.15.52:0/3840401556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7960149460 msgr2=0x7f79601e0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:34.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.353+0000 7f795ffff700 1 --2- 172.21.15.52:0/3840401556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7960149460 0x7f79601e0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.353+0000 7f795ffff700 1 -- 172.21.15.52:0/3840401556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f796006b0e0 msgr2=0x7f79600bbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:34.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.353+0000 7f795ffff700 1 --2- 172.21.15.52:0/3840401556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f796006b0e0 0x7f79600bbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.354+0000 7f795ffff700 1 -- 172.21.15.52:0/3840401556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7954009550 con 0x7f796014a310 2023-06-23T18:45:34.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.354+0000 7f795ffff700 1 --2- 172.21.15.52:0/3840401556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f796014a310 0x7f79601ddc90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f794c00a1c0 tx=0x7f794c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:34.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.354+0000 7f795d7fa700 1 -- 172.21.15.52:0/3840401556 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c003ab0 con 0x7f796014a310 2023-06-23T18:45:34.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.354+0000 7f795d7fa700 1 -- 172.21.15.52:0/3840401556 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c003c10 con 0x7f796014a310 2023-06-23T18:45:34.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.354+0000 7f7966c35700 1 -- 172.21.15.52:0/3840401556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f794c00a640 con 0x7f796014a310 2023-06-23T18:45:34.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.354+0000 7f795d7fa700 1 -- 172.21.15.52:0/3840401556 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c021480 con 0x7f796014a310 2023-06-23T18:45:34.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.354+0000 7f7966c35700 1 -- 172.21.15.52:0/3840401556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79601dd800 con 0x7f796014a310 2023-06-23T18:45:34.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.355+0000 7f7966c35700 1 -- 172.21.15.52:0/3840401556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79601dd990 con 0x7f796014a310 2023-06-23T18:45:34.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.355+0000 7f795d7fa700 1 -- 172.21.15.52:0/3840401556 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f794c018400 con 0x7f796014a310 2023-06-23T18:45:34.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.356+0000 7f795d7fa700 1 --2- 172.21.15.52:0/3840401556 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f794406ad10 0x7f794406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:34.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.356+0000 7f795d7fa700 1 -- 172.21.15.52:0/3840401556 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f794c08a7a0 con 0x7f796014a310 2023-06-23T18:45:34.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.356+0000 7f79649d1700 1 --2- 172.21.15.52:0/3840401556 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f794406ad10 0x7f794406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:34.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.356+0000 7f79649d1700 1 --2- 172.21.15.52:0/3840401556 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f794406ad10 0x7f794406d1c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7954009cf0 tx=0x7f7954008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:34.371 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.360+0000 7f795d7fa700 1 -- 172.21.15.52:0/3840401556 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f794c055c60 con 0x7f796014a310 2023-06-23T18:45:34.564 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.559+0000 7f7966c35700 1 -- 172.21.15.52:0/3840401556 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f79601dd5a0 con 0x7f796014a310 2023-06-23T18:45:34.565 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.559+0000 7f795d7fa700 1 -- 172.21.15.52:0/3840401556 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+126 (secure 0 0 0) 0x7f794c059280 con 0x7f796014a310 2023-06-23T18:45:34.565 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:34.565 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2023-06-23T18:45:34.565 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-06-23T18:45:34.566 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2023-06-23T18:45:34.566 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": "rbd" 2023-06-23T18:45:34.566 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2023-06-23T18:45:34.566 INFO:teuthology.orchestra.run.smithi052.stdout: { 2023-06-23T18:45:34.566 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 2, 2023-06-23T18:45:34.566 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2023-06-23T18:45:34.566 INFO:teuthology.orchestra.run.smithi052.stdout: } 2023-06-23T18:45:34.567 INFO:teuthology.orchestra.run.smithi052.stdout:] 2023-06-23T18:45:34.567 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.561+0000 7f7966c35700 1 -- 172.21.15.52:0/3840401556 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f794406ad10 msgr2=0x7f794406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:34.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.561+0000 7f7966c35700 1 --2- 172.21.15.52:0/3840401556 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f794406ad10 0x7f794406d1c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7954009cf0 tx=0x7f7954008040 comp rx=0 tx=0).stop 2023-06-23T18:45:34.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.561+0000 7f7966c35700 1 -- 172.21.15.52:0/3840401556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f796014a310 msgr2=0x7f79601ddc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:34.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.561+0000 7f7966c35700 1 --2- 172.21.15.52:0/3840401556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f796014a310 0x7f79601ddc90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f794c00a1c0 tx=0x7f794c0047c0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.561+0000 7f7966c35700 1 -- 172.21.15.52:0/3840401556 shutdown_connections 2023-06-23T18:45:34.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.561+0000 7f7966c35700 1 --2- 172.21.15.52:0/3840401556 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f794406ad10 0x7f794406d1c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.561+0000 7f7966c35700 1 --2- 172.21.15.52:0/3840401556 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7960149460 0x7f79601e0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.568 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.561+0000 7f7966c35700 1 --2- 172.21.15.52:0/3840401556 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f796006b0e0 0x7f79600bbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.561+0000 7f7966c35700 1 --2- 172.21.15.52:0/3840401556 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f796014a310 0x7f79601ddc90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.561+0000 7f7966c35700 1 -- 172.21.15.52:0/3840401556 >> 172.21.15.52:0/3840401556 conn(0x7f79600bd690 msgr2=0x7f7960138ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:34.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.561+0000 7f7966c35700 1 -- 172.21.15.52:0/3840401556 shutdown_connections 2023-06-23T18:45:34.569 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.561+0000 7f7966c35700 1 -- 172.21.15.52:0/3840401556 wait complete. 2023-06-23T18:45:34.579 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-23T18:45:34.579 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-23T18:45:34.709 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.704+0000 7ff2718dd700 1 Processor -- start 2023-06-23T18:45:34.710 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.704+0000 7ff2718dd700 1 -- start start 2023-06-23T18:45:34.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.705+0000 7ff2718dd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff26c0b5f40 0x7ff26c0b85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:34.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.705+0000 7ff2718dd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff26c071a70 0x7ff26c14a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:34.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.705+0000 7ff2718dd700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff26c06b610 con 0x7ff26c0b6cf0 2023-06-23T18:45:34.711 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.705+0000 7ff2718dd700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff26c0b90d0 con 0x7ff26c0b5f40 2023-06-23T18:45:34.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.705+0000 7ff2718dd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c0b8df0 con 0x7ff26c071a70 2023-06-23T18:45:34.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.705+0000 7ff263fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff26c071a70 0x7ff26c14a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:34.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.705+0000 7ff26affd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff26c0b5f40 0x7ff26c0b85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:34.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.705+0000 7ff263fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff26c071a70 0x7ff26c14a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.52:56076/0 (socket says 172.21.15.52:56076) 2023-06-23T18:45:34.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.705+0000 7ff26affd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff26c0b5f40 0x7ff26c0b85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.52:42430/0 (socket says 172.21.15.52:42430) 2023-06-23T18:45:34.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.705+0000 7ff26b7fe700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff26c0b6cf0 0x7ff26c06af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.52:46234/0 (socket says 172.21.15.52:46234) 2023-06-23T18:45:34.712 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.705+0000 7ff263fff700 1 -- 172.21.15.52:0/1625200561 learned_addr learned my addr 172.21.15.52:0/1625200561 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:34.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.706+0000 7ff26affd700 1 -- 172.21.15.52:0/1625200561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff26c071a70 msgr2=0x7ff26c14a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:34.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.706+0000 7ff26affd700 1 --2- 172.21.15.52:0/1625200561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff26c071a70 0x7ff26c14a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.714 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.706+0000 7ff26affd700 1 -- 172.21.15.52:0/1625200561 >> v1:172.21.15.89:6789/0 conn(0x7ff26c0b6cf0 legacy=0x7ff26c06af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:34.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.706+0000 7ff26affd700 1 -- 172.21.15.52:0/1625200561 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26c071270 con 0x7ff26c0b5f40 2023-06-23T18:45:34.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.706+0000 7ff26a7fc700 1 -- 172.21.15.52:0/1625200561 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954856640 0 0) 0x7ff26c06b610 con 0x7ff26c0b6cf0 2023-06-23T18:45:34.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.706+0000 7ff263fff700 1 --2- 172.21.15.52:0/1625200561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff26c071a70 0x7ff26c14a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:45:34.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.706+0000 7ff26affd700 1 --2- 172.21.15.52:0/1625200561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff26c0b5f40 0x7ff26c0b85d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff25c009840 tx=0x7ff25c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20c8bea9b3987e6c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:34.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.706+0000 7ff26a7fc700 1 -- 172.21.15.52:0/1625200561 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c011830 con 0x7ff26c0b5f40 2023-06-23T18:45:34.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.706+0000 7ff26a7fc700 1 -- 172.21.15.52:0/1625200561 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25c011990 con 0x7ff26c0b5f40 2023-06-23T18:45:34.715 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.706+0000 7ff26a7fc700 1 -- 172.21.15.52:0/1625200561 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c011d20 con 0x7ff26c0b5f40 2023-06-23T18:45:34.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.707+0000 7ff2718dd700 1 -- 172.21.15.52:0/1625200561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff26c0b5f40 msgr2=0x7ff26c0b85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:34.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.707+0000 7ff2718dd700 1 --2- 172.21.15.52:0/1625200561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff26c0b5f40 0x7ff26c0b85d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff25c009840 tx=0x7ff25c009b50 comp rx=0 tx=0).stop 2023-06-23T18:45:34.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.707+0000 7ff2718dd700 1 -- 172.21.15.52:0/1625200561 shutdown_connections 2023-06-23T18:45:34.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.707+0000 7ff2718dd700 1 --2- 172.21.15.52:0/1625200561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff26c0b5f40 0x7ff26c0b85d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.707+0000 7ff2718dd700 1 --2- 172.21.15.52:0/1625200561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff26c071a70 0x7ff26c14a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.707+0000 7ff2718dd700 1 -- 172.21.15.52:0/1625200561 >> 172.21.15.52:0/1625200561 conn(0x7ff26c0b95c0 msgr2=0x7ff26c0b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:34.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.707+0000 7ff2718dd700 1 -- 172.21.15.52:0/1625200561 shutdown_connections 2023-06-23T18:45:34.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.707+0000 7ff2718dd700 1 -- 172.21.15.52:0/1625200561 wait complete. 2023-06-23T18:45:34.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.708+0000 7ff2718dd700 1 Processor -- start 2023-06-23T18:45:34.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.708+0000 7ff2718dd700 1 -- start start 2023-06-23T18:45:34.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.708+0000 7ff2718dd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff26c071a70 0x7ff26c06a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:34.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.708+0000 7ff2718dd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff26c0b5f40 0x7ff26c1d4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:34.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.708+0000 7ff2718dd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff26c0b6cf0 0x7ff26c1e2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:34.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.708+0000 7ff2718dd700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c1d5380 con 0x7ff26c0b6cf0 2023-06-23T18:45:34.717 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.708+0000 7ff2718dd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c141dc0 con 0x7ff26c0b5f40 2023-06-23T18:45:34.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.708+0000 7ff2718dd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c1420a0 con 0x7ff26c071a70 2023-06-23T18:45:34.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.709+0000 7ff26b7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff26c0b6cf0 0x7ff26c1e2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:34.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.709+0000 7ff26b7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff26c0b6cf0 0x7ff26c1e2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:46414/0 (socket says 172.21.15.52:46414) 2023-06-23T18:45:34.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.709+0000 7ff26b7fe700 1 -- 172.21.15.52:0/2703977815 learned_addr learned my addr 172.21.15.52:0/2703977815 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:34.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.709+0000 7ff263fff700 1 --2- 172.21.15.52:0/2703977815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff26c0b5f40 0x7ff26c1d4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:34.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.709+0000 7ff26affd700 1 --2- 172.21.15.52:0/2703977815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff26c071a70 0x7ff26c06a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:34.719 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.709+0000 7ff26b7fe700 1 -- 172.21.15.52:0/2703977815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff26c071a70 msgr2=0x7ff26c06a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:34.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.709+0000 7ff26b7fe700 1 --2- 172.21.15.52:0/2703977815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff26c071a70 0x7ff26c06a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.709+0000 7ff26b7fe700 1 -- 172.21.15.52:0/2703977815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff26c0b5f40 msgr2=0x7ff26c1d4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:34.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.709+0000 7ff26b7fe700 1 --2- 172.21.15.52:0/2703977815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff26c0b5f40 0x7ff26c1d4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:34.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.709+0000 7ff26b7fe700 1 -- 172.21.15.52:0/2703977815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff254009550 con 0x7ff26c0b6cf0 2023-06-23T18:45:34.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.709+0000 7ff263fff700 1 --2- 172.21.15.52:0/2703977815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff26c0b5f40 0x7ff26c1d4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:45:34.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.709+0000 7ff26b7fe700 1 --2- 172.21.15.52:0/2703977815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff26c0b6cf0 0x7ff26c1e2ce0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff26400cba0 tx=0x7ff26400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:34.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.709+0000 7ff268ff9700 1 -- 172.21.15.52:0/2703977815 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26400aaa0 con 0x7ff26c0b6cf0 2023-06-23T18:45:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.709+0000 7ff268ff9700 1 -- 172.21.15.52:0/2703977815 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26400ac20 con 0x7ff26c0b6cf0 2023-06-23T18:45:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.709+0000 7ff2718dd700 1 -- 172.21.15.52:0/2703977815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff25c0094a0 con 0x7ff26c0b6cf0 2023-06-23T18:45:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.709+0000 7ff268ff9700 1 -- 172.21.15.52:0/2703977815 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2640070d0 con 0x7ff26c0b6cf0 2023-06-23T18:45:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.709+0000 7ff2718dd700 1 -- 172.21.15.52:0/2703977815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff26c147a20 con 0x7ff26c0b6cf0 2023-06-23T18:45:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.710+0000 7ff2718dd700 1 -- 172.21.15.52:0/2703977815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff26c14a0a0 con 0x7ff26c0b6cf0 2023-06-23T18:45:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.711+0000 7ff268ff9700 1 -- 172.21.15.52:0/2703977815 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff264007230 con 0x7ff26c0b6cf0 2023-06-23T18:45:34.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.711+0000 7ff268ff9700 1 --2- 172.21.15.52:0/2703977815 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff24c06ace0 0x7ff24c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:34.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.711+0000 7ff268ff9700 1 -- 172.21.15.52:0/2703977815 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff264088bf0 con 0x7ff26c0b6cf0 2023-06-23T18:45:34.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.712+0000 7ff26affd700 1 --2- 172.21.15.52:0/2703977815 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff24c06ace0 0x7ff24c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:34.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.712+0000 7ff26affd700 1 --2- 172.21.15.52:0/2703977815 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff24c06ace0 0x7ff24c06d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0090b0 tx=0x7ff25c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:34.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.716+0000 7ff268ff9700 1 -- 172.21.15.52:0/2703977815 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff26c14a0a0 con 0x7ff26c0b6cf0 2023-06-23T18:45:34.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:34.912+0000 7ff2718dd700 1 -- 172.21.15.52:0/2703977815 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff26c14a0a0 con 0x7ff26c0b6cf0 2023-06-23T18:45:35.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:35.908+0000 7ff268ff9700 1 -- 172.21.15.52:0/2703977815 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff26c14a0a0 con 0x7ff26c0b6cf0 2023-06-23T18:45:35.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:35.912+0000 7ff2718dd700 1 -- 172.21.15.52:0/2703977815 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff24c06ace0 msgr2=0x7ff24c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:35.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:35.912+0000 7ff2718dd700 1 --2- 172.21.15.52:0/2703977815 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff24c06ace0 0x7ff24c06d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0090b0 tx=0x7ff25c008030 comp rx=0 tx=0).stop 2023-06-23T18:45:35.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:35.912+0000 7ff2718dd700 1 -- 172.21.15.52:0/2703977815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff26c0b6cf0 msgr2=0x7ff26c1e2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:35.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:35.912+0000 7ff2718dd700 1 --2- 172.21.15.52:0/2703977815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff26c0b6cf0 0x7ff26c1e2ce0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff26400cba0 tx=0x7ff26400ceb0 comp rx=0 tx=0).stop 2023-06-23T18:45:35.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:35.912+0000 7ff2718dd700 1 -- 172.21.15.52:0/2703977815 shutdown_connections 2023-06-23T18:45:35.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:35.912+0000 7ff2718dd700 1 --2- 172.21.15.52:0/2703977815 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff24c06ace0 0x7ff24c06d190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:35.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:35.912+0000 7ff2718dd700 1 --2- 172.21.15.52:0/2703977815 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff26c0b6cf0 0x7ff26c1e2ce0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:35.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:35.912+0000 7ff2718dd700 1 --2- 172.21.15.52:0/2703977815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff26c071a70 0x7ff26c06a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:35.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:35.912+0000 7ff2718dd700 1 --2- 172.21.15.52:0/2703977815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff26c0b5f40 0x7ff26c1d4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:35.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:35.912+0000 7ff2718dd700 1 -- 172.21.15.52:0/2703977815 >> 172.21.15.52:0/2703977815 conn(0x7ff26c0b95c0 msgr2=0x7ff26c14a950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:35.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:35.912+0000 7ff2718dd700 1 -- 172.21.15.52:0/2703977815 shutdown_connections 2023-06-23T18:45:35.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:35.912+0000 7ff2718dd700 1 -- 172.21.15.52:0/2703977815 wait complete. 2023-06-23T18:45:35.920 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2023-06-23T18:45:35.935 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-23T18:45:36.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.069+0000 7f718662a700 1 Processor -- start 2023-06-23T18:45:36.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.069+0000 7f718662a700 1 -- start start 2023-06-23T18:45:36.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.070+0000 7f718662a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f71800b5890 0x7f7180142550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:36.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.070+0000 7f718662a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71800bacc0 0x7f71800bb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:36.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.070+0000 7f718662a700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f718014c670 con 0x7f7180142a90 2023-06-23T18:45:36.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.070+0000 7f718662a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71800b6c00 con 0x7f71800b5890 2023-06-23T18:45:36.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.070+0000 7f718662a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718014baa0 con 0x7f71800bacc0 2023-06-23T18:45:36.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.070+0000 7f717f7fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f7180142a90 0x7f71800be590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51732/0 (socket says 172.21.15.52:51732) 2023-06-23T18:45:36.078 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.070+0000 7f717f7fe700 1 -- 172.21.15.52:0/1328009579 learned_addr learned my addr 172.21.15.52:0/1328009579 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:36.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.070+0000 7f7184bc7700 1 --2- 172.21.15.52:0/1328009579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71800bacc0 0x7f71800bb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:36.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.070+0000 7f717ffff700 1 --2- 172.21.15.52:0/1328009579 >> v2:172.21.15.89:3300/0 conn(0x7f71800b5890 0x7f7180142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:36.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.070+0000 7f717effd700 1 -- 172.21.15.52:0/1328009579 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 946882768 0 0) 0x7f718014c670 con 0x7f7180142a90 2023-06-23T18:45:36.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.070+0000 7f717effd700 1 -- 172.21.15.52:0/1328009579 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f716c0035b0 con 0x7f7180142a90 2023-06-23T18:45:36.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.071+0000 7f717effd700 1 -- 172.21.15.52:0/1328009579 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1875408231 0 0) 0x7f716c0035b0 con 0x7f7180142a90 2023-06-23T18:45:36.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.071+0000 7f717effd700 1 -- 172.21.15.52:0/1328009579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71800bacc0 msgr2=0x7f71800bb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:36.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.071+0000 7f717effd700 1 --2- 172.21.15.52:0/1328009579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71800bacc0 0x7f71800bb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:36.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.071+0000 7f717effd700 1 -- 172.21.15.52:0/1328009579 >> v2:172.21.15.89:3300/0 conn(0x7f71800b5890 msgr2=0x7f7180142550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:36.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.071+0000 7f717effd700 1 --2- 172.21.15.52:0/1328009579 >> v2:172.21.15.89:3300/0 conn(0x7f71800b5890 0x7f7180142550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:36.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.071+0000 7f717effd700 1 -- 172.21.15.52:0/1328009579 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718014bd40 con 0x7f7180142a90 2023-06-23T18:45:36.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.071+0000 7f717effd700 1 -- 172.21.15.52:0/1328009579 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7f7168001670 con 0x7f7180142a90 2023-06-23T18:45:36.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.071+0000 7f717effd700 1 -- 172.21.15.52:0/1328009579 >> v1:172.21.15.52:6789/0 conn(0x7f7180142a90 legacy=0x7f71800be590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:36.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.071+0000 7f717effd700 1 --2- 172.21.15.52:0/1328009579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f716c003a00 0x7f716c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:36.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.071+0000 7f717effd700 1 --2- 172.21.15.52:0/1328009579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c004430 0x7f716c0048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:36.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.071+0000 7f717effd700 1 --2- 172.21.15.52:0/1328009579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71800bacc0 0x7f716c004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:36.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.071+0000 7f717effd700 1 -- 172.21.15.52:0/1328009579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71800b6c00 con 0x7f716c003a00 2023-06-23T18:45:36.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.071+0000 7f717effd700 1 -- 172.21.15.52:0/1328009579 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718014baa0 con 0x7f716c004430 2023-06-23T18:45:36.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.071+0000 7f717effd700 1 -- 172.21.15.52:0/1328009579 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716c00ba10 con 0x7f71800bacc0 2023-06-23T18:45:36.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.071+0000 7f717ffff700 1 --2- 172.21.15.52:0/1328009579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f716c003a00 0x7f716c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:36.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.071+0000 7f717f7fe700 1 --2- 172.21.15.52:0/1328009579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c004430 0x7f716c0048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:36.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.071+0000 7f7184bc7700 1 --2- 172.21.15.52:0/1328009579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71800bacc0 0x7f716c004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:36.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.071+0000 7f717ffff700 1 -- 172.21.15.52:0/1328009579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71800bacc0 msgr2=0x7f716c004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:36.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.071+0000 7f717ffff700 1 --2- 172.21.15.52:0/1328009579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71800bacc0 0x7f716c004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:36.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.071+0000 7f717ffff700 1 -- 172.21.15.52:0/1328009579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c004430 msgr2=0x7f716c0048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:36.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.071+0000 7f717ffff700 1 --2- 172.21.15.52:0/1328009579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c004430 0x7f716c0048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:36.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.071+0000 7f717ffff700 1 -- 172.21.15.52:0/1328009579 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c0035b0 con 0x7f716c003a00 2023-06-23T18:45:36.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.071+0000 7f717ffff700 1 --2- 172.21.15.52:0/1328009579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f716c003a00 0x7f716c003e10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7170009b60 tx=0x7f716c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af0e1686cfbfbc5 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:36.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.071+0000 7f717effd700 1 -- 172.21.15.52:0/1328009579 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717000e6c0 con 0x7f716c003a00 2023-06-23T18:45:36.082 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.071+0000 7f717effd700 1 -- 172.21.15.52:0/1328009579 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717000e820 con 0x7f716c003a00 2023-06-23T18:45:36.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.071+0000 7f717effd700 1 -- 172.21.15.52:0/1328009579 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717000eb90 con 0x7f716c003a00 2023-06-23T18:45:36.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.072+0000 7f718662a700 1 -- 172.21.15.52:0/1328009579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f716c003a00 msgr2=0x7f716c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:36.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.072+0000 7f718662a700 1 --2- 172.21.15.52:0/1328009579 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f716c003a00 0x7f716c003e10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7170009b60 tx=0x7f716c005880 comp rx=0 tx=0).stop 2023-06-23T18:45:36.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.072+0000 7f7184bc7700 1 -- 172.21.15.52:0/1328009579 reap_dead start 2023-06-23T18:45:36.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.072+0000 7f718662a700 1 -- 172.21.15.52:0/1328009579 shutdown_connections 2023-06-23T18:45:36.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.072+0000 7f718662a700 1 -- 172.21.15.52:0/1328009579 >> 172.21.15.52:0/1328009579 conn(0x7f7180071410 msgr2=0x7f7180071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:36.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.072+0000 7f718662a700 1 -- 172.21.15.52:0/1328009579 shutdown_connections 2023-06-23T18:45:36.083 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.072+0000 7f718662a700 1 -- 172.21.15.52:0/1328009579 wait complete. 2023-06-23T18:45:36.085 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.073+0000 7f718662a700 1 Processor -- start 2023-06-23T18:45:36.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.073+0000 7f718662a700 1 -- start start 2023-06-23T18:45:36.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.074+0000 7f718662a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c003a00 0x7f71800ad820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:36.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.074+0000 7f718662a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7180146f40 0x7f71801e0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:36.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.074+0000 7f718662a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71800ac800 0x7f71800acc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:36.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.074+0000 7f718662a700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718013d460 con 0x7f71800ac800 2023-06-23T18:45:36.086 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.074+0000 7f718662a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7180147770 con 0x7f716c003a00 2023-06-23T18:45:36.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.074+0000 7f718662a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71800ad1b0 con 0x7f7180146f40 2023-06-23T18:45:36.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.074+0000 7f7184bc7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71800ac800 0x7f71800acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:36.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.074+0000 7f7184bc7700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71800ac800 0x7f71800acc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40126/0 (socket says 172.21.15.52:40126) 2023-06-23T18:45:36.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.074+0000 7f7184bc7700 1 -- 172.21.15.52:0/996699719 learned_addr learned my addr 172.21.15.52:0/996699719 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:36.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.074+0000 7f717ffff700 1 --2- 172.21.15.52:0/996699719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c003a00 0x7f71800ad820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:36.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.074+0000 7f717f7fe700 1 --2- 172.21.15.52:0/996699719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7180146f40 0x7f71801e0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:36.087 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.074+0000 7f7184bc7700 1 -- 172.21.15.52:0/996699719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7180146f40 msgr2=0x7f71801e0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:36.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.074+0000 7f7184bc7700 1 --2- 172.21.15.52:0/996699719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7180146f40 0x7f71801e0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:36.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.074+0000 7f7184bc7700 1 -- 172.21.15.52:0/996699719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c003a00 msgr2=0x7f71800ad820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:36.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.074+0000 7f7184bc7700 1 --2- 172.21.15.52:0/996699719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c003a00 0x7f71800ad820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:36.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.074+0000 7f7184bc7700 1 -- 172.21.15.52:0/996699719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71800ae320 con 0x7f71800ac800 2023-06-23T18:45:36.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.074+0000 7f717f7fe700 1 --2- 172.21.15.52:0/996699719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7180146f40 0x7f71801e0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:36.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.074+0000 7f717ffff700 1 --2- 172.21.15.52:0/996699719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c003a00 0x7f71800ad820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:36.088 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.074+0000 7f7184bc7700 1 --2- 172.21.15.52:0/996699719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71800ac800 0x7f71800acc70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f71800b2270 tx=0x7f717800f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:36.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.075+0000 7f717cff9700 1 -- 172.21.15.52:0/996699719 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717800e040 con 0x7f71800ac800 2023-06-23T18:45:36.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.075+0000 7f717cff9700 1 -- 172.21.15.52:0/996699719 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717800f040 con 0x7f71800ac800 2023-06-23T18:45:36.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.075+0000 7f718662a700 1 -- 172.21.15.52:0/996699719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71800ae040 con 0x7f71800ac800 2023-06-23T18:45:36.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.075+0000 7f717cff9700 1 -- 172.21.15.52:0/996699719 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7178015670 con 0x7f71800ac800 2023-06-23T18:45:36.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.075+0000 7f718662a700 1 -- 172.21.15.52:0/996699719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71801e0100 con 0x7f71800ac800 2023-06-23T18:45:36.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.076+0000 7f718662a700 1 -- 172.21.15.52:0/996699719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f718006ae70 con 0x7f71800ac800 2023-06-23T18:45:36.089 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.076+0000 7f717cff9700 1 -- 172.21.15.52:0/996699719 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f71780157d0 con 0x7f71800ac800 2023-06-23T18:45:36.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.077+0000 7f717cff9700 1 --2- 172.21.15.52:0/996699719 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f716006ace0 0x7f716006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:36.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.077+0000 7f717cff9700 1 -- 172.21.15.52:0/996699719 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f7178089960 con 0x7f71800ac800 2023-06-23T18:45:36.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.077+0000 7f717ffff700 1 --2- 172.21.15.52:0/996699719 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f716006ace0 0x7f716006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:36.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.078+0000 7f717ffff700 1 --2- 172.21.15.52:0/996699719 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f716006ace0 0x7f716006d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f71700090b0 tx=0x7f7170008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:36.090 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.082+0000 7f717cff9700 1 -- 172.21.15.52:0/996699719 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7178054b60 con 0x7f71800ac800 2023-06-23T18:45:36.281 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.275+0000 7f718662a700 1 -- 172.21.15.52:0/996699719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f718004e1d0 con 0x7f71800ac800 2023-06-23T18:45:36.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.920+0000 7f717cff9700 1 -- 172.21.15.52:0/996699719 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7178058180 con 0x7f71800ac800 2023-06-23T18:45:36.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.927+0000 7f718662a700 1 -- 172.21.15.52:0/996699719 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f716006ace0 msgr2=0x7f716006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:36.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.927+0000 7f718662a700 1 --2- 172.21.15.52:0/996699719 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f716006ace0 0x7f716006d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f71700090b0 tx=0x7f7170008030 comp rx=0 tx=0).stop 2023-06-23T18:45:36.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.927+0000 7f718662a700 1 -- 172.21.15.52:0/996699719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71800ac800 msgr2=0x7f71800acc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:36.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.927+0000 7f718662a700 1 --2- 172.21.15.52:0/996699719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71800ac800 0x7f71800acc70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f71800b2270 tx=0x7f717800f490 comp rx=0 tx=0).stop 2023-06-23T18:45:36.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.929+0000 7f718662a700 1 -- 172.21.15.52:0/996699719 shutdown_connections 2023-06-23T18:45:36.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.929+0000 7f718662a700 1 --2- 172.21.15.52:0/996699719 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f716006ace0 0x7f716006d190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:36.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.929+0000 7f718662a700 1 --2- 172.21.15.52:0/996699719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f71800ac800 0x7f71800acc70 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:36.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.929+0000 7f718662a700 1 --2- 172.21.15.52:0/996699719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f716c003a00 0x7f71800ad820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:36.936 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.929+0000 7f718662a700 1 --2- 172.21.15.52:0/996699719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7180146f40 0x7f71801e0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:36.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.929+0000 7f718662a700 1 -- 172.21.15.52:0/996699719 >> 172.21.15.52:0/996699719 conn(0x7f7180071410 msgr2=0x7f71800bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:36.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.929+0000 7f718662a700 1 -- 172.21.15.52:0/996699719 shutdown_connections 2023-06-23T18:45:36.937 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:36.930+0000 7f718662a700 1 -- 172.21.15.52:0/996699719 wait complete. 2023-06-23T18:45:36.943 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2023-06-23T18:45:36.958 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-23T18:45:37.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.086+0000 7f99b8557700 1 Processor -- start 2023-06-23T18:45:37.092 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.086+0000 7f99b8557700 1 -- start start 2023-06-23T18:45:37.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.087+0000 7f99b8557700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f99b014a600 0x7f99b00bb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:37.093 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.087+0000 7f99b8557700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f99b00b59b0 0x7f99b00bb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:37.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.087+0000 7f99b8557700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b00be040 con 0x7f99b00b6870 2023-06-23T18:45:37.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.087+0000 7f99b8557700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b014aae0 con 0x7f99b014a600 2023-06-23T18:45:37.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.087+0000 7f99b8557700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b014adc0 con 0x7f99b00b59b0 2023-06-23T18:45:37.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.087+0000 7f99b5af2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f99b014a600 0x7f99b00bb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:37.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.087+0000 7f99b5af2700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f99b014a600 0x7f99b00bb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40140/0 (socket says 172.21.15.52:40140) 2023-06-23T18:45:37.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.087+0000 7f99b5af2700 1 -- 172.21.15.52:0/3274455571 learned_addr learned my addr 172.21.15.52:0/3274455571 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:37.094 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.087+0000 7f99b6af4700 1 --2- 172.21.15.52:0/3274455571 >> v2:172.21.15.89:3300/0 conn(0x7f99b00b59b0 0x7f99b00bb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:37.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.088+0000 7f99b5af2700 1 -- 172.21.15.52:0/3274455571 >> v2:172.21.15.89:3300/0 conn(0x7f99b00b59b0 msgr2=0x7f99b00bb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:37.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.088+0000 7f99b5af2700 1 --2- 172.21.15.52:0/3274455571 >> v2:172.21.15.89:3300/0 conn(0x7f99b00b59b0 0x7f99b00bb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:37.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.088+0000 7f99b5af2700 1 -- 172.21.15.52:0/3274455571 >> v1:172.21.15.89:6789/0 conn(0x7f99b00b6870 legacy=0x7f99b0144480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:37.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.088+0000 7f99b5af2700 1 -- 172.21.15.52:0/3274455571 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b014b0a0 con 0x7f99b014a600 2023-06-23T18:45:37.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.088+0000 7f99b5af2700 1 --2- 172.21.15.52:0/3274455571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99b014a600 0x7f99b00bb1f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f99b008ac80 tx=0x7f99ac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19167c1942014742 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:37.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.088+0000 7f99b52f1700 1 -- 172.21.15.52:0/3274455571 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac011830 con 0x7f99b014a600 2023-06-23T18:45:37.095 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.088+0000 7f99b52f1700 1 -- 172.21.15.52:0/3274455571 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac011990 con 0x7f99b014a600 2023-06-23T18:45:37.096 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.088+0000 7f99b52f1700 1 -- 172.21.15.52:0/3274455571 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac011d20 con 0x7f99b014a600 2023-06-23T18:45:37.097 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.088+0000 7f99b8557700 1 -- 172.21.15.52:0/3274455571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99b014a600 msgr2=0x7f99b00bb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:37.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.088+0000 7f99b8557700 1 --2- 172.21.15.52:0/3274455571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99b014a600 0x7f99b00bb1f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f99b008ac80 tx=0x7f99ac009bd0 comp rx=0 tx=0).stop 2023-06-23T18:45:37.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.088+0000 7f99b8557700 1 -- 172.21.15.52:0/3274455571 shutdown_connections 2023-06-23T18:45:37.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.088+0000 7f99b8557700 1 --2- 172.21.15.52:0/3274455571 >> v2:172.21.15.89:3300/0 conn(0x7f99b00b59b0 0x7f99b00bb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:37.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.088+0000 7f99b8557700 1 --2- 172.21.15.52:0/3274455571 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99b014a600 0x7f99b00bb1f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:37.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.088+0000 7f99b8557700 1 -- 172.21.15.52:0/3274455571 >> 172.21.15.52:0/3274455571 conn(0x7f99b00bd140 msgr2=0x7f99b00bd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:37.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.088+0000 7f99b8557700 1 -- 172.21.15.52:0/3274455571 shutdown_connections 2023-06-23T18:45:37.098 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.088+0000 7f99b8557700 1 -- 172.21.15.52:0/3274455571 wait complete. 2023-06-23T18:45:37.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.089+0000 7f99b8557700 1 Processor -- start 2023-06-23T18:45:37.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.090+0000 7f99b8557700 1 -- start start 2023-06-23T18:45:37.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.090+0000 7f99b8557700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99b00b59b0 0x7f99b0137810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:37.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.090+0000 7f99b8557700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99b00b6870 0x7f99b01e0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:37.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.090+0000 7f99b8557700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99b014a600 0x7f99b0136930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:37.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.090+0000 7f99b8557700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b01398f0 con 0x7f99b014a600 2023-06-23T18:45:37.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.090+0000 7f99b8557700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b0137d50 con 0x7f99b00b59b0 2023-06-23T18:45:37.099 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.090+0000 7f99b8557700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b00b8450 con 0x7f99b00b6870 2023-06-23T18:45:37.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.090+0000 7f99b6af4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99b014a600 0x7f99b0136930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:37.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.090+0000 7f99b6af4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99b014a600 0x7f99b0136930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40148/0 (socket says 172.21.15.52:40148) 2023-06-23T18:45:37.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.090+0000 7f99b6af4700 1 -- 172.21.15.52:0/1013527537 learned_addr learned my addr 172.21.15.52:0/1013527537 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:37.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.090+0000 7f99b62f3700 1 --2- 172.21.15.52:0/1013527537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99b00b59b0 0x7f99b0137810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:37.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.090+0000 7f99b5af2700 1 --2- 172.21.15.52:0/1013527537 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99b00b6870 0x7f99b01e0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:37.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.091+0000 7f99b6af4700 1 -- 172.21.15.52:0/1013527537 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99b00b6870 msgr2=0x7f99b01e0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:37.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.091+0000 7f99b6af4700 1 --2- 172.21.15.52:0/1013527537 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99b00b6870 0x7f99b01e0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:37.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.091+0000 7f99b6af4700 1 -- 172.21.15.52:0/1013527537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99b00b59b0 msgr2=0x7f99b0137810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:37.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.091+0000 7f99b6af4700 1 --2- 172.21.15.52:0/1013527537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99b00b59b0 0x7f99b0137810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:37.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.091+0000 7f99b6af4700 1 -- 172.21.15.52:0/1013527537 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac009550 con 0x7f99b014a600 2023-06-23T18:45:37.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.091+0000 7f99b6af4700 1 --2- 172.21.15.52:0/1013527537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99b014a600 0x7f99b0136930 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f99a800efc0 tx=0x7f99a800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:37.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.091+0000 7f99a6ffd700 1 -- 172.21.15.52:0/1013527537 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a800cad0 con 0x7f99b014a600 2023-06-23T18:45:37.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.091+0000 7f99a6ffd700 1 -- 172.21.15.52:0/1013527537 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a800f040 con 0x7f99b014a600 2023-06-23T18:45:37.101 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.091+0000 7f99a6ffd700 1 -- 172.21.15.52:0/1013527537 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a800ce70 con 0x7f99b014a600 2023-06-23T18:45:37.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.091+0000 7f99b8557700 1 -- 172.21.15.52:0/1013527537 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b0145310 con 0x7f99b014a600 2023-06-23T18:45:37.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.091+0000 7f99b8557700 1 -- 172.21.15.52:0/1013527537 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b0139610 con 0x7f99b014a600 2023-06-23T18:45:37.102 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.092+0000 7f99b8557700 1 -- 172.21.15.52:0/1013527537 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b004e1d0 con 0x7f99b014a600 2023-06-23T18:45:37.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.093+0000 7f99a6ffd700 1 -- 172.21.15.52:0/1013527537 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f99a8014480 con 0x7f99b014a600 2023-06-23T18:45:37.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.093+0000 7f99a6ffd700 1 --2- 172.21.15.52:0/1013527537 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f999406ace0 0x7f999406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:37.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.093+0000 7f99a6ffd700 1 -- 172.21.15.52:0/1013527537 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f99a8089b70 con 0x7f99b014a600 2023-06-23T18:45:37.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.093+0000 7f99b62f3700 1 --2- 172.21.15.52:0/1013527537 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f999406ace0 0x7f999406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:37.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.094+0000 7f99b62f3700 1 --2- 172.21.15.52:0/1013527537 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f999406ace0 0x7f999406d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f99a0007fd0 tx=0x7f99a0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:37.103 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.098+0000 7f99a6ffd700 1 -- 172.21.15.52:0/1013527537 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f99a8054c80 con 0x7f99b014a600 2023-06-23T18:45:37.345 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.339+0000 7f99b8557700 1 -- 172.21.15.52:0/1013527537 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f99b0142a50 con 0x7f99b014a600 2023-06-23T18:45:37.351 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.345+0000 7f99a6ffd700 1 -- 172.21.15.52:0/1013527537 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f99a80582a0 con 0x7f99b014a600 2023-06-23T18:45:37.354 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.349+0000 7f99b8557700 1 -- 172.21.15.52:0/1013527537 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f999406ace0 msgr2=0x7f999406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:37.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.349+0000 7f99b8557700 1 --2- 172.21.15.52:0/1013527537 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f999406ace0 0x7f999406d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f99a0007fd0 tx=0x7f99a0009040 comp rx=0 tx=0).stop 2023-06-23T18:45:37.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.349+0000 7f99b8557700 1 -- 172.21.15.52:0/1013527537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99b014a600 msgr2=0x7f99b0136930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:37.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.349+0000 7f99b8557700 1 --2- 172.21.15.52:0/1013527537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99b014a600 0x7f99b0136930 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f99a800efc0 tx=0x7f99a800c0c0 comp rx=0 tx=0).stop 2023-06-23T18:45:37.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.349+0000 7f99b8557700 1 -- 172.21.15.52:0/1013527537 shutdown_connections 2023-06-23T18:45:37.355 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.349+0000 7f99b8557700 1 --2- 172.21.15.52:0/1013527537 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f999406ace0 0x7f999406d190 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f99a0007fd0 tx=0x7f99a0009040 comp rx=0 tx=0).stop 2023-06-23T18:45:37.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.349+0000 7f99b8557700 1 --2- 172.21.15.52:0/1013527537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99b014a600 0x7f99b0136930 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:37.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.349+0000 7f99b8557700 1 --2- 172.21.15.52:0/1013527537 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f99b00b59b0 0x7f99b0137810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:37.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.349+0000 7f99b8557700 1 --2- 172.21.15.52:0/1013527537 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f99b00b6870 0x7f99b01e0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:37.356 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.349+0000 7f99b8557700 1 -- 172.21.15.52:0/1013527537 >> 172.21.15.52:0/1013527537 conn(0x7f99b00bd140 msgr2=0x7f99b01412a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:37.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.352+0000 7f99b8557700 1 -- 172.21.15.52:0/1013527537 shutdown_connections 2023-06-23T18:45:37.358 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.352+0000 7f99b8557700 1 -- 172.21.15.52:0/1013527537 wait complete. 2023-06-23T18:45:37.366 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 5 and data pool 6 2023-06-23T18:45:37.380 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:45:37.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.499+0000 7fcb6c70d700 1 Processor -- start 2023-06-23T18:45:37.505 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.499+0000 7fcb6c70d700 1 -- start start 2023-06-23T18:45:37.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.500+0000 7fcb6c70d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb641426a0 0x7fcb64071be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:37.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.500+0000 7fcb6c70d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcb640b8c70 0x7fcb64148480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:37.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.500+0000 7fcb6c70d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb640b53b0 con 0x7fcb641489c0 2023-06-23T18:45:37.507 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.500+0000 7fcb6c70d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb640b4750 con 0x7fcb640b8c70 2023-06-23T18:45:37.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.500+0000 7fcb6c70d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb64142a70 con 0x7fcb641426a0 2023-06-23T18:45:37.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.500+0000 7fcb69ca8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcb640b8c70 0x7fcb64148480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:37.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.500+0000 7fcb6a4a9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb641426a0 0x7fcb64071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:37.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.500+0000 7fcb69ca8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcb640b8c70 0x7fcb64148480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.52:45322/0 (socket says 172.21.15.52:45322) 2023-06-23T18:45:37.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.500+0000 7fcb69ca8700 1 -- 172.21.15.52:0/3634118211 learned_addr learned my addr 172.21.15.52:0/3634118211 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:37.508 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.500+0000 7fcb6a4a9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb641426a0 0x7fcb64071be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.52:38514/0 (socket says 172.21.15.52:38514) 2023-06-23T18:45:37.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.500+0000 7fcb6acaa700 1 --1- 172.21.15.52:0/3634118211 >> v1:172.21.15.89:6789/0 conn(0x7fcb641489c0 0x7fcb6414b880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.52:39530/0 (socket says 172.21.15.52:39530) 2023-06-23T18:45:37.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.501+0000 7fcb6a4a9700 1 -- 172.21.15.52:0/3634118211 >> v2:172.21.15.89:3300/0 conn(0x7fcb640b8c70 msgr2=0x7fcb64148480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:37.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.501+0000 7fcb6a4a9700 1 --2- 172.21.15.52:0/3634118211 >> v2:172.21.15.89:3300/0 conn(0x7fcb640b8c70 0x7fcb64148480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:37.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.501+0000 7fcb6a4a9700 1 -- 172.21.15.52:0/3634118211 >> v1:172.21.15.89:6789/0 conn(0x7fcb641489c0 legacy=0x7fcb6414b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:37.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.501+0000 7fcb6a4a9700 1 -- 172.21.15.52:0/3634118211 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb640b9c30 con 0x7fcb641426a0 2023-06-23T18:45:37.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.501+0000 7fcb694a7700 1 -- 172.21.15.52:0/3634118211 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2579474232 0 0) 0x7fcb640b53b0 con 0x7fcb641489c0 2023-06-23T18:45:37.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.501+0000 7fcb69ca8700 1 --2- 172.21.15.52:0/3634118211 >> v2:172.21.15.89:3300/0 conn(0x7fcb640b8c70 0x7fcb64148480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:45:37.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.501+0000 7fcb6a4a9700 1 --2- 172.21.15.52:0/3634118211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb641426a0 0x7fcb64071be0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009d90 tx=0x7fcb5c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f23b8cfafe5efc29 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:37.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.501+0000 7fcb694a7700 1 -- 172.21.15.52:0/3634118211 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c00e070 con 0x7fcb641426a0 2023-06-23T18:45:37.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.501+0000 7fcb694a7700 1 -- 172.21.15.52:0/3634118211 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5c00bb20 con 0x7fcb641426a0 2023-06-23T18:45:37.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.501+0000 7fcb694a7700 1 -- 172.21.15.52:0/3634118211 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c012430 con 0x7fcb641426a0 2023-06-23T18:45:37.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.502+0000 7fcb6c70d700 1 -- 172.21.15.52:0/3634118211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb641426a0 msgr2=0x7fcb64071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:37.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.502+0000 7fcb6c70d700 1 --2- 172.21.15.52:0/3634118211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb641426a0 0x7fcb64071be0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009d90 tx=0x7fcb5c00b330 comp rx=0 tx=0).stop 2023-06-23T18:45:37.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.502+0000 7fcb6c70d700 1 -- 172.21.15.52:0/3634118211 shutdown_connections 2023-06-23T18:45:37.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.502+0000 7fcb6c70d700 1 --2- 172.21.15.52:0/3634118211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb641426a0 0x7fcb64071be0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:37.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.502+0000 7fcb6c70d700 1 --2- 172.21.15.52:0/3634118211 >> v2:172.21.15.89:3300/0 conn(0x7fcb640b8c70 0x7fcb64148480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:37.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.502+0000 7fcb6c70d700 1 -- 172.21.15.52:0/3634118211 >> 172.21.15.52:0/3634118211 conn(0x7fcb640bd690 msgr2=0x7fcb640b9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:37.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.502+0000 7fcb6c70d700 1 -- 172.21.15.52:0/3634118211 shutdown_connections 2023-06-23T18:45:37.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.502+0000 7fcb6c70d700 1 -- 172.21.15.52:0/3634118211 wait complete. 2023-06-23T18:45:37.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.503+0000 7fcb6c70d700 1 Processor -- start 2023-06-23T18:45:37.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.503+0000 7fcb6c70d700 1 -- start start 2023-06-23T18:45:37.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.504+0000 7fcb6c70d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb640b8c70 0x7fcb641439e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:37.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.504+0000 7fcb6c70d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb641426a0 0x7fcb641e2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:37.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.504+0000 7fcb6c70d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb641489c0 0x7fcb641471d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:37.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.504+0000 7fcb6c70d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb64142f90 con 0x7fcb641489c0 2023-06-23T18:45:37.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.504+0000 7fcb6c70d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb64144e80 con 0x7fcb640b8c70 2023-06-23T18:45:37.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.504+0000 7fcb6c70d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb64145b90 con 0x7fcb641426a0 2023-06-23T18:45:37.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.504+0000 7fcb6acaa700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb641489c0 0x7fcb641471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:37.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.504+0000 7fcb6acaa700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb641489c0 0x7fcb641471d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40156/0 (socket says 172.21.15.52:40156) 2023-06-23T18:45:37.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.504+0000 7fcb6acaa700 1 -- 172.21.15.52:0/3676956122 learned_addr learned my addr 172.21.15.52:0/3676956122 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:37.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.505+0000 7fcb69ca8700 1 --2- 172.21.15.52:0/3676956122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb641426a0 0x7fcb641e2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:37.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.505+0000 7fcb6a4a9700 1 --2- 172.21.15.52:0/3676956122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb640b8c70 0x7fcb641439e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:37.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.505+0000 7fcb6acaa700 1 -- 172.21.15.52:0/3676956122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb641426a0 msgr2=0x7fcb641e2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:37.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.505+0000 7fcb6acaa700 1 --2- 172.21.15.52:0/3676956122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb641426a0 0x7fcb641e2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:37.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.505+0000 7fcb6acaa700 1 -- 172.21.15.52:0/3676956122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb640b8c70 msgr2=0x7fcb641439e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:37.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.505+0000 7fcb6acaa700 1 --2- 172.21.15.52:0/3676956122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb640b8c70 0x7fcb641439e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:37.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.505+0000 7fcb6acaa700 1 -- 172.21.15.52:0/3676956122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb58009550 con 0x7fcb641489c0 2023-06-23T18:45:37.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.505+0000 7fcb6a4a9700 1 --2- 172.21.15.52:0/3676956122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb640b8c70 0x7fcb641439e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:45:37.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.505+0000 7fcb6acaa700 1 --2- 172.21.15.52:0/3676956122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb641489c0 0x7fcb641471d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400c480 tx=0x7fcb5400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:37.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.505+0000 7fcb62ffd700 1 -- 172.21.15.52:0/3676956122 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb54004c80 con 0x7fcb641489c0 2023-06-23T18:45:37.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.505+0000 7fcb62ffd700 1 -- 172.21.15.52:0/3676956122 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb54004e00 con 0x7fcb641489c0 2023-06-23T18:45:37.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.505+0000 7fcb6c70d700 1 -- 172.21.15.52:0/3676956122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb5c009a70 con 0x7fcb641489c0 2023-06-23T18:45:37.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.505+0000 7fcb62ffd700 1 -- 172.21.15.52:0/3676956122 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb54007310 con 0x7fcb641489c0 2023-06-23T18:45:37.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.505+0000 7fcb6c70d700 1 -- 172.21.15.52:0/3676956122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb641434c0 con 0x7fcb641489c0 2023-06-23T18:45:37.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.506+0000 7fcb6c70d700 1 -- 172.21.15.52:0/3676956122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6404e1d0 con 0x7fcb641489c0 2023-06-23T18:45:37.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.506+0000 7fcb62ffd700 1 -- 172.21.15.52:0/3676956122 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcb54007470 con 0x7fcb641489c0 2023-06-23T18:45:37.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.507+0000 7fcb62ffd700 1 --2- 172.21.15.52:0/3676956122 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcb5006ace0 0x7fcb5006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:37.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.507+0000 7fcb62ffd700 1 -- 172.21.15.52:0/3676956122 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcb54089170 con 0x7fcb641489c0 2023-06-23T18:45:37.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.507+0000 7fcb6a4a9700 1 --2- 172.21.15.52:0/3676956122 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcb5006ace0 0x7fcb5006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:37.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.507+0000 7fcb6a4a9700 1 --2- 172.21.15.52:0/3676956122 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcb5006ace0 0x7fcb5006d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00b370 tx=0x7fcb5c011000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:37.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.511+0000 7fcb62ffd700 1 -- 172.21.15.52:0/3676956122 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcb54054210 con 0x7fcb641489c0 2023-06-23T18:45:37.716 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.711+0000 7fcb6c70d700 1 -- 172.21.15.52:0/3676956122 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb640b50d0 con 0x7fcb641489c0 2023-06-23T18:45:37.718 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.712+0000 7fcb62ffd700 1 -- 172.21.15.52:0/3676956122 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18258 (secure 0 0 0) 0x7fcb54057830 con 0x7fcb641489c0 2023-06-23T18:45:37.718 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:37.718 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":31,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","created":"2023-06-23T18:44:31.918434+0000","modified":"2023-06-23T18:45:37.341731+0000","last_up_change":"2023-06-23T18:44:42.169624+0000","last_in_change":"2023-06-23T18:44:34.510501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-23T18:44:43.346578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-23T18:44:43.829719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:45:34.943560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-23T18:45:36.307208+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c371fb28-1b15-4e43-8d5a-43e402920ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6812","nonce":1066999520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6815","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6818","nonce":1066999520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6829","nonce":1066999520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6823","nonce":1066999520}]},"public_addr":"172.21.15.52:6812/1066999520","cluster_addr":"172.21.15.52:6818/1066999520","heartbeat_back_addr":"172.21.15.52:6829/1066999520","heartbeat_front_addr":"172.21.15.52:6823/1066999520","state":["exists","up"]},{"osd":1,"uuid":"4a142f04-33eb-47ec-9cc5-b08b44d82658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6813","nonce":2360219751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6819","nonce":2360219751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6830","nonce":2360219751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6825","nonce":2360219751}]},"public_addr":"172.21.15.52:6813/2360219751","cluster_addr":"172.21.15.52:6819/2360219751","heartbeat_back_addr":"172.21.15.52:6830/2360219751","heartbeat_front_addr":"172.21.15.52:6825/2360219751","state":["exists","up"]},{"osd":2,"uuid":"d7bb089d-4c55-4370-ba59-7fe88c39512a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6801","nonce":835073005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6803","nonce":835073005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6807","nonce":835073005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6805","nonce":835073005}]},"public_addr":"172.21.15.52:6801/835073005","cluster_addr":"172.21.15.52:6803/835073005","heartbeat_back_addr":"172.21.15.52:6807/835073005","heartbeat_front_addr":"172.21.15.52:6805/835073005","state":["exists","up"]},{"osd":3,"uuid":"4bcdcdc3-6a8f-468e-877e-57f76079ac3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6811","nonce":2852700864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6817","nonce":2852700864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6831","nonce":2852700864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6824","nonce":2852700864}]},"public_addr":"172.21.15.52:6811/2852700864","cluster_addr":"172.21.15.52:6817/2852700864","heartbeat_back_addr":"172.21.15.52:6831/2852700864","heartbeat_front_addr":"172.21.15.52:6824/2852700864","state":["exists","up"]},{"osd":4,"uuid":"cac63000-ae94-4b08-93e6-a99119640b63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6809","nonce":2538664679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6811","nonce":2538664679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6815","nonce":2538664679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6813","nonce":2538664679}]},"public_addr":"172.21.15.89:6809/2538664679","cluster_addr":"172.21.15.89:6811/2538664679","heartbeat_back_addr":"172.21.15.89:6815/2538664679","heartbeat_front_addr":"172.21.15.89:6813/2538664679","state":["exists","up"]},{"osd":5,"uuid":"45c53102-18a6-4fd7-9c25-8ea5e1ef6851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6801","nonce":1683710352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6803","nonce":1683710352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6807","nonce":1683710352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6805","nonce":1683710352}]},"public_addr":"172.21.15.89:6801/1683710352","cluster_addr":"172.21.15.89:6803/1683710352","heartbeat_back_addr":"172.21.15.89:6807/1683710352","heartbeat_front_addr":"172.21.15.89:6805/1683710352","state":["exists","up"]},{"osd":6,"uuid":"abee09d1-8eba-484f-a25c-871c1fe2e843","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6817","nonce":3890899288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6819","nonce":3890899288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6823","nonce":3890899288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6821","nonce":3890899288}]},"public_addr":"172.21.15.89:6817/3890899288","cluster_addr":"172.21.15.89:6819/3890899288","heartbeat_back_addr":"172.21.15.89:6823/3890899288","heartbeat_front_addr":"172.21.15.89:6821/3890899288","state":["exists","up"]},{"osd":7,"uuid":"5acf9e2e-00dd-4f9b-a7d9-3d820f695de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6825","nonce":2989085420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6827","nonce":2989085420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6831","nonce":2989085420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6829","nonce":2989085420}]},"public_addr":"172.21.15.89:6825/2989085420","cluster_addr":"172.21.15.89:6827/2989085420","heartbeat_back_addr":"172.21.15.89:6831/2989085420","heartbeat_front_addr":"172.21.15.89:6829/2989085420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.663866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.710904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.619347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.660102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.686933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.724635+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.669111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.678740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:45:37.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.714+0000 7fcb6c70d700 1 -- 172.21.15.52:0/3676956122 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcb5006ace0 msgr2=0x7fcb5006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:37.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.714+0000 7fcb6c70d700 1 --2- 172.21.15.52:0/3676956122 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcb5006ace0 0x7fcb5006d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00b370 tx=0x7fcb5c011000 comp rx=0 tx=0).stop 2023-06-23T18:45:37.720 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.714+0000 7fcb6c70d700 1 -- 172.21.15.52:0/3676956122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb641489c0 msgr2=0x7fcb641471d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:37.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.714+0000 7fcb6c70d700 1 --2- 172.21.15.52:0/3676956122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb641489c0 0x7fcb641471d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400c480 tx=0x7fcb5400c840 comp rx=0 tx=0).stop 2023-06-23T18:45:37.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.714+0000 7fcb6c70d700 1 -- 172.21.15.52:0/3676956122 shutdown_connections 2023-06-23T18:45:37.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.714+0000 7fcb6c70d700 1 --2- 172.21.15.52:0/3676956122 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcb5006ace0 0x7fcb5006d190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:37.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.714+0000 7fcb6c70d700 1 --2- 172.21.15.52:0/3676956122 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb641489c0 0x7fcb641471d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:37.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.714+0000 7fcb6c70d700 1 --2- 172.21.15.52:0/3676956122 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb640b8c70 0x7fcb641439e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:37.721 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.714+0000 7fcb6c70d700 1 --2- 172.21.15.52:0/3676956122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb641426a0 0x7fcb641e2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.714+0000 7fcb6c70d700 1 -- 172.21.15.52:0/3676956122 >> 172.21.15.52:0/3676956122 conn(0x7fcb640bd690 msgr2=0x7fcb64065b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.714+0000 7fcb6c70d700 1 -- 172.21.15.52:0/3676956122 shutdown_connections 2023-06-23T18:45:37.722 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.714+0000 7fcb6c70d700 1 -- 172.21.15.52:0/3676956122 wait complete. 2023-06-23T18:45:37.733 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:45:37.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.853+0000 7fdb5e79e700 1 Processor -- start 2023-06-23T18:45:37.859 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.853+0000 7fdb5e79e700 1 -- start start 2023-06-23T18:45:37.860 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.854+0000 7fdb5e79e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb5806a0d0 0x7fdb580bc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:37.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.854+0000 7fdb5e79e700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb580b7540 0x7fdb5814de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:37.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.854+0000 7fdb5e79e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb580b64a0 con 0x7fdb580b6930 2023-06-23T18:45:37.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.854+0000 7fdb5e79e700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb580b7d90 con 0x7fdb580b7540 2023-06-23T18:45:37.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.854+0000 7fdb5e79e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5814e3a0 con 0x7fdb5806a0d0 2023-06-23T18:45:37.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.854+0000 7fdb577fe700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fdb580b7540 0x7fdb5814de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:37.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.854+0000 7fdb5cd3b700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fdb580b6930 0x7fdb58147b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51744/0 (socket says 172.21.15.52:51744) 2023-06-23T18:45:37.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.854+0000 7fdb5cd3b700 1 -- 172.21.15.52:0/700183357 learned_addr learned my addr 172.21.15.52:0/700183357 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:37.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.854+0000 7fdb57fff700 1 --2- 172.21.15.52:0/700183357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb5806a0d0 0x7fdb580bc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:37.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.854+0000 7fdb577fe700 1 -- 172.21.15.52:0/700183357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb5806a0d0 msgr2=0x7fdb580bc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:37.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.854+0000 7fdb577fe700 1 --2- 172.21.15.52:0/700183357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb5806a0d0 0x7fdb580bc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:37.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.854+0000 7fdb577fe700 1 -- 172.21.15.52:0/700183357 >> v1:172.21.15.52:6789/0 conn(0x7fdb580b6930 legacy=0x7fdb58147b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:37.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.854+0000 7fdb577fe700 1 -- 172.21.15.52:0/700183357 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb580b55a0 con 0x7fdb580b7540 2023-06-23T18:45:37.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.854+0000 7fdb56ffd700 1 -- 172.21.15.52:0/700183357 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 101369685 0 0) 0x7fdb580b64a0 con 0x7fdb580b6930 2023-06-23T18:45:37.862 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.854+0000 7fdb57fff700 1 --2- 172.21.15.52:0/700183357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb5806a0d0 0x7fdb580bc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:45:37.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.855+0000 7fdb577fe700 1 --2- 172.21.15.52:0/700183357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb580b7540 0x7fdb5814de60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c009840 tx=0x7fdb4c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc1fd6352be81ac server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:37.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.855+0000 7fdb56ffd700 1 -- 172.21.15.52:0/700183357 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c011830 con 0x7fdb580b7540 2023-06-23T18:45:37.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.855+0000 7fdb56ffd700 1 -- 172.21.15.52:0/700183357 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4c011990 con 0x7fdb580b7540 2023-06-23T18:45:37.863 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.855+0000 7fdb56ffd700 1 -- 172.21.15.52:0/700183357 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c011d20 con 0x7fdb580b7540 2023-06-23T18:45:37.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.855+0000 7fdb5e79e700 1 -- 172.21.15.52:0/700183357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb580b7540 msgr2=0x7fdb5814de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:37.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.855+0000 7fdb5e79e700 1 --2- 172.21.15.52:0/700183357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb580b7540 0x7fdb5814de60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c009840 tx=0x7fdb4c009b50 comp rx=0 tx=0).stop 2023-06-23T18:45:37.865 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.855+0000 7fdb5e79e700 1 -- 172.21.15.52:0/700183357 shutdown_connections 2023-06-23T18:45:37.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.855+0000 7fdb5e79e700 1 --2- 172.21.15.52:0/700183357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb5806a0d0 0x7fdb580bc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:37.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.855+0000 7fdb5e79e700 1 --2- 172.21.15.52:0/700183357 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb580b7540 0x7fdb5814de60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:37.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.855+0000 7fdb5e79e700 1 -- 172.21.15.52:0/700183357 >> 172.21.15.52:0/700183357 conn(0x7fdb5806bb20 msgr2=0x7fdb5806bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:37.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.855+0000 7fdb5e79e700 1 -- 172.21.15.52:0/700183357 shutdown_connections 2023-06-23T18:45:37.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.855+0000 7fdb5e79e700 1 -- 172.21.15.52:0/700183357 wait complete. 2023-06-23T18:45:37.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.857+0000 7fdb5e79e700 1 Processor -- start 2023-06-23T18:45:37.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.857+0000 7fdb5e79e700 1 -- start start 2023-06-23T18:45:37.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.858+0000 7fdb5e79e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb5806a0d0 0x7fdb581dfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:37.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.858+0000 7fdb5e79e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb580b6930 0x7fdb581d59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:37.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.858+0000 7fdb5e79e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb580b7540 0x7fdb5814c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:37.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.858+0000 7fdb5e79e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5814c9d0 con 0x7fdb580b6930 2023-06-23T18:45:37.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.858+0000 7fdb5e79e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb581d54e0 con 0x7fdb5806a0d0 2023-06-23T18:45:37.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.858+0000 7fdb5e79e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb581485f0 con 0x7fdb580b7540 2023-06-23T18:45:37.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.858+0000 7fdb577fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb580b6930 0x7fdb581d59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:37.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.858+0000 7fdb577fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb580b6930 0x7fdb581d59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40180/0 (socket says 172.21.15.52:40180) 2023-06-23T18:45:37.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.858+0000 7fdb577fe700 1 -- 172.21.15.52:0/657086311 learned_addr learned my addr 172.21.15.52:0/657086311 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:37.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.858+0000 7fdb5cd3b700 1 --2- 172.21.15.52:0/657086311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb580b7540 0x7fdb5814c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:37.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.858+0000 7fdb57fff700 1 --2- 172.21.15.52:0/657086311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb5806a0d0 0x7fdb581dfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:37.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.858+0000 7fdb577fe700 1 -- 172.21.15.52:0/657086311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb580b7540 msgr2=0x7fdb5814c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:37.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.858+0000 7fdb577fe700 1 --2- 172.21.15.52:0/657086311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb580b7540 0x7fdb5814c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:37.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.858+0000 7fdb577fe700 1 -- 172.21.15.52:0/657086311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb5806a0d0 msgr2=0x7fdb581dfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:37.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.858+0000 7fdb577fe700 1 --2- 172.21.15.52:0/657086311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb5806a0d0 0x7fdb581dfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:37.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.858+0000 7fdb577fe700 1 -- 172.21.15.52:0/657086311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4c0094a0 con 0x7fdb580b6930 2023-06-23T18:45:37.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.858+0000 7fdb5cd3b700 1 --2- 172.21.15.52:0/657086311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb580b7540 0x7fdb5814c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:37.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.858+0000 7fdb577fe700 1 --2- 172.21.15.52:0/657086311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb580b6930 0x7fdb581d59c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c000c00 tx=0x7fdb4c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:37.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.859+0000 7fdb54ff9700 1 -- 172.21.15.52:0/657086311 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c0038a0 con 0x7fdb580b6930 2023-06-23T18:45:37.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.859+0000 7fdb54ff9700 1 -- 172.21.15.52:0/657086311 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4c01e070 con 0x7fdb580b6930 2023-06-23T18:45:37.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.859+0000 7fdb5e79e700 1 -- 172.21.15.52:0/657086311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb581488d0 con 0x7fdb580b6930 2023-06-23T18:45:37.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.859+0000 7fdb54ff9700 1 -- 172.21.15.52:0/657086311 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c003c60 con 0x7fdb580b6930 2023-06-23T18:45:37.869 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.859+0000 7fdb5e79e700 1 -- 172.21.15.52:0/657086311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb58149900 con 0x7fdb580b6930 2023-06-23T18:45:37.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.859+0000 7fdb5e79e700 1 -- 172.21.15.52:0/657086311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb580a6800 con 0x7fdb580b6930 2023-06-23T18:45:37.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.860+0000 7fdb54ff9700 1 -- 172.21.15.52:0/657086311 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdb4c02d450 con 0x7fdb580b6930 2023-06-23T18:45:37.870 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.860+0000 7fdb54ff9700 1 --2- 172.21.15.52:0/657086311 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdb4406ace0 0x7fdb4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:37.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.860+0000 7fdb54ff9700 1 -- 172.21.15.52:0/657086311 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdb4c08a580 con 0x7fdb580b6930 2023-06-23T18:45:37.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.861+0000 7fdb57fff700 1 --2- 172.21.15.52:0/657086311 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdb4406ace0 0x7fdb4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:37.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.861+0000 7fdb57fff700 1 --2- 172.21.15.52:0/657086311 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdb4406ace0 0x7fdb4406d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdb48006fd0 tx=0x7fdb48008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:37.871 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:37.865+0000 7fdb54ff9700 1 -- 172.21.15.52:0/657086311 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdb4c0556c0 con 0x7fdb580b6930 2023-06-23T18:45:38.070 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.064+0000 7fdb5e79e700 1 -- 172.21.15.52:0/657086311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb5804e1d0 con 0x7fdb580b6930 2023-06-23T18:45:38.071 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.065+0000 7fdb54ff9700 1 -- 172.21.15.52:0/657086311 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+18258 (secure 0 0 0) 0x7fdb4c058ce0 con 0x7fdb580b6930 2023-06-23T18:45:38.071 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:38.072 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":31,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","created":"2023-06-23T18:44:31.918434+0000","modified":"2023-06-23T18:45:37.341731+0000","last_up_change":"2023-06-23T18:44:42.169624+0000","last_in_change":"2023-06-23T18:44:34.510501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-23T18:44:43.346578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-23T18:44:43.829719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:45:34.943560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-23T18:45:36.307208+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c371fb28-1b15-4e43-8d5a-43e402920ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6812","nonce":1066999520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6815","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6818","nonce":1066999520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6829","nonce":1066999520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6823","nonce":1066999520}]},"public_addr":"172.21.15.52:6812/1066999520","cluster_addr":"172.21.15.52:6818/1066999520","heartbeat_back_addr":"172.21.15.52:6829/1066999520","heartbeat_front_addr":"172.21.15.52:6823/1066999520","state":["exists","up"]},{"osd":1,"uuid":"4a142f04-33eb-47ec-9cc5-b08b44d82658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6813","nonce":2360219751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6819","nonce":2360219751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6830","nonce":2360219751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6825","nonce":2360219751}]},"public_addr":"172.21.15.52:6813/2360219751","cluster_addr":"172.21.15.52:6819/2360219751","heartbeat_back_addr":"172.21.15.52:6830/2360219751","heartbeat_front_addr":"172.21.15.52:6825/2360219751","state":["exists","up"]},{"osd":2,"uuid":"d7bb089d-4c55-4370-ba59-7fe88c39512a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6801","nonce":835073005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6803","nonce":835073005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6807","nonce":835073005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6805","nonce":835073005}]},"public_addr":"172.21.15.52:6801/835073005","cluster_addr":"172.21.15.52:6803/835073005","heartbeat_back_addr":"172.21.15.52:6807/835073005","heartbeat_front_addr":"172.21.15.52:6805/835073005","state":["exists","up"]},{"osd":3,"uuid":"4bcdcdc3-6a8f-468e-877e-57f76079ac3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6811","nonce":2852700864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6817","nonce":2852700864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6831","nonce":2852700864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6824","nonce":2852700864}]},"public_addr":"172.21.15.52:6811/2852700864","cluster_addr":"172.21.15.52:6817/2852700864","heartbeat_back_addr":"172.21.15.52:6831/2852700864","heartbeat_front_addr":"172.21.15.52:6824/2852700864","state":["exists","up"]},{"osd":4,"uuid":"cac63000-ae94-4b08-93e6-a99119640b63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6809","nonce":2538664679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6811","nonce":2538664679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6815","nonce":2538664679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6813","nonce":2538664679}]},"public_addr":"172.21.15.89:6809/2538664679","cluster_addr":"172.21.15.89:6811/2538664679","heartbeat_back_addr":"172.21.15.89:6815/2538664679","heartbeat_front_addr":"172.21.15.89:6813/2538664679","state":["exists","up"]},{"osd":5,"uuid":"45c53102-18a6-4fd7-9c25-8ea5e1ef6851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6801","nonce":1683710352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6803","nonce":1683710352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6807","nonce":1683710352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6805","nonce":1683710352}]},"public_addr":"172.21.15.89:6801/1683710352","cluster_addr":"172.21.15.89:6803/1683710352","heartbeat_back_addr":"172.21.15.89:6807/1683710352","heartbeat_front_addr":"172.21.15.89:6805/1683710352","state":["exists","up"]},{"osd":6,"uuid":"abee09d1-8eba-484f-a25c-871c1fe2e843","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6817","nonce":3890899288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6819","nonce":3890899288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6823","nonce":3890899288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6821","nonce":3890899288}]},"public_addr":"172.21.15.89:6817/3890899288","cluster_addr":"172.21.15.89:6819/3890899288","heartbeat_back_addr":"172.21.15.89:6823/3890899288","heartbeat_front_addr":"172.21.15.89:6821/3890899288","state":["exists","up"]},{"osd":7,"uuid":"5acf9e2e-00dd-4f9b-a7d9-3d820f695de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6825","nonce":2989085420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6827","nonce":2989085420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6831","nonce":2989085420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6829","nonce":2989085420}]},"public_addr":"172.21.15.89:6825/2989085420","cluster_addr":"172.21.15.89:6827/2989085420","heartbeat_back_addr":"172.21.15.89:6831/2989085420","heartbeat_front_addr":"172.21.15.89:6829/2989085420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.663866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.710904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.619347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.660102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.686933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.724635+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.669111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.678740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:45:38.073 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.067+0000 7fdb5e79e700 1 -- 172.21.15.52:0/657086311 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdb4406ace0 msgr2=0x7fdb4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:38.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.068+0000 7fdb5e79e700 1 --2- 172.21.15.52:0/657086311 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdb4406ace0 0x7fdb4406d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdb48006fd0 tx=0x7fdb48008040 comp rx=0 tx=0).stop 2023-06-23T18:45:38.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.068+0000 7fdb5e79e700 1 -- 172.21.15.52:0/657086311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb580b6930 msgr2=0x7fdb581d59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:38.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.068+0000 7fdb5e79e700 1 --2- 172.21.15.52:0/657086311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb580b6930 0x7fdb581d59c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c000c00 tx=0x7fdb4c004750 comp rx=0 tx=0).stop 2023-06-23T18:45:38.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.068+0000 7fdb5e79e700 1 -- 172.21.15.52:0/657086311 shutdown_connections 2023-06-23T18:45:38.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.068+0000 7fdb5e79e700 1 --2- 172.21.15.52:0/657086311 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fdb4406ace0 0x7fdb4406d190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:38.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.068+0000 7fdb5e79e700 1 --2- 172.21.15.52:0/657086311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdb580b7540 0x7fdb5814c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:38.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.068+0000 7fdb5e79e700 1 --2- 172.21.15.52:0/657086311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb5806a0d0 0x7fdb581dfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:38.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.068+0000 7fdb5e79e700 1 --2- 172.21.15.52:0/657086311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdb580b6930 0x7fdb581d59c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:38.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.068+0000 7fdb5e79e700 1 -- 172.21.15.52:0/657086311 >> 172.21.15.52:0/657086311 conn(0x7fdb5806bb20 msgr2=0x7fdb58144d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:38.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.068+0000 7fdb5e79e700 1 -- 172.21.15.52:0/657086311 shutdown_connections 2023-06-23T18:45:38.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.068+0000 7fdb5e79e700 1 -- 172.21.15.52:0/657086311 wait complete. 2023-06-23T18:45:38.086 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-23T18:45:38.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.208+0000 7fa8079e5700 1 Processor -- start 2023-06-23T18:45:38.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.209+0000 7fa8079e5700 1 -- start start 2023-06-23T18:45:38.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.210+0000 7fa8079e5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa800070930 0x7fa80006fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:38.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.210+0000 7fa8079e5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa8000afe00 0x7fa8000b0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:38.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.210+0000 7fa8079e5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8000b6fe0 con 0x7fa80006b0e0 2023-06-23T18:45:38.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.210+0000 7fa8079e5700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8000b0740 con 0x7fa800070930 2023-06-23T18:45:38.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.210+0000 7fa8079e5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa800071c00 con 0x7fa8000afe00 2023-06-23T18:45:38.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.210+0000 7fa804f80700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa800070930 0x7fa80006fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:38.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.210+0000 7fa804f80700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fa800070930 0x7fa80006fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40190/0 (socket says 172.21.15.52:40190) 2023-06-23T18:45:38.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.210+0000 7fa804f80700 1 -- 172.21.15.52:0/3582798026 learned_addr learned my addr 172.21.15.52:0/3582798026 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:38.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.210+0000 7fa805f82700 1 --2- 172.21.15.52:0/3582798026 >> v2:172.21.15.89:3300/0 conn(0x7fa8000afe00 0x7fa8000b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:38.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.210+0000 7fa804f80700 1 -- 172.21.15.52:0/3582798026 >> v2:172.21.15.89:3300/0 conn(0x7fa8000afe00 msgr2=0x7fa8000b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:38.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.210+0000 7fa804f80700 1 --2- 172.21.15.52:0/3582798026 >> v2:172.21.15.89:3300/0 conn(0x7fa8000afe00 0x7fa8000b0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:38.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.210+0000 7fa804f80700 1 -- 172.21.15.52:0/3582798026 >> v1:172.21.15.89:6789/0 conn(0x7fa80006b0e0 legacy=0x7fa8000b73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:38.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.210+0000 7fa804f80700 1 -- 172.21.15.52:0/3582798026 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8000b6a20 con 0x7fa800070930 2023-06-23T18:45:38.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.210+0000 7fa804f80700 1 --2- 172.21.15.52:0/3582798026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa800070930 0x7fa80006fab0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa8000b89d0 tx=0x7fa7f0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b577c5a2beda5f4 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:38.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.210+0000 7fa7f7fff700 1 -- 172.21.15.52:0/3582798026 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0004230 con 0x7fa800070930 2023-06-23T18:45:38.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.211+0000 7fa7f7fff700 1 -- 172.21.15.52:0/3582798026 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f0004390 con 0x7fa800070930 2023-06-23T18:45:38.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.211+0000 7fa7f7fff700 1 -- 172.21.15.52:0/3582798026 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f00036a0 con 0x7fa800070930 2023-06-23T18:45:38.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.211+0000 7fa8079e5700 1 -- 172.21.15.52:0/3582798026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa800070930 msgr2=0x7fa80006fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:38.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.211+0000 7fa8079e5700 1 --2- 172.21.15.52:0/3582798026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa800070930 0x7fa80006fab0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa8000b89d0 tx=0x7fa7f0009bd0 comp rx=0 tx=0).stop 2023-06-23T18:45:38.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.211+0000 7fa8079e5700 1 -- 172.21.15.52:0/3582798026 shutdown_connections 2023-06-23T18:45:38.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.211+0000 7fa8079e5700 1 --2- 172.21.15.52:0/3582798026 >> v2:172.21.15.89:3300/0 conn(0x7fa8000afe00 0x7fa8000b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:38.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.211+0000 7fa8079e5700 1 --2- 172.21.15.52:0/3582798026 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa800070930 0x7fa80006fab0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:38.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.211+0000 7fa8079e5700 1 -- 172.21.15.52:0/3582798026 >> 172.21.15.52:0/3582798026 conn(0x7fa8000b95c0 msgr2=0x7fa8000b99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:38.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.211+0000 7fa8079e5700 1 -- 172.21.15.52:0/3582798026 shutdown_connections 2023-06-23T18:45:38.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.211+0000 7fa8079e5700 1 -- 172.21.15.52:0/3582798026 wait complete. 2023-06-23T18:45:38.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.213+0000 7fa8079e5700 1 Processor -- start 2023-06-23T18:45:38.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.213+0000 7fa8079e5700 1 -- start start 2023-06-23T18:45:38.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.213+0000 7fa8079e5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa80006b0e0 0x7fa8001d4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:38.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.213+0000 7fa8079e5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa800070930 0x7fa80014ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:38.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.213+0000 7fa8079e5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8000afe00 0x7fa80014b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:38.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.213+0000 7fa8079e5700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8001d4aa0 con 0x7fa8000afe00 2023-06-23T18:45:38.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.213+0000 7fa8079e5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8000b44a0 con 0x7fa800070930 2023-06-23T18:45:38.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.213+0000 7fa8079e5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8000b5250 con 0x7fa80006b0e0 2023-06-23T18:45:38.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.214+0000 7fa805f82700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8000afe00 0x7fa80014b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:38.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.214+0000 7fa805f82700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8000afe00 0x7fa80014b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40196/0 (socket says 172.21.15.52:40196) 2023-06-23T18:45:38.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.214+0000 7fa805f82700 1 -- 172.21.15.52:0/1563787215 learned_addr learned my addr 172.21.15.52:0/1563787215 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:38.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.214+0000 7fa804f80700 1 --2- 172.21.15.52:0/1563787215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa800070930 0x7fa80014ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:38.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.214+0000 7fa805781700 1 --2- 172.21.15.52:0/1563787215 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa80006b0e0 0x7fa8001d4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:38.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.214+0000 7fa805f82700 1 -- 172.21.15.52:0/1563787215 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa80006b0e0 msgr2=0x7fa8001d4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:38.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.214+0000 7fa805f82700 1 --2- 172.21.15.52:0/1563787215 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa80006b0e0 0x7fa8001d4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:38.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.214+0000 7fa805f82700 1 -- 172.21.15.52:0/1563787215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa800070930 msgr2=0x7fa80014ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:38.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.214+0000 7fa805f82700 1 --2- 172.21.15.52:0/1563787215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa800070930 0x7fa80014ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:38.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.214+0000 7fa805f82700 1 -- 172.21.15.52:0/1563787215 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f0009550 con 0x7fa8000afe00 2023-06-23T18:45:38.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.214+0000 7fa805f82700 1 --2- 172.21.15.52:0/1563787215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8000afe00 0x7fa80014b1c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8007e60 tx=0x7fa7f800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:38.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.214+0000 7fa7f5ffb700 1 -- 172.21.15.52:0/1563787215 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f800ed30 con 0x7fa8000afe00 2023-06-23T18:45:38.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.214+0000 7fa7f5ffb700 1 -- 172.21.15.52:0/1563787215 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f8014420 con 0x7fa8000afe00 2023-06-23T18:45:38.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.214+0000 7fa8079e5700 1 -- 172.21.15.52:0/1563787215 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8000b3470 con 0x7fa8000afe00 2023-06-23T18:45:38.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.214+0000 7fa7f5ffb700 1 -- 172.21.15.52:0/1563787215 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f80147d0 con 0x7fa8000afe00 2023-06-23T18:45:38.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.214+0000 7fa8079e5700 1 -- 172.21.15.52:0/1563787215 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8000b3c80 con 0x7fa8000afe00 2023-06-23T18:45:38.226 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.215+0000 7fa8079e5700 1 -- 172.21.15.52:0/1563787215 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8000b37d0 con 0x7fa8000afe00 2023-06-23T18:45:38.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.216+0000 7fa7f5ffb700 1 -- 172.21.15.52:0/1563787215 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa7f8014930 con 0x7fa8000afe00 2023-06-23T18:45:38.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.216+0000 7fa7f5ffb700 1 --2- 172.21.15.52:0/1563787215 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa7e406ace0 0x7fa7e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:38.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.216+0000 7fa7f5ffb700 1 -- 172.21.15.52:0/1563787215 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa7f8089ac0 con 0x7fa8000afe00 2023-06-23T18:45:38.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.216+0000 7fa805781700 1 --2- 172.21.15.52:0/1563787215 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa7e406ace0 0x7fa7e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:38.227 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.217+0000 7fa805781700 1 --2- 172.21.15.52:0/1563787215 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa7e406ace0 0x7fa7e406d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc007fd0 tx=0x7fa7fc007ec0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:38.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.221+0000 7fa7f5ffb700 1 -- 172.21.15.52:0/1563787215 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa7f8054b70 con 0x7fa8000afe00 2023-06-23T18:45:38.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:38.463+0000 7fa8079e5700 1 -- 172.21.15.52:0/1563787215 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa80004e1d0 con 0x7fa8000afe00 2023-06-23T18:45:39.359 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.353+0000 7fa7f5ffb700 1 -- 172.21.15.52:0/1563787215 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa7f8089e60 con 0x7fa8000afe00 2023-06-23T18:45:39.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.355+0000 7fa8079e5700 1 -- 172.21.15.52:0/1563787215 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa7e406ace0 msgr2=0x7fa7e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:39.362 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.355+0000 7fa8079e5700 1 --2- 172.21.15.52:0/1563787215 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa7e406ace0 0x7fa7e406d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc007fd0 tx=0x7fa7fc007ec0 comp rx=0 tx=0).stop 2023-06-23T18:45:39.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.356+0000 7fa8079e5700 1 -- 172.21.15.52:0/1563787215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8000afe00 msgr2=0x7fa80014b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:39.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.356+0000 7fa8079e5700 1 --2- 172.21.15.52:0/1563787215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8000afe00 0x7fa80014b1c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa7f8007e60 tx=0x7fa7f800e3c0 comp rx=0 tx=0).stop 2023-06-23T18:45:39.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.356+0000 7fa8079e5700 1 -- 172.21.15.52:0/1563787215 shutdown_connections 2023-06-23T18:45:39.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.356+0000 7fa8079e5700 1 --2- 172.21.15.52:0/1563787215 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fa7e406ace0 0x7fa7e406d190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:39.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.356+0000 7fa8079e5700 1 --2- 172.21.15.52:0/1563787215 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8000afe00 0x7fa80014b1c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:39.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.356+0000 7fa8079e5700 1 --2- 172.21.15.52:0/1563787215 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa80006b0e0 0x7fa8001d4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:39.364 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.356+0000 7fa8079e5700 1 --2- 172.21.15.52:0/1563787215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa800070930 0x7fa80014ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:39.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.356+0000 7fa8079e5700 1 -- 172.21.15.52:0/1563787215 >> 172.21.15.52:0/1563787215 conn(0x7fa8000b95c0 msgr2=0x7fa8001d0980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:39.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.356+0000 7fa8079e5700 1 -- 172.21.15.52:0/1563787215 shutdown_connections 2023-06-23T18:45:39.365 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.356+0000 7fa8079e5700 1 -- 172.21.15.52:0/1563787215 wait complete. 2023-06-23T18:45:39.376 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-23T18:45:39.377 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-23T18:45:39.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.506+0000 7ff48b7c4700 1 Processor -- start 2023-06-23T18:45:39.512 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.506+0000 7ff48b7c4700 1 -- start start 2023-06-23T18:45:39.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.507+0000 7ff48b7c4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4840b9170 0x7ff48406cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:39.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.507+0000 7ff48b7c4700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4840be840 0x7ff484154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:39.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.507+0000 7ff48b7c4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff48414a680 con 0x7ff4840be470 2023-06-23T18:45:39.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.507+0000 7ff48b7c4700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff48406b6c0 con 0x7ff4840be840 2023-06-23T18:45:39.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.507+0000 7ff48b7c4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48406cff0 con 0x7ff4840b9170 2023-06-23T18:45:39.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.507+0000 7ff489d61700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4840be840 0x7ff484154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:39.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.507+0000 7ff489d61700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7ff4840be840 0x7ff484154fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40198/0 (socket says 172.21.15.52:40198) 2023-06-23T18:45:39.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.507+0000 7ff489d61700 1 -- 172.21.15.52:0/820929542 learned_addr learned my addr 172.21.15.52:0/820929542 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:39.516 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.507+0000 7ff488d5f700 1 --2- 172.21.15.52:0/820929542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4840b9170 0x7ff48406cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:39.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.508+0000 7ff489d61700 1 -- 172.21.15.52:0/820929542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4840b9170 msgr2=0x7ff48406cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:39.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.508+0000 7ff489d61700 1 --2- 172.21.15.52:0/820929542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4840b9170 0x7ff48406cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:39.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.508+0000 7ff489d61700 1 -- 172.21.15.52:0/820929542 >> v1:172.21.15.89:6789/0 conn(0x7ff4840be470 legacy=0x7ff48414b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:39.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.508+0000 7ff489d61700 1 -- 172.21.15.52:0/820929542 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48406b3e0 con 0x7ff4840be840 2023-06-23T18:45:39.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.508+0000 7ff489d61700 1 --2- 172.21.15.52:0/820929542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4840be840 0x7ff484154fe0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff47c0098f0 tx=0x7ff47c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a75407e05f0f50 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:39.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.508+0000 7ff483fff700 1 -- 172.21.15.52:0/820929542 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c00b8a0 con 0x7ff4840be840 2023-06-23T18:45:39.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.508+0000 7ff483fff700 1 -- 172.21.15.52:0/820929542 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47c00ba00 con 0x7ff4840be840 2023-06-23T18:45:39.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.508+0000 7ff483fff700 1 -- 172.21.15.52:0/820929542 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c00bd90 con 0x7ff4840be840 2023-06-23T18:45:39.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.508+0000 7ff48b7c4700 1 -- 172.21.15.52:0/820929542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4840be840 msgr2=0x7ff484154fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:39.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.508+0000 7ff48b7c4700 1 --2- 172.21.15.52:0/820929542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4840be840 0x7ff484154fe0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff47c0098f0 tx=0x7ff47c009c00 comp rx=0 tx=0).stop 2023-06-23T18:45:39.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.508+0000 7ff48b7c4700 1 -- 172.21.15.52:0/820929542 shutdown_connections 2023-06-23T18:45:39.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.508+0000 7ff48b7c4700 1 --2- 172.21.15.52:0/820929542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4840be840 0x7ff484154fe0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:39.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.508+0000 7ff48b7c4700 1 --2- 172.21.15.52:0/820929542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4840b9170 0x7ff48406cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:39.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.508+0000 7ff48b7c4700 1 -- 172.21.15.52:0/820929542 >> 172.21.15.52:0/820929542 conn(0x7ff484071410 msgr2=0x7ff484071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:39.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.509+0000 7ff48b7c4700 1 -- 172.21.15.52:0/820929542 shutdown_connections 2023-06-23T18:45:39.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.509+0000 7ff48b7c4700 1 -- 172.21.15.52:0/820929542 wait complete. 2023-06-23T18:45:39.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.510+0000 7ff48b7c4700 1 Processor -- start 2023-06-23T18:45:39.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.510+0000 7ff48b7c4700 1 -- start start 2023-06-23T18:45:39.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.510+0000 7ff48b7c4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4840b9170 0x7ff484149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:39.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.510+0000 7ff48b7c4700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4840be470 0x7ff48414d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:39.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.510+0000 7ff48b7c4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4840be840 0x7ff4841465e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:39.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.510+0000 7ff48b7c4700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48414a100 con 0x7ff4840be470 2023-06-23T18:45:39.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.510+0000 7ff48b7c4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff484146150 con 0x7ff4840be840 2023-06-23T18:45:39.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.510+0000 7ff48b7c4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48414c7a0 con 0x7ff4840b9170 2023-06-23T18:45:39.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.510+0000 7ff488d5f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4840be470 0x7ff48414d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:39.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.510+0000 7ff488d5f700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4840be470 0x7ff48414d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40212/0 (socket says 172.21.15.52:40212) 2023-06-23T18:45:39.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.510+0000 7ff488d5f700 1 -- 172.21.15.52:0/1082023719 learned_addr learned my addr 172.21.15.52:0/1082023719 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:39.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.510+0000 7ff489d61700 1 --2- 172.21.15.52:0/1082023719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4840be840 0x7ff4841465e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:39.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.510+0000 7ff489560700 1 --2- 172.21.15.52:0/1082023719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4840b9170 0x7ff484149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:39.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.511+0000 7ff488d5f700 1 -- 172.21.15.52:0/1082023719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4840b9170 msgr2=0x7ff484149bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:39.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.511+0000 7ff488d5f700 1 --2- 172.21.15.52:0/1082023719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4840b9170 0x7ff484149bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:39.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.511+0000 7ff488d5f700 1 -- 172.21.15.52:0/1082023719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4840be840 msgr2=0x7ff4841465e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:39.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.511+0000 7ff488d5f700 1 --2- 172.21.15.52:0/1082023719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4840be840 0x7ff4841465e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:39.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.511+0000 7ff488d5f700 1 -- 172.21.15.52:0/1082023719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c009550 con 0x7ff4840be470 2023-06-23T18:45:39.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.511+0000 7ff488d5f700 1 --2- 172.21.15.52:0/1082023719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4840be470 0x7ff48414d3f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff47800e810 tx=0x7ff47800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:39.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.511+0000 7ff481ffb700 1 -- 172.21.15.52:0/1082023719 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47800c070 con 0x7ff4840be470 2023-06-23T18:45:39.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.511+0000 7ff481ffb700 1 -- 172.21.15.52:0/1082023719 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff478013610 con 0x7ff4840be470 2023-06-23T18:45:39.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.511+0000 7ff48b7c4700 1 -- 172.21.15.52:0/1082023719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff48414ca80 con 0x7ff4840be470 2023-06-23T18:45:39.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.511+0000 7ff481ffb700 1 -- 172.21.15.52:0/1082023719 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4780139c0 con 0x7ff4840be470 2023-06-23T18:45:39.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.511+0000 7ff48b7c4700 1 -- 172.21.15.52:0/1082023719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff484147b90 con 0x7ff4840be470 2023-06-23T18:45:39.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.512+0000 7ff48b7c4700 1 -- 172.21.15.52:0/1082023719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff484142ce0 con 0x7ff4840be470 2023-06-23T18:45:39.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.513+0000 7ff481ffb700 1 -- 172.21.15.52:0/1082023719 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff478013b20 con 0x7ff4840be470 2023-06-23T18:45:39.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.513+0000 7ff481ffb700 1 --2- 172.21.15.52:0/1082023719 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff47006ace0 0x7ff47006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:39.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.513+0000 7ff481ffb700 1 -- 172.21.15.52:0/1082023719 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff478089230 con 0x7ff4840be470 2023-06-23T18:45:39.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.513+0000 7ff489560700 1 --2- 172.21.15.52:0/1082023719 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff47006ace0 0x7ff47006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:39.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.514+0000 7ff489560700 1 --2- 172.21.15.52:0/1082023719 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff47006ace0 0x7ff47006d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff4740012e0 tx=0x7ff474009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:39.525 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.517+0000 7ff481ffb700 1 -- 172.21.15.52:0/1082023719 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff478057d80 con 0x7ff4840be470 2023-06-23T18:45:39.763 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:39.757+0000 7ff48b7c4700 1 -- 172.21.15.52:0/1082023719 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff48404e1d0 con 0x7ff4840be470 2023-06-23T18:45:39.903 INFO:tasks.ceph.mds.c.smithi052.stderr:2023-06-23T18:45:39.898+0000 7fc6313a4700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-23T18:45:40.363 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.357+0000 7ff481ffb700 1 -- 172.21.15.52:0/1082023719 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff478057910 con 0x7ff4840be470 2023-06-23T18:45:40.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.360+0000 7ff48b7c4700 1 -- 172.21.15.52:0/1082023719 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff47006ace0 msgr2=0x7ff47006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:40.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.360+0000 7ff48b7c4700 1 --2- 172.21.15.52:0/1082023719 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff47006ace0 0x7ff47006d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff4740012e0 tx=0x7ff474009040 comp rx=0 tx=0).stop 2023-06-23T18:45:40.366 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.360+0000 7ff48b7c4700 1 -- 172.21.15.52:0/1082023719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4840be470 msgr2=0x7ff48414d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:40.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.360+0000 7ff48b7c4700 1 --2- 172.21.15.52:0/1082023719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4840be470 0x7ff48414d3f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff47800e810 tx=0x7ff47800eb20 comp rx=0 tx=0).stop 2023-06-23T18:45:40.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.360+0000 7ff48b7c4700 1 -- 172.21.15.52:0/1082023719 shutdown_connections 2023-06-23T18:45:40.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.360+0000 7ff48b7c4700 1 --2- 172.21.15.52:0/1082023719 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7ff47006ace0 0x7ff47006d190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:40.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.360+0000 7ff48b7c4700 1 --2- 172.21.15.52:0/1082023719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4840be840 0x7ff4841465e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:40.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.360+0000 7ff48b7c4700 1 --2- 172.21.15.52:0/1082023719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff4840b9170 0x7ff484149bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:40.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.360+0000 7ff48b7c4700 1 --2- 172.21.15.52:0/1082023719 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff4840be470 0x7ff48414d3f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:40.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.360+0000 7ff48b7c4700 1 -- 172.21.15.52:0/1082023719 >> 172.21.15.52:0/1082023719 conn(0x7ff484071410 msgr2=0x7ff4841425d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:40.367 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.360+0000 7ff48b7c4700 1 -- 172.21.15.52:0/1082023719 shutdown_connections 2023-06-23T18:45:40.368 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.360+0000 7ff48b7c4700 1 -- 172.21.15.52:0/1082023719 wait complete. 2023-06-23T18:45:40.381 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-23T18:45:40.381 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T18:45:40.514 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.509+0000 7fbaa5e38700 1 Processor -- start 2023-06-23T18:45:40.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.509+0000 7fbaa5e38700 1 -- start start 2023-06-23T18:45:40.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.509+0000 7fbaa5e38700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbaa006c1f0 0x7fbaa00b8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:40.517 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.509+0000 7fbaa5e38700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa00b98a0 con 0x7fbaa00b9310 2023-06-23T18:45:40.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.509+0000 7fbaa5e38700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa014a6a0 con 0x7fbaa014da40 2023-06-23T18:45:40.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.509+0000 7fbaa5e38700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa014a980 con 0x7fbaa006c1f0 2023-06-23T18:45:40.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.509+0000 7fba9ffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fbaa00b9310 0x7fbaa01443e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51752/0 (socket says 172.21.15.52:51752) 2023-06-23T18:45:40.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.510+0000 7fba9ffff700 1 -- 172.21.15.52:0/2299958761 learned_addr learned my addr 172.21.15.52:0/2299958761 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:40.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.510+0000 7fba9f7fe700 1 --2- 172.21.15.52:0/2299958761 >> v2:172.21.15.89:3300/0 conn(0x7fbaa006c1f0 0x7fbaa00b8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:40.518 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.510+0000 7fba9e7fc700 1 -- 172.21.15.52:0/2299958761 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 755937687 0 0) 0x7fbaa00b98a0 con 0x7fbaa00b9310 2023-06-23T18:45:40.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.510+0000 7fba9e7fc700 1 -- 172.21.15.52:0/2299958761 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba880035b0 con 0x7fbaa00b9310 2023-06-23T18:45:40.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.510+0000 7fba9e7fc700 1 -- 172.21.15.52:0/2299958761 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 188806106 0 0) 0x7fbaa014a6a0 con 0x7fbaa014da40 2023-06-23T18:45:40.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.510+0000 7fba9e7fc700 1 -- 172.21.15.52:0/2299958761 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaa00b98a0 con 0x7fbaa014da40 2023-06-23T18:45:40.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.510+0000 7fba9e7fc700 1 -- 172.21.15.52:0/2299958761 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1987637677 0 0) 0x7fba880035b0 con 0x7fbaa00b9310 2023-06-23T18:45:40.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.510+0000 7fba9e7fc700 1 -- 172.21.15.52:0/2299958761 >> v2:172.21.15.89:3300/0 conn(0x7fbaa006c1f0 msgr2=0x7fbaa00b8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:40.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.510+0000 7fba9e7fc700 1 --2- 172.21.15.52:0/2299958761 >> v2:172.21.15.89:3300/0 conn(0x7fbaa006c1f0 0x7fbaa00b8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:40.519 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.510+0000 7fba9e7fc700 1 -- 172.21.15.52:0/2299958761 >> v1:172.21.15.89:6789/0 conn(0x7fbaa014da40 legacy=0x7fbaa014aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:40.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.510+0000 7fba9e7fc700 1 -- 172.21.15.52:0/2299958761 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa0144af0 con 0x7fbaa00b9310 2023-06-23T18:45:40.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.510+0000 7fba9e7fc700 1 -- 172.21.15.52:0/2299958761 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7fba980019f0 con 0x7fbaa00b9310 2023-06-23T18:45:40.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.510+0000 7fba9e7fc700 1 -- 172.21.15.52:0/2299958761 >> v1:172.21.15.52:6789/0 conn(0x7fbaa00b9310 legacy=0x7fbaa01443e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:40.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.510+0000 7fba9e7fc700 1 --2- 172.21.15.52:0/2299958761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba88003be0 0x7fba88003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:40.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.510+0000 7fba9e7fc700 1 --2- 172.21.15.52:0/2299958761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba88004850 0x7fba88004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:40.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.510+0000 7fba9e7fc700 1 --2- 172.21.15.52:0/2299958761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba88005200 0x7fba8800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:40.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.510+0000 7fba9e7fc700 1 -- 172.21.15.52:0/2299958761 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa014a980 con 0x7fba88003be0 2023-06-23T18:45:40.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.510+0000 7fba9e7fc700 1 -- 172.21.15.52:0/2299958761 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8800c030 con 0x7fba88004850 2023-06-23T18:45:40.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.510+0000 7fba9e7fc700 1 -- 172.21.15.52:0/2299958761 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8800c1f0 con 0x7fba88005200 2023-06-23T18:45:40.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.510+0000 7fba9f7fe700 1 --2- 172.21.15.52:0/2299958761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba88003be0 0x7fba88003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:40.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.510+0000 7fba9effd700 1 --2- 172.21.15.52:0/2299958761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba88004850 0x7fba88004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:40.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.510+0000 7fba9ffff700 1 --2- 172.21.15.52:0/2299958761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba88005200 0x7fba8800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:40.521 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.510+0000 7fba9f7fe700 1 -- 172.21.15.52:0/2299958761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba88005200 msgr2=0x7fba8800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:40.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.511+0000 7fba9f7fe700 1 --2- 172.21.15.52:0/2299958761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba88005200 0x7fba8800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:40.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.511+0000 7fba9f7fe700 1 -- 172.21.15.52:0/2299958761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba88004850 msgr2=0x7fba88004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:40.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.511+0000 7fba9f7fe700 1 --2- 172.21.15.52:0/2299958761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba88004850 0x7fba88004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:40.522 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.511+0000 7fba9f7fe700 1 -- 172.21.15.52:0/2299958761 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba880035b0 con 0x7fba88003be0 2023-06-23T18:45:40.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.511+0000 7fba9effd700 1 --2- 172.21.15.52:0/2299958761 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba88004850 0x7fba88004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:40.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.511+0000 7fba9ffff700 1 --2- 172.21.15.52:0/2299958761 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba88005200 0x7fba8800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:45:40.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.511+0000 7fba9ffff700 1 -- 172.21.15.52:0/2299958761 reap_dead start 2023-06-23T18:45:40.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.511+0000 7fba9f7fe700 1 --2- 172.21.15.52:0/2299958761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba88003be0 0x7fba88003fd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fba900096f0 tx=0x7fba88005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684dc81273df0015 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:40.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.511+0000 7fba9e7fc700 1 -- 172.21.15.52:0/2299958761 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba90017a50 con 0x7fba88003be0 2023-06-23T18:45:40.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.511+0000 7fba9e7fc700 1 -- 172.21.15.52:0/2299958761 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba90017bb0 con 0x7fba88003be0 2023-06-23T18:45:40.523 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.511+0000 7fba9e7fc700 1 -- 172.21.15.52:0/2299958761 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9000e6c0 con 0x7fba88003be0 2023-06-23T18:45:40.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.511+0000 7fbaa5e38700 1 -- 172.21.15.52:0/2299958761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba88003be0 msgr2=0x7fba88003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:40.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.511+0000 7fbaa5e38700 1 --2- 172.21.15.52:0/2299958761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba88003be0 0x7fba88003fd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fba900096f0 tx=0x7fba88005880 comp rx=0 tx=0).stop 2023-06-23T18:45:40.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.511+0000 7fbaa5e38700 1 -- 172.21.15.52:0/2299958761 shutdown_connections 2023-06-23T18:45:40.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.511+0000 7fbaa5e38700 1 --2- 172.21.15.52:0/2299958761 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fba88003be0 0x7fba88003fd0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:40.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.511+0000 7fbaa5e38700 1 -- 172.21.15.52:0/2299958761 >> 172.21.15.52:0/2299958761 conn(0x7fbaa00bdf30 msgr2=0x7fbaa00b9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:40.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.511+0000 7fbaa5e38700 1 -- 172.21.15.52:0/2299958761 shutdown_connections 2023-06-23T18:45:40.524 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.512+0000 7fbaa5e38700 1 -- 172.21.15.52:0/2299958761 wait complete. 2023-06-23T18:45:40.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.513+0000 7fbaa5e38700 1 Processor -- start 2023-06-23T18:45:40.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.513+0000 7fbaa5e38700 1 -- start start 2023-06-23T18:45:40.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.514+0000 7fbaa5e38700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba88003be0 0x7fbaa0149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:40.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.514+0000 7fbaa5e38700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbaa0147d40 0x7fbaa00b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:40.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.514+0000 7fbaa5e38700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbaa01405c0 0x7fbaa013e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:40.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.514+0000 7fbaa5e38700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa00b4b50 con 0x7fbaa01405c0 2023-06-23T18:45:40.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.514+0000 7fbaa5e38700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa0140a30 con 0x7fbaa0147d40 2023-06-23T18:45:40.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.514+0000 7fbaa5e38700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa014a2a0 con 0x7fba88003be0 2023-06-23T18:45:40.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.514+0000 7fba9ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbaa01405c0 0x7fbaa013e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:40.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.514+0000 7fba9ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbaa01405c0 0x7fbaa013e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40232/0 (socket says 172.21.15.52:40232) 2023-06-23T18:45:40.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.514+0000 7fba9ffff700 1 -- 172.21.15.52:0/2902232174 learned_addr learned my addr 172.21.15.52:0/2902232174 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:40.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.514+0000 7fba9effd700 1 --2- 172.21.15.52:0/2902232174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbaa0147d40 0x7fbaa00b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:40.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.514+0000 7fba9f7fe700 1 --2- 172.21.15.52:0/2902232174 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba88003be0 0x7fbaa0149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:40.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.514+0000 7fba9ffff700 1 -- 172.21.15.52:0/2902232174 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba88003be0 msgr2=0x7fbaa0149b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:40.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.514+0000 7fba9ffff700 1 --2- 172.21.15.52:0/2902232174 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba88003be0 0x7fbaa0149b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:40.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.514+0000 7fba9ffff700 1 -- 172.21.15.52:0/2902232174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbaa0147d40 msgr2=0x7fbaa00b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:40.529 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.514+0000 7fba9ffff700 1 --2- 172.21.15.52:0/2902232174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbaa0147d40 0x7fbaa00b5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:40.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.514+0000 7fba9ffff700 1 -- 172.21.15.52:0/2902232174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa00b4870 con 0x7fbaa01405c0 2023-06-23T18:45:40.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.514+0000 7fba9f7fe700 1 --2- 172.21.15.52:0/2902232174 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba88003be0 0x7fbaa0149b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:45:40.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.515+0000 7fba9ffff700 1 --2- 172.21.15.52:0/2902232174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbaa01405c0 0x7fbaa013e4a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbaa014eb10 tx=0x7fba9800dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:40.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.515+0000 7fba87fff700 1 -- 172.21.15.52:0/2902232174 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9800ba40 con 0x7fbaa01405c0 2023-06-23T18:45:40.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.515+0000 7fba87fff700 1 -- 172.21.15.52:0/2902232174 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9800bba0 con 0x7fbaa01405c0 2023-06-23T18:45:40.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.515+0000 7fbaa5e38700 1 -- 172.21.15.52:0/2902232174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa00b5090 con 0x7fbaa01405c0 2023-06-23T18:45:40.530 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.515+0000 7fba87fff700 1 -- 172.21.15.52:0/2902232174 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba98007030 con 0x7fbaa01405c0 2023-06-23T18:45:40.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.515+0000 7fbaa5e38700 1 -- 172.21.15.52:0/2902232174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa0140f70 con 0x7fbaa01405c0 2023-06-23T18:45:40.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.516+0000 7fbaa5e38700 1 -- 172.21.15.52:0/2902232174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa00b4ef0 con 0x7fbaa01405c0 2023-06-23T18:45:40.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.516+0000 7fba87fff700 1 -- 172.21.15.52:0/2902232174 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fba98007190 con 0x7fbaa01405c0 2023-06-23T18:45:40.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.516+0000 7fba87fff700 1 --2- 172.21.15.52:0/2902232174 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fba8c06ace0 0x7fba8c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:40.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.517+0000 7fba87fff700 1 -- 172.21.15.52:0/2902232174 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fba98088ea0 con 0x7fbaa01405c0 2023-06-23T18:45:40.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.517+0000 7fba9f7fe700 1 --2- 172.21.15.52:0/2902232174 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fba8c06ace0 0x7fba8c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:40.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.517+0000 7fba9f7fe700 1 --2- 172.21.15.52:0/2902232174 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fba8c06ace0 0x7fba8c06d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fba900090b0 tx=0x7fba9001b000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:40.531 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.521+0000 7fba87fff700 1 -- 172.21.15.52:0/2902232174 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbaa00b4ef0 con 0x7fbaa01405c0 2023-06-23T18:45:40.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.760+0000 7fbaa5e38700 1 -- 172.21.15.52:0/2902232174 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbaa00b4ef0 con 0x7fbaa01405c0 2023-06-23T18:45:40.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.760+0000 7fba87fff700 1 -- 172.21.15.52:0/2902232174 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+3914 (secure 0 0 0) 0x7fbaa00b4ef0 con 0x7fbaa01405c0 2023-06-23T18:45:40.767 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:40.767 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2419745169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2419745169},{"type":"v1","addr":"172.21.15.89:6835","nonce":2419745169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4846,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1941545390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1941545390},{"type":"v1","addr":"172.21.15.52:6834","nonce":1941545390}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T18:45:37.342046+0000","modified":"2023-06-23T18:45:40.353120+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4849},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4849":{"gid":4849,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6835/2041592035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":2041592035},{"type":"v1","addr":"172.21.15.52:6835","nonce":2041592035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-23T18:45:40.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.763+0000 7fbaa5e38700 1 -- 172.21.15.52:0/2902232174 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fba8c06ace0 msgr2=0x7fba8c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:40.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.763+0000 7fbaa5e38700 1 --2- 172.21.15.52:0/2902232174 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fba8c06ace0 0x7fba8c06d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fba900090b0 tx=0x7fba9001b000 comp rx=0 tx=0).stop 2023-06-23T18:45:40.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.763+0000 7fbaa5e38700 1 -- 172.21.15.52:0/2902232174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbaa01405c0 msgr2=0x7fbaa013e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:40.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.763+0000 7fbaa5e38700 1 --2- 172.21.15.52:0/2902232174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbaa01405c0 0x7fbaa013e4a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbaa014eb10 tx=0x7fba9800dea0 comp rx=0 tx=0).stop 2023-06-23T18:45:40.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.763+0000 7fbaa5e38700 1 -- 172.21.15.52:0/2902232174 shutdown_connections 2023-06-23T18:45:40.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.763+0000 7fbaa5e38700 1 --2- 172.21.15.52:0/2902232174 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fba8c06ace0 0x7fba8c06d190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:40.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.763+0000 7fbaa5e38700 1 --2- 172.21.15.52:0/2902232174 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbaa01405c0 0x7fbaa013e4a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:40.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.763+0000 7fbaa5e38700 1 --2- 172.21.15.52:0/2902232174 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba88003be0 0x7fbaa0149b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:40.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.763+0000 7fbaa5e38700 1 --2- 172.21.15.52:0/2902232174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbaa0147d40 0x7fbaa00b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:40.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.763+0000 7fbaa5e38700 1 -- 172.21.15.52:0/2902232174 >> 172.21.15.52:0/2902232174 conn(0x7fbaa00bdf30 msgr2=0x7fbaa014ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:40.772 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.763+0000 7fbaa5e38700 1 -- 172.21.15.52:0/2902232174 shutdown_connections 2023-06-23T18:45:40.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.763+0000 7fbaa5e38700 1 -- 172.21.15.52:0/2902232174 wait complete. 2023-06-23T18:45:40.773 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 16 2023-06-23T18:45:40.781 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T18:45:40.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.900+0000 7f485cc41700 1 Processor -- start 2023-06-23T18:45:40.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.900+0000 7f485cc41700 1 -- start start 2023-06-23T18:45:40.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.901+0000 7f485cc41700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f485806a0d0 0x7f48580bc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:40.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.901+0000 7f485cc41700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48581444a0 0x7f48580b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:40.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.901+0000 7f485cc41700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f48580b5a20 0x7f48580bb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:40.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.901+0000 7f485cc41700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48580b7aa0 con 0x7f48580b5a20 2023-06-23T18:45:40.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.901+0000 7f485cc41700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48580b5f30 con 0x7f485806a0d0 2023-06-23T18:45:40.909 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.901+0000 7f485cc41700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48580b6210 con 0x7f48581444a0 2023-06-23T18:45:40.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.901+0000 7f4856d9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f48580b5a20 0x7f48580bb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:40.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.902+0000 7f4856d9d700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f48580b5a20 0x7f48580bb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40240/0 (socket says 172.21.15.52:40240) 2023-06-23T18:45:40.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.902+0000 7f4856d9d700 1 -- 172.21.15.52:0/1090087723 learned_addr learned my addr 172.21.15.52:0/1090087723 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:40.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.902+0000 7f4855d9b700 1 --2- 172.21.15.52:0/1090087723 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48581444a0 0x7f48580b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:40.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.902+0000 7f485659c700 1 --2- 172.21.15.52:0/1090087723 >> v2:172.21.15.89:3300/0 conn(0x7f485806a0d0 0x7f48580bc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:40.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.902+0000 7f4856d9d700 1 -- 172.21.15.52:0/1090087723 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48581444a0 msgr2=0x7f48580b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:40.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.902+0000 7f4856d9d700 1 --2- 172.21.15.52:0/1090087723 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48581444a0 0x7f48580b54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:40.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.902+0000 7f4856d9d700 1 -- 172.21.15.52:0/1090087723 >> v2:172.21.15.89:3300/0 conn(0x7f485806a0d0 msgr2=0x7f48580bc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:40.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.902+0000 7f4856d9d700 1 --2- 172.21.15.52:0/1090087723 >> v2:172.21.15.89:3300/0 conn(0x7f485806a0d0 0x7f48580bc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:40.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.902+0000 7f4856d9d700 1 -- 172.21.15.52:0/1090087723 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48580b64f0 con 0x7f48580b5a20 2023-06-23T18:45:40.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.902+0000 7f4856d9d700 1 --2- 172.21.15.52:0/1090087723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48580b5a20 0x7f48580bb020 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f485808a170 tx=0x7f485000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60745168e749ace3 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:40.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.902+0000 7f485559a700 1 -- 172.21.15.52:0/1090087723 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485000e070 con 0x7f48580b5a20 2023-06-23T18:45:40.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.902+0000 7f485559a700 1 -- 172.21.15.52:0/1090087723 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485000b910 con 0x7f48580b5a20 2023-06-23T18:45:40.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.902+0000 7f485559a700 1 -- 172.21.15.52:0/1090087723 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485000bcc0 con 0x7f48580b5a20 2023-06-23T18:45:40.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.903+0000 7f485cc41700 1 -- 172.21.15.52:0/1090087723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48580b5a20 msgr2=0x7f48580bb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:40.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.903+0000 7f485cc41700 1 --2- 172.21.15.52:0/1090087723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48580b5a20 0x7f48580bb020 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f485808a170 tx=0x7f485000b330 comp rx=0 tx=0).stop 2023-06-23T18:45:40.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.903+0000 7f485cc41700 1 -- 172.21.15.52:0/1090087723 shutdown_connections 2023-06-23T18:45:40.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.903+0000 7f485cc41700 1 --2- 172.21.15.52:0/1090087723 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48580b5a20 0x7f48580bb020 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:40.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.903+0000 7f485cc41700 1 --2- 172.21.15.52:0/1090087723 >> v2:172.21.15.89:3300/0 conn(0x7f485806a0d0 0x7f48580bc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:40.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.903+0000 7f485cc41700 1 --2- 172.21.15.52:0/1090087723 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48581444a0 0x7f48580b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:40.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.903+0000 7f485cc41700 1 -- 172.21.15.52:0/1090087723 >> 172.21.15.52:0/1090087723 conn(0x7f485806bb90 msgr2=0x7f485806bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:40.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.903+0000 7f485cc41700 1 -- 172.21.15.52:0/1090087723 shutdown_connections 2023-06-23T18:45:40.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.903+0000 7f485cc41700 1 -- 172.21.15.52:0/1090087723 wait complete. 2023-06-23T18:45:40.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.904+0000 7f485cc41700 1 Processor -- start 2023-06-23T18:45:40.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.904+0000 7f485cc41700 1 -- start start 2023-06-23T18:45:40.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.905+0000 7f485cc41700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f485806a0d0 0x7f48581d5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:40.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.905+0000 7f485cc41700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48580b5a20 0x7f4858146b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:40.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.905+0000 7f485cc41700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48581444a0 0x7f48581e3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:40.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.905+0000 7f485cc41700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4858145800 con 0x7f48581444a0 2023-06-23T18:45:40.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.905+0000 7f485cc41700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4858146680 con 0x7f485806a0d0 2023-06-23T18:45:40.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.905+0000 7f485cc41700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4858145240 con 0x7f48580b5a20 2023-06-23T18:45:40.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.905+0000 7f4856d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48581444a0 0x7f48581e3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:40.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.905+0000 7f4856d9d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48581444a0 0x7f48581e3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40248/0 (socket says 172.21.15.52:40248) 2023-06-23T18:45:40.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.905+0000 7f4856d9d700 1 -- 172.21.15.52:0/3965557458 learned_addr learned my addr 172.21.15.52:0/3965557458 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:40.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.905+0000 7f485659c700 1 --2- 172.21.15.52:0/3965557458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f485806a0d0 0x7f48581d5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:40.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.905+0000 7f4855d9b700 1 --2- 172.21.15.52:0/3965557458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48580b5a20 0x7f4858146b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:40.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.905+0000 7f4856d9d700 1 -- 172.21.15.52:0/3965557458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48580b5a20 msgr2=0x7f4858146b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:40.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.905+0000 7f4856d9d700 1 --2- 172.21.15.52:0/3965557458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48580b5a20 0x7f4858146b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:40.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.905+0000 7f4856d9d700 1 -- 172.21.15.52:0/3965557458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f485806a0d0 msgr2=0x7f48581d5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:40.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.905+0000 7f4856d9d700 1 --2- 172.21.15.52:0/3965557458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f485806a0d0 0x7f48581d5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:40.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.905+0000 7f4856d9d700 1 -- 172.21.15.52:0/3965557458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4850009b30 con 0x7f48581444a0 2023-06-23T18:45:40.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.905+0000 7f4856d9d700 1 --2- 172.21.15.52:0/3965557458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48581444a0 0x7f48581e3550 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4850012000 tx=0x7f4850004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:40.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.905+0000 7f4846ffd700 1 -- 172.21.15.52:0/3965557458 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485000ce80 con 0x7f48581444a0 2023-06-23T18:45:40.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.906+0000 7f4846ffd700 1 -- 172.21.15.52:0/3965557458 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4850004250 con 0x7f48581444a0 2023-06-23T18:45:40.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.906+0000 7f485cc41700 1 -- 172.21.15.52:0/3965557458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4858145520 con 0x7f48581444a0 2023-06-23T18:45:40.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.906+0000 7f4846ffd700 1 -- 172.21.15.52:0/3965557458 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4850004600 con 0x7f48581444a0 2023-06-23T18:45:40.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.906+0000 7f485cc41700 1 -- 172.21.15.52:0/3965557458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4858147050 con 0x7f48581444a0 2023-06-23T18:45:40.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.907+0000 7f485cc41700 1 -- 172.21.15.52:0/3965557458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4858146450 con 0x7f48581444a0 2023-06-23T18:45:40.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.907+0000 7f4846ffd700 1 -- 172.21.15.52:0/3965557458 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4850004760 con 0x7f48581444a0 2023-06-23T18:45:40.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.908+0000 7f4846ffd700 1 --2- 172.21.15.52:0/3965557458 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f483806ad10 0x7f483806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:40.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.908+0000 7f4846ffd700 1 -- 172.21.15.52:0/3965557458 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f485008a890 con 0x7f48581444a0 2023-06-23T18:45:40.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.908+0000 7f485659c700 1 --2- 172.21.15.52:0/3965557458 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f483806ad10 0x7f483806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:40.919 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.908+0000 7f485659c700 1 --2- 172.21.15.52:0/3965557458 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f483806ad10 0x7f483806d1c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f484c009b70 tx=0x7f484c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:40.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:40.912+0000 7f4846ffd700 1 -- 172.21.15.52:0/3965557458 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4858146450 con 0x7f48581444a0 2023-06-23T18:45:41.115 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.109+0000 7f485cc41700 1 -- 172.21.15.52:0/3965557458 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4858146450 con 0x7f48581444a0 2023-06-23T18:45:41.116 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.111+0000 7f4846ffd700 1 -- 172.21.15.52:0/3965557458 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+18245 (secure 0 0 0) 0x7f4858146450 con 0x7f48581444a0 2023-06-23T18:45:41.117 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:41.117 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":32,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","created":"2023-06-23T18:44:31.918434+0000","modified":"2023-06-23T18:45:38.343737+0000","last_up_change":"2023-06-23T18:44:42.169624+0000","last_in_change":"2023-06-23T18:44:34.510501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-23T18:44:43.346578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-23T18:44:43.829719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:45:34.943560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-23T18:45:36.307208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c371fb28-1b15-4e43-8d5a-43e402920ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6812","nonce":1066999520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6815","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6818","nonce":1066999520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6829","nonce":1066999520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6823","nonce":1066999520}]},"public_addr":"172.21.15.52:6812/1066999520","cluster_addr":"172.21.15.52:6818/1066999520","heartbeat_back_addr":"172.21.15.52:6829/1066999520","heartbeat_front_addr":"172.21.15.52:6823/1066999520","state":["exists","up"]},{"osd":1,"uuid":"4a142f04-33eb-47ec-9cc5-b08b44d82658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6813","nonce":2360219751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6819","nonce":2360219751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6830","nonce":2360219751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6825","nonce":2360219751}]},"public_addr":"172.21.15.52:6813/2360219751","cluster_addr":"172.21.15.52:6819/2360219751","heartbeat_back_addr":"172.21.15.52:6830/2360219751","heartbeat_front_addr":"172.21.15.52:6825/2360219751","state":["exists","up"]},{"osd":2,"uuid":"d7bb089d-4c55-4370-ba59-7fe88c39512a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6801","nonce":835073005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6803","nonce":835073005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6807","nonce":835073005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6805","nonce":835073005}]},"public_addr":"172.21.15.52:6801/835073005","cluster_addr":"172.21.15.52:6803/835073005","heartbeat_back_addr":"172.21.15.52:6807/835073005","heartbeat_front_addr":"172.21.15.52:6805/835073005","state":["exists","up"]},{"osd":3,"uuid":"4bcdcdc3-6a8f-468e-877e-57f76079ac3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6811","nonce":2852700864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6817","nonce":2852700864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6831","nonce":2852700864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6824","nonce":2852700864}]},"public_addr":"172.21.15.52:6811/2852700864","cluster_addr":"172.21.15.52:6817/2852700864","heartbeat_back_addr":"172.21.15.52:6831/2852700864","heartbeat_front_addr":"172.21.15.52:6824/2852700864","state":["exists","up"]},{"osd":4,"uuid":"cac63000-ae94-4b08-93e6-a99119640b63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6809","nonce":2538664679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6811","nonce":2538664679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6815","nonce":2538664679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6813","nonce":2538664679}]},"public_addr":"172.21.15.89:6809/2538664679","cluster_addr":"172.21.15.89:6811/2538664679","heartbeat_back_addr":"172.21.15.89:6815/2538664679","heartbeat_front_addr":"172.21.15.89:6813/2538664679","state":["exists","up"]},{"osd":5,"uuid":"45c53102-18a6-4fd7-9c25-8ea5e1ef6851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6801","nonce":1683710352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6803","nonce":1683710352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6807","nonce":1683710352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6805","nonce":1683710352}]},"public_addr":"172.21.15.89:6801/1683710352","cluster_addr":"172.21.15.89:6803/1683710352","heartbeat_back_addr":"172.21.15.89:6807/1683710352","heartbeat_front_addr":"172.21.15.89:6805/1683710352","state":["exists","up"]},{"osd":6,"uuid":"abee09d1-8eba-484f-a25c-871c1fe2e843","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6817","nonce":3890899288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6819","nonce":3890899288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6823","nonce":3890899288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6821","nonce":3890899288}]},"public_addr":"172.21.15.89:6817/3890899288","cluster_addr":"172.21.15.89:6819/3890899288","heartbeat_back_addr":"172.21.15.89:6823/3890899288","heartbeat_front_addr":"172.21.15.89:6821/3890899288","state":["exists","up"]},{"osd":7,"uuid":"5acf9e2e-00dd-4f9b-a7d9-3d820f695de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6825","nonce":2989085420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6827","nonce":2989085420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6831","nonce":2989085420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6829","nonce":2989085420}]},"public_addr":"172.21.15.89:6825/2989085420","cluster_addr":"172.21.15.89:6827/2989085420","heartbeat_back_addr":"172.21.15.89:6831/2989085420","heartbeat_front_addr":"172.21.15.89:6829/2989085420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.663866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.710904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.619347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.660102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.686933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.724635+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.669111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.678740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T18:45:41.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.113+0000 7f485cc41700 1 -- 172.21.15.52:0/3965557458 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f483806ad10 msgr2=0x7f483806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:41.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.113+0000 7f485cc41700 1 --2- 172.21.15.52:0/3965557458 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f483806ad10 0x7f483806d1c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f484c009b70 tx=0x7f484c008040 comp rx=0 tx=0).stop 2023-06-23T18:45:41.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.113+0000 7f485cc41700 1 -- 172.21.15.52:0/3965557458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48581444a0 msgr2=0x7f48581e3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:41.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.113+0000 7f485cc41700 1 --2- 172.21.15.52:0/3965557458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48581444a0 0x7f48581e3550 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4850012000 tx=0x7f4850004ad0 comp rx=0 tx=0).stop 2023-06-23T18:45:41.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.113+0000 7f485cc41700 1 -- 172.21.15.52:0/3965557458 shutdown_connections 2023-06-23T18:45:41.119 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.113+0000 7f485cc41700 1 --2- 172.21.15.52:0/3965557458 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f483806ad10 0x7f483806d1c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:41.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.113+0000 7f485cc41700 1 --2- 172.21.15.52:0/3965557458 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48581444a0 0x7f48581e3550 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:41.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.113+0000 7f485cc41700 1 --2- 172.21.15.52:0/3965557458 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f485806a0d0 0x7f48581d5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:41.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.113+0000 7f485cc41700 1 --2- 172.21.15.52:0/3965557458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48580b5a20 0x7f4858146b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:41.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.113+0000 7f485cc41700 1 -- 172.21.15.52:0/3965557458 >> 172.21.15.52:0/3965557458 conn(0x7f485806bb90 msgr2=0x7f48580a5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:41.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.113+0000 7f485cc41700 1 -- 172.21.15.52:0/3965557458 shutdown_connections 2023-06-23T18:45:41.120 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.113+0000 7f485cc41700 1 -- 172.21.15.52:0/3965557458 wait complete. 2023-06-23T18:45:41.131 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-23T18:45:41.131 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T18:45:41.257 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.251+0000 7fef26f17700 1 Processor -- start 2023-06-23T18:45:41.258 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.252+0000 7fef26f17700 1 -- start start 2023-06-23T18:45:41.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.252+0000 7fef26f17700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fef200b6930 0x7fef200bc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:41.260 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.252+0000 7fef26f17700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef200b64a0 con 0x7fef200b7540 2023-06-23T18:45:41.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.252+0000 7fef26f17700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef200b7d90 con 0x7fef2006a0d0 2023-06-23T18:45:41.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.252+0000 7fef26f17700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef200b55a0 con 0x7fef200b6930 2023-06-23T18:45:41.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.252+0000 7fef1ffff700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fef200b7540 0x7fef20147b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51766/0 (socket says 172.21.15.52:51766) 2023-06-23T18:45:41.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.252+0000 7fef1ffff700 1 -- 172.21.15.52:0/3085619711 learned_addr learned my addr 172.21.15.52:0/3085619711 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:41.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.253+0000 7fef1f7fe700 1 -- 172.21.15.52:0/3085619711 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2255223031 0 0) 0x7fef200b64a0 con 0x7fef200b7540 2023-06-23T18:45:41.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.253+0000 7fef1f7fe700 1 -- 172.21.15.52:0/3085619711 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef100035b0 con 0x7fef200b7540 2023-06-23T18:45:41.261 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.253+0000 7fef254b4700 1 --2- 172.21.15.52:0/3085619711 >> v2:172.21.15.89:3300/0 conn(0x7fef200b6930 0x7fef200bc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:41.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.253+0000 7fef1f7fe700 1 -- 172.21.15.52:0/3085619711 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1076933252 0 0) 0x7fef100035b0 con 0x7fef200b7540 2023-06-23T18:45:41.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.253+0000 7fef1f7fe700 1 -- 172.21.15.52:0/3085619711 >> v2:172.21.15.89:3300/0 conn(0x7fef200b6930 msgr2=0x7fef200bc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:41.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.253+0000 7fef1f7fe700 1 --2- 172.21.15.52:0/3085619711 >> v2:172.21.15.89:3300/0 conn(0x7fef200b6930 0x7fef200bc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:41.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.253+0000 7fef1f7fe700 1 -- 172.21.15.52:0/3085619711 >> v1:172.21.15.89:6789/0 conn(0x7fef2006a0d0 legacy=0x7fef2014de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:41.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.253+0000 7fef1f7fe700 1 -- 172.21.15.52:0/3085619711 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef200b5880 con 0x7fef200b7540 2023-06-23T18:45:41.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.253+0000 7fef1f7fe700 1 -- 172.21.15.52:0/3085619711 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7fef0c001670 con 0x7fef200b7540 2023-06-23T18:45:41.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.253+0000 7fef1f7fe700 1 -- 172.21.15.52:0/3085619711 >> v1:172.21.15.52:6789/0 conn(0x7fef200b7540 legacy=0x7fef20147b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:41.262 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.253+0000 7fef1f7fe700 1 --2- 172.21.15.52:0/3085619711 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef10003a00 0x7fef10003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:41.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.253+0000 7fef1f7fe700 1 --2- 172.21.15.52:0/3085619711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef10004850 0x7fef10004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:41.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.253+0000 7fef1f7fe700 1 --2- 172.21.15.52:0/3085619711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef10005200 0x7fef1000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:41.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.253+0000 7fef1f7fe700 1 -- 172.21.15.52:0/3085619711 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef200b55a0 con 0x7fef10005200 2023-06-23T18:45:41.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.253+0000 7fef1f7fe700 1 -- 172.21.15.52:0/3085619711 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1000c080 con 0x7fef10004850 2023-06-23T18:45:41.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.253+0000 7fef1f7fe700 1 -- 172.21.15.52:0/3085619711 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1000c240 con 0x7fef10003a00 2023-06-23T18:45:41.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.253+0000 7fef254b4700 1 --2- 172.21.15.52:0/3085619711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef10005200 0x7fef1000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:41.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.253+0000 7fef24cb3700 1 --2- 172.21.15.52:0/3085619711 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef10003a00 0x7fef10003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:41.263 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.253+0000 7fef1ffff700 1 --2- 172.21.15.52:0/3085619711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef10004850 0x7fef10004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:41.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.253+0000 7fef254b4700 1 -- 172.21.15.52:0/3085619711 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef10003a00 msgr2=0x7fef10003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:41.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.253+0000 7fef254b4700 1 --2- 172.21.15.52:0/3085619711 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef10003a00 0x7fef10003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:41.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.253+0000 7fef254b4700 1 -- 172.21.15.52:0/3085619711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef10004850 msgr2=0x7fef10004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:41.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.253+0000 7fef254b4700 1 --2- 172.21.15.52:0/3085619711 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef10004850 0x7fef10004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:41.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.253+0000 7fef254b4700 1 -- 172.21.15.52:0/3085619711 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef100035b0 con 0x7fef10005200 2023-06-23T18:45:41.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.254+0000 7fef254b4700 1 -- 172.21.15.52:0/3085619711 reap_dead start 2023-06-23T18:45:41.264 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.254+0000 7fef254b4700 1 --2- 172.21.15.52:0/3085619711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef10005200 0x7fef1000ba10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fef18009fc0 tx=0x7fef10005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149ea00ea1c2067e server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:41.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.254+0000 7fef1f7fe700 1 -- 172.21.15.52:0/3085619711 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18003a20 con 0x7fef10005200 2023-06-23T18:45:41.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.254+0000 7fef1f7fe700 1 -- 172.21.15.52:0/3085619711 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1800f040 con 0x7fef10005200 2023-06-23T18:45:41.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.254+0000 7fef1f7fe700 1 -- 172.21.15.52:0/3085619711 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef18003de0 con 0x7fef10005200 2023-06-23T18:45:41.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.254+0000 7fef26f17700 1 -- 172.21.15.52:0/3085619711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef10005200 msgr2=0x7fef1000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:41.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.254+0000 7fef26f17700 1 --2- 172.21.15.52:0/3085619711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef10005200 0x7fef1000ba10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fef18009fc0 tx=0x7fef10005880 comp rx=0 tx=0).stop 2023-06-23T18:45:41.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.254+0000 7fef26f17700 1 -- 172.21.15.52:0/3085619711 shutdown_connections 2023-06-23T18:45:41.265 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.254+0000 7fef26f17700 1 --2- 172.21.15.52:0/3085619711 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef10005200 0x7fef1000ba10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:41.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.254+0000 7fef26f17700 1 -- 172.21.15.52:0/3085619711 >> 172.21.15.52:0/3085619711 conn(0x7fef2006bb20 msgr2=0x7fef2006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:41.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.254+0000 7fef26f17700 1 -- 172.21.15.52:0/3085619711 shutdown_connections 2023-06-23T18:45:41.266 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.254+0000 7fef26f17700 1 -- 172.21.15.52:0/3085619711 wait complete. 2023-06-23T18:45:41.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.255+0000 7fef26f17700 1 Processor -- start 2023-06-23T18:45:41.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.256+0000 7fef26f17700 1 -- start start 2023-06-23T18:45:41.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.256+0000 7fef26f17700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef10005200 0x7fef200b9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:41.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.256+0000 7fef26f17700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef201496a0 0x7fef20149b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:41.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.256+0000 7fef26f17700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef2013ff20 0x7fef20140390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:41.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.256+0000 7fef26f17700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef20149230 con 0x7fef10005200 2023-06-23T18:45:41.268 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.256+0000 7fef26f17700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2014a050 con 0x7fef2013ff20 2023-06-23T18:45:41.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.256+0000 7fef26f17700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2014eab0 con 0x7fef201496a0 2023-06-23T18:45:41.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.256+0000 7fef24cb3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef10005200 0x7fef200b9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:41.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.256+0000 7fef24cb3700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef10005200 0x7fef200b9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40280/0 (socket says 172.21.15.52:40280) 2023-06-23T18:45:41.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.256+0000 7fef24cb3700 1 -- 172.21.15.52:0/2453494524 learned_addr learned my addr 172.21.15.52:0/2453494524 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:41.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.257+0000 7fef24cb3700 1 -- 172.21.15.52:0/2453494524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef201496a0 msgr2=0x7fef20149b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:41.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.257+0000 7fef24cb3700 1 --2- 172.21.15.52:0/2453494524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef201496a0 0x7fef20149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:41.269 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.257+0000 7fef24cb3700 1 -- 172.21.15.52:0/2453494524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef2013ff20 msgr2=0x7fef20140390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:41.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.257+0000 7fef24cb3700 1 --2- 172.21.15.52:0/2453494524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef2013ff20 0x7fef20140390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:41.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.257+0000 7fef24cb3700 1 -- 172.21.15.52:0/2453494524 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef200b5ce0 con 0x7fef10005200 2023-06-23T18:45:41.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.257+0000 7fef24cb3700 1 --2- 172.21.15.52:0/2453494524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef10005200 0x7fef200b9ae0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fef1400f570 tx=0x7fef1400f930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:41.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.257+0000 7fef1d7fa700 1 -- 172.21.15.52:0/2453494524 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef14005320 con 0x7fef10005200 2023-06-23T18:45:41.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.257+0000 7fef1d7fa700 1 -- 172.21.15.52:0/2453494524 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef14005480 con 0x7fef10005200 2023-06-23T18:45:41.270 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.257+0000 7fef26f17700 1 -- 172.21.15.52:0/2453494524 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef20148be0 con 0x7fef10005200 2023-06-23T18:45:41.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.257+0000 7fef1d7fa700 1 -- 172.21.15.52:0/2453494524 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef14006aa0 con 0x7fef10005200 2023-06-23T18:45:41.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.257+0000 7fef26f17700 1 -- 172.21.15.52:0/2453494524 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef201408d0 con 0x7fef10005200 2023-06-23T18:45:41.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.258+0000 7fef26f17700 1 -- 172.21.15.52:0/2453494524 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef200a6800 con 0x7fef10005200 2023-06-23T18:45:41.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.259+0000 7fef1d7fa700 1 -- 172.21.15.52:0/2453494524 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fef14006c00 con 0x7fef10005200 2023-06-23T18:45:41.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.259+0000 7fef1d7fa700 1 --2- 172.21.15.52:0/2453494524 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fef0406ace0 0x7fef0406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:41.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.259+0000 7fef1d7fa700 1 -- 172.21.15.52:0/2453494524 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fef14088b90 con 0x7fef10005200 2023-06-23T18:45:41.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.259+0000 7fef1ffff700 1 --2- 172.21.15.52:0/2453494524 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fef0406ace0 0x7fef0406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:41.271 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.260+0000 7fef1ffff700 1 --2- 172.21.15.52:0/2453494524 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fef0406ace0 0x7fef0406d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fef0c001c80 tx=0x7fef0c001bd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:41.272 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.263+0000 7fef1d7fa700 1 -- 172.21.15.52:0/2453494524 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fef14053cd0 con 0x7fef10005200 2023-06-23T18:45:41.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.455+0000 7fef26f17700 1 -- 172.21.15.52:0/2453494524 --> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fef200b5b60 con 0x7fef0406ace0 2023-06-23T18:45:41.470 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.464+0000 7fef1d7fa700 1 -- 172.21.15.52:0/2453494524 <== mgr.4106 v2:172.21.15.89:6832/397406548 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286858 (secure 0 0 0) 0x7fef0c001610 con 0x7fef0406ace0 2023-06-23T18:45:41.473 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:41.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.467+0000 7fef26f17700 1 -- 172.21.15.52:0/2453494524 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fef0406ace0 msgr2=0x7fef0406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:41.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.467+0000 7fef26f17700 1 --2- 172.21.15.52:0/2453494524 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fef0406ace0 0x7fef0406d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fef0c001c80 tx=0x7fef0c001bd0 comp rx=0 tx=0).stop 2023-06-23T18:45:41.475 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.467+0000 7fef26f17700 1 -- 172.21.15.52:0/2453494524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef10005200 msgr2=0x7fef200b9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:41.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.467+0000 7fef26f17700 1 --2- 172.21.15.52:0/2453494524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef10005200 0x7fef200b9ae0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fef1400f570 tx=0x7fef1400f930 comp rx=0 tx=0).stop 2023-06-23T18:45:41.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.468+0000 7fef26f17700 1 -- 172.21.15.52:0/2453494524 shutdown_connections 2023-06-23T18:45:41.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.468+0000 7fef26f17700 1 --2- 172.21.15.52:0/2453494524 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fef0406ace0 0x7fef0406d190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:41.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.468+0000 7fef26f17700 1 --2- 172.21.15.52:0/2453494524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef2013ff20 0x7fef20140390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:41.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.468+0000 7fef26f17700 1 --2- 172.21.15.52:0/2453494524 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fef10005200 0x7fef200b9ae0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:41.476 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.468+0000 7fef26f17700 1 --2- 172.21.15.52:0/2453494524 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef201496a0 0x7fef20149b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:41.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.468+0000 7fef26f17700 1 -- 172.21.15.52:0/2453494524 >> 172.21.15.52:0/2453494524 conn(0x7fef2006bb20 msgr2=0x7fef201462a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:41.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.468+0000 7fef26f17700 1 -- 172.21.15.52:0/2453494524 shutdown_connections 2023-06-23T18:45:41.477 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.468+0000 7fef26f17700 1 -- 172.21.15.52:0/2453494524 wait complete. 2023-06-23T18:45:41.477 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-06-23T18:45:41.485 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-06-23T18:45:39.788161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":95,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219464,"kb_used_data":3848,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755256,"statfs":{"total":773094113280,"available":772869382144,"internally_reserved":0,"allocated":3940352,"data_stored":2264605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000769"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.373836+0000","last_change":"2023-06-23T18:45:37.372352+0000","last_active":"2023-06-23T18:45:37.373836+0000","last_peered":"2023-06-23T18:45:37.373836+0000","last_clean":"2023-06-23T18:45:37.373836+0000","last_became_active":"2023-06-23T18:45:37.372017+0000","last_became_peered":"2023-06-23T18:45:37.372017+0000","last_unstale":"2023-06-23T18:45:37.373836+0000","last_undegraded":"2023-06-23T18:45:37.373836+0000","last_fullsized":"2023-06-23T18:45:37.373836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:54:01.544372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.373798+0000","last_change":"2023-06-23T18:45:37.368374+0000","last_active":"2023-06-23T18:45:37.373798+0000","last_peered":"2023-06-23T18:45:37.373798+0000","last_clean":"2023-06-23T18:45:37.373798+0000","last_became_active":"2023-06-23T18:45:37.368094+0000","last_became_peered":"2023-06-23T18:45:37.368094+0000","last_unstale":"2023-06-23T18:45:37.373798+0000","last_undegraded":"2023-06-23T18:45:37.373798+0000","last_fullsized":"2023-06-23T18:45:37.373798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:06:07.216241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.366320+0000","last_change":"2023-06-23T18:45:37.359204+0000","last_active":"2023-06-23T18:45:37.366320+0000","last_peered":"2023-06-23T18:45:37.366320+0000","last_clean":"2023-06-23T18:45:37.366320+0000","last_became_active":"2023-06-23T18:45:37.358947+0000","last_became_peered":"2023-06-23T18:45:37.358947+0000","last_unstale":"2023-06-23T18:45:37.366320+0000","last_undegraded":"2023-06-23T18:45:37.366320+0000","last_fullsized":"2023-06-23T18:45:37.366320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:58:38.321849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.362770+0000","last_change":"2023-06-23T18:45:37.361899+0000","last_active":"2023-06-23T18:45:37.362770+0000","last_peered":"2023-06-23T18:45:37.362770+0000","last_clean":"2023-06-23T18:45:37.362770+0000","last_became_active":"2023-06-23T18:45:37.361647+0000","last_became_peered":"2023-06-23T18:45:37.361647+0000","last_unstale":"2023-06-23T18:45:37.362770+0000","last_undegraded":"2023-06-23T18:45:37.362770+0000","last_fullsized":"2023-06-23T18:45:37.362770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:22:07.840330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.359775+0000","last_change":"2023-06-23T18:45:37.357808+0000","last_active":"2023-06-23T18:45:37.359775+0000","last_peered":"2023-06-23T18:45:37.359775+0000","last_clean":"2023-06-23T18:45:37.359775+0000","last_became_active":"2023-06-23T18:45:37.357521+0000","last_became_peered":"2023-06-23T18:45:37.357521+0000","last_unstale":"2023-06-23T18:45:37.359775+0000","last_undegraded":"2023-06-23T18:45:37.359775+0000","last_fullsized":"2023-06-23T18:45:37.359775+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:02:31.427637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.362527+0000","last_change":"2023-06-23T18:45:37.358048+0000","last_active":"2023-06-23T18:45:37.362527+0000","last_peered":"2023-06-23T18:45:37.362527+0000","last_clean":"2023-06-23T18:45:37.362527+0000","last_became_active":"2023-06-23T18:45:37.357785+0000","last_became_peered":"2023-06-23T18:45:37.357785+0000","last_unstale":"2023-06-23T18:45:37.362527+0000","last_undegraded":"2023-06-23T18:45:37.362527+0000","last_fullsized":"2023-06-23T18:45:37.362527+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:13.700319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.374862+0000","last_change":"2023-06-23T18:45:37.372422+0000","last_active":"2023-06-23T18:45:37.374862+0000","last_peered":"2023-06-23T18:45:37.374862+0000","last_clean":"2023-06-23T18:45:37.374862+0000","last_became_active":"2023-06-23T18:45:37.372136+0000","last_became_peered":"2023-06-23T18:45:37.372136+0000","last_unstale":"2023-06-23T18:45:37.374862+0000","last_undegraded":"2023-06-23T18:45:37.374862+0000","last_fullsized":"2023-06-23T18:45:37.374862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:29:34.046509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.366474+0000","last_change":"2023-06-23T18:45:37.358083+0000","last_active":"2023-06-23T18:45:37.366474+0000","last_peered":"2023-06-23T18:45:37.366474+0000","last_clean":"2023-06-23T18:45:37.366474+0000","last_became_active":"2023-06-23T18:45:37.357802+0000","last_became_peered":"2023-06-23T18:45:37.357802+0000","last_unstale":"2023-06-23T18:45:37.366474+0000","last_undegraded":"2023-06-23T18:45:37.366474+0000","last_fullsized":"2023-06-23T18:45:37.366474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:02:39.896090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.367063+0000","last_change":"2023-06-23T18:45:37.357611+0000","last_active":"2023-06-23T18:45:37.367063+0000","last_peered":"2023-06-23T18:45:37.367063+0000","last_clean":"2023-06-23T18:45:37.367063+0000","last_became_active":"2023-06-23T18:45:37.357346+0000","last_became_peered":"2023-06-23T18:45:37.357346+0000","last_unstale":"2023-06-23T18:45:37.367063+0000","last_undegraded":"2023-06-23T18:45:37.367063+0000","last_fullsized":"2023-06-23T18:45:37.367063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:06:13.343933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.358185+0000","last_change":"2023-06-23T18:45:37.357169+0000","last_active":"2023-06-23T18:45:37.358185+0000","last_peered":"2023-06-23T18:45:37.358185+0000","last_clean":"2023-06-23T18:45:37.358185+0000","last_became_active":"2023-06-23T18:45:37.356237+0000","last_became_peered":"2023-06-23T18:45:37.356237+0000","last_unstale":"2023-06-23T18:45:37.358185+0000","last_undegraded":"2023-06-23T18:45:37.358185+0000","last_fullsized":"2023-06-23T18:45:37.358185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:59:23.743660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.356927+0000","last_change":"2023-06-23T18:45:37.354695+0000","last_active":"2023-06-23T18:45:37.356927+0000","last_peered":"2023-06-23T18:45:37.356927+0000","last_clean":"2023-06-23T18:45:37.356927+0000","last_became_active":"2023-06-23T18:45:37.354434+0000","last_became_peered":"2023-06-23T18:45:37.354434+0000","last_unstale":"2023-06-23T18:45:37.356927+0000","last_undegraded":"2023-06-23T18:45:37.356927+0000","last_fullsized":"2023-06-23T18:45:37.356927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:13:26.565977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.366322+0000","last_change":"2023-06-23T18:45:37.359516+0000","last_active":"2023-06-23T18:45:37.366322+0000","last_peered":"2023-06-23T18:45:37.366322+0000","last_clean":"2023-06-23T18:45:37.366322+0000","last_became_active":"2023-06-23T18:45:37.359239+0000","last_became_peered":"2023-06-23T18:45:37.359239+0000","last_unstale":"2023-06-23T18:45:37.366322+0000","last_undegraded":"2023-06-23T18:45:37.366322+0000","last_fullsized":"2023-06-23T18:45:37.366322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:44:37.509204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.357862+0000","last_change":"2023-06-23T18:45:37.355458+0000","last_active":"2023-06-23T18:45:37.357862+0000","last_peered":"2023-06-23T18:45:37.357862+0000","last_clean":"2023-06-23T18:45:37.357862+0000","last_became_active":"2023-06-23T18:45:37.355179+0000","last_became_peered":"2023-06-23T18:45:37.355179+0000","last_unstale":"2023-06-23T18:45:37.357862+0000","last_undegraded":"2023-06-23T18:45:37.357862+0000","last_fullsized":"2023-06-23T18:45:37.357862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:20:21.173101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.366347+0000","last_change":"2023-06-23T18:45:37.363389+0000","last_active":"2023-06-23T18:45:37.366347+0000","last_peered":"2023-06-23T18:45:37.366347+0000","last_clean":"2023-06-23T18:45:37.366347+0000","last_became_active":"2023-06-23T18:45:37.362806+0000","last_became_peered":"2023-06-23T18:45:37.362806+0000","last_unstale":"2023-06-23T18:45:37.366347+0000","last_undegraded":"2023-06-23T18:45:37.366347+0000","last_fullsized":"2023-06-23T18:45:37.366347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:57:32.624331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.370239+0000","last_change":"2023-06-23T18:45:37.368105+0000","last_active":"2023-06-23T18:45:37.370239+0000","last_peered":"2023-06-23T18:45:37.370239+0000","last_clean":"2023-06-23T18:45:37.370239+0000","last_became_active":"2023-06-23T18:45:37.367829+0000","last_became_peered":"2023-06-23T18:45:37.367829+0000","last_unstale":"2023-06-23T18:45:37.370239+0000","last_undegraded":"2023-06-23T18:45:37.370239+0000","last_fullsized":"2023-06-23T18:45:37.370239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:50:03.628231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.361215+0000","last_change":"2023-06-23T18:45:37.358866+0000","last_active":"2023-06-23T18:45:37.361215+0000","last_peered":"2023-06-23T18:45:37.361215+0000","last_clean":"2023-06-23T18:45:37.361215+0000","last_became_active":"2023-06-23T18:45:37.358571+0000","last_became_peered":"2023-06-23T18:45:37.358571+0000","last_unstale":"2023-06-23T18:45:37.361215+0000","last_undegraded":"2023-06-23T18:45:37.361215+0000","last_fullsized":"2023-06-23T18:45:37.361215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:02:06.197488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.361024+0000","last_change":"2023-06-23T18:45:37.358987+0000","last_active":"2023-06-23T18:45:37.361024+0000","last_peered":"2023-06-23T18:45:37.361024+0000","last_clean":"2023-06-23T18:45:37.361024+0000","last_became_active":"2023-06-23T18:45:37.358688+0000","last_became_peered":"2023-06-23T18:45:37.358688+0000","last_unstale":"2023-06-23T18:45:37.361024+0000","last_undegraded":"2023-06-23T18:45:37.361024+0000","last_fullsized":"2023-06-23T18:45:37.361024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:21:19.322277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.370277+0000","last_change":"2023-06-23T18:45:37.367997+0000","last_active":"2023-06-23T18:45:37.370277+0000","last_peered":"2023-06-23T18:45:37.370277+0000","last_clean":"2023-06-23T18:45:37.370277+0000","last_became_active":"2023-06-23T18:45:37.367716+0000","last_became_peered":"2023-06-23T18:45:37.367716+0000","last_unstale":"2023-06-23T18:45:37.370277+0000","last_undegraded":"2023-06-23T18:45:37.370277+0000","last_fullsized":"2023-06-23T18:45:37.370277+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:58:38.321849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.359748+0000","last_change":"2023-06-23T18:45:37.356302+0000","last_active":"2023-06-23T18:45:37.359748+0000","last_peered":"2023-06-23T18:45:37.359748+0000","last_clean":"2023-06-23T18:45:37.359748+0000","last_became_active":"2023-06-23T18:45:37.356047+0000","last_became_peered":"2023-06-23T18:45:37.356047+0000","last_unstale":"2023-06-23T18:45:37.359748+0000","last_undegraded":"2023-06-23T18:45:37.359748+0000","last_fullsized":"2023-06-23T18:45:37.359748+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:40:10.789625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.371194+0000","last_change":"2023-06-23T18:45:37.368599+0000","last_active":"2023-06-23T18:45:37.371194+0000","last_peered":"2023-06-23T18:45:37.371194+0000","last_clean":"2023-06-23T18:45:37.371194+0000","last_became_active":"2023-06-23T18:45:37.368310+0000","last_became_peered":"2023-06-23T18:45:37.368310+0000","last_unstale":"2023-06-23T18:45:37.371194+0000","last_undegraded":"2023-06-23T18:45:37.371194+0000","last_fullsized":"2023-06-23T18:45:37.371194+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:20:21.173101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.360837+0000","last_change":"2023-06-23T18:45:37.357763+0000","last_active":"2023-06-23T18:45:37.360837+0000","last_peered":"2023-06-23T18:45:37.360837+0000","last_clean":"2023-06-23T18:45:37.360837+0000","last_became_active":"2023-06-23T18:45:37.357411+0000","last_became_peered":"2023-06-23T18:45:37.357411+0000","last_unstale":"2023-06-23T18:45:37.360837+0000","last_undegraded":"2023-06-23T18:45:37.360837+0000","last_fullsized":"2023-06-23T18:45:37.360837+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:21:48.226385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.365711+0000","last_change":"2023-06-23T18:45:37.363051+0000","last_active":"2023-06-23T18:45:37.365711+0000","last_peered":"2023-06-23T18:45:37.365711+0000","last_clean":"2023-06-23T18:45:37.365711+0000","last_became_active":"2023-06-23T18:45:37.362035+0000","last_became_peered":"2023-06-23T18:45:37.362035+0000","last_unstale":"2023-06-23T18:45:37.365711+0000","last_undegraded":"2023-06-23T18:45:37.365711+0000","last_fullsized":"2023-06-23T18:45:37.365711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:26:11.887047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.370043+0000","last_change":"2023-06-23T18:45:37.368589+0000","last_active":"2023-06-23T18:45:37.370043+0000","last_peered":"2023-06-23T18:45:37.370043+0000","last_clean":"2023-06-23T18:45:37.370043+0000","last_became_active":"2023-06-23T18:45:37.368338+0000","last_became_peered":"2023-06-23T18:45:37.368338+0000","last_unstale":"2023-06-23T18:45:37.370043+0000","last_undegraded":"2023-06-23T18:45:37.370043+0000","last_fullsized":"2023-06-23T18:45:37.370043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:57:32.624331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.370889+0000","last_change":"2023-06-23T18:45:37.367504+0000","last_active":"2023-06-23T18:45:37.370889+0000","last_peered":"2023-06-23T18:45:37.370889+0000","last_clean":"2023-06-23T18:45:37.370889+0000","last_became_active":"2023-06-23T18:45:37.367258+0000","last_became_peered":"2023-06-23T18:45:37.367258+0000","last_unstale":"2023-06-23T18:45:37.370889+0000","last_undegraded":"2023-06-23T18:45:37.370889+0000","last_fullsized":"2023-06-23T18:45:37.370889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:59:01.005562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.364125+0000","last_change":"2023-06-23T18:45:37.360609+0000","last_active":"2023-06-23T18:45:37.364125+0000","last_peered":"2023-06-23T18:45:37.364125+0000","last_clean":"2023-06-23T18:45:37.364125+0000","last_became_active":"2023-06-23T18:45:37.360298+0000","last_became_peered":"2023-06-23T18:45:37.360298+0000","last_unstale":"2023-06-23T18:45:37.364125+0000","last_undegraded":"2023-06-23T18:45:37.364125+0000","last_fullsized":"2023-06-23T18:45:37.364125+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:44:37.509204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.362013+0000","last_change":"2023-06-23T18:45:37.360481+0000","last_active":"2023-06-23T18:45:37.362013+0000","last_peered":"2023-06-23T18:45:37.362013+0000","last_clean":"2023-06-23T18:45:37.362013+0000","last_became_active":"2023-06-23T18:45:37.360219+0000","last_became_peered":"2023-06-23T18:45:37.360219+0000","last_unstale":"2023-06-23T18:45:37.362013+0000","last_undegraded":"2023-06-23T18:45:37.362013+0000","last_fullsized":"2023-06-23T18:45:37.362013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:38:49.279079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.366133+0000","last_change":"2023-06-23T18:45:37.363594+0000","last_active":"2023-06-23T18:45:37.366133+0000","last_peered":"2023-06-23T18:45:37.366133+0000","last_clean":"2023-06-23T18:45:37.366133+0000","last_became_active":"2023-06-23T18:45:37.362677+0000","last_became_peered":"2023-06-23T18:45:37.362677+0000","last_unstale":"2023-06-23T18:45:37.366133+0000","last_undegraded":"2023-06-23T18:45:37.366133+0000","last_fullsized":"2023-06-23T18:45:37.366133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:33:52.674356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.374865+0000","last_change":"2023-06-23T18:45:37.372450+0000","last_active":"2023-06-23T18:45:37.374865+0000","last_peered":"2023-06-23T18:45:37.374865+0000","last_clean":"2023-06-23T18:45:37.374865+0000","last_became_active":"2023-06-23T18:45:37.372232+0000","last_became_peered":"2023-06-23T18:45:37.372232+0000","last_unstale":"2023-06-23T18:45:37.374865+0000","last_undegraded":"2023-06-23T18:45:37.374865+0000","last_fullsized":"2023-06-23T18:45:37.374865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:24:27.309798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.368496+0000","last_change":"2023-06-23T18:45:37.364560+0000","last_active":"2023-06-23T18:45:37.368496+0000","last_peered":"2023-06-23T18:45:37.368496+0000","last_clean":"2023-06-23T18:45:37.368496+0000","last_became_active":"2023-06-23T18:45:37.364209+0000","last_became_peered":"2023-06-23T18:45:37.364209+0000","last_unstale":"2023-06-23T18:45:37.368496+0000","last_undegraded":"2023-06-23T18:45:37.368496+0000","last_fullsized":"2023-06-23T18:45:37.368496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:24:27.309798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.368600+0000","last_change":"2023-06-23T18:45:37.367655+0000","last_active":"2023-06-23T18:45:37.368600+0000","last_peered":"2023-06-23T18:45:37.368600+0000","last_clean":"2023-06-23T18:45:37.368600+0000","last_became_active":"2023-06-23T18:45:37.367373+0000","last_became_peered":"2023-06-23T18:45:37.367373+0000","last_unstale":"2023-06-23T18:45:37.368600+0000","last_undegraded":"2023-06-23T18:45:37.368600+0000","last_fullsized":"2023-06-23T18:45:37.368600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:13:26.565977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.371840+0000","last_change":"2023-06-23T18:45:37.368718+0000","last_active":"2023-06-23T18:45:37.371840+0000","last_peered":"2023-06-23T18:45:37.371840+0000","last_clean":"2023-06-23T18:45:37.371840+0000","last_became_active":"2023-06-23T18:45:37.368426+0000","last_became_peered":"2023-06-23T18:45:37.368426+0000","last_unstale":"2023-06-23T18:45:37.371840+0000","last_undegraded":"2023-06-23T18:45:37.371840+0000","last_fullsized":"2023-06-23T18:45:37.371840+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:50:06.418172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.362726+0000","last_change":"2023-06-23T18:45:37.359942+0000","last_active":"2023-06-23T18:45:37.362726+0000","last_peered":"2023-06-23T18:45:37.362726+0000","last_clean":"2023-06-23T18:45:37.362726+0000","last_became_active":"2023-06-23T18:45:37.359415+0000","last_became_peered":"2023-06-23T18:45:37.359415+0000","last_unstale":"2023-06-23T18:45:37.362726+0000","last_undegraded":"2023-06-23T18:45:37.362726+0000","last_fullsized":"2023-06-23T18:45:37.362726+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:58:51.395271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.361509+0000","last_change":"2023-06-23T18:45:37.359478+0000","last_active":"2023-06-23T18:45:37.361509+0000","last_peered":"2023-06-23T18:45:37.361509+0000","last_clean":"2023-06-23T18:45:37.361509+0000","last_became_active":"2023-06-23T18:45:37.359097+0000","last_became_peered":"2023-06-23T18:45:37.359097+0000","last_unstale":"2023-06-23T18:45:37.361509+0000","last_undegraded":"2023-06-23T18:45:37.361509+0000","last_fullsized":"2023-06-23T18:45:37.361509+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:06:07.216241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"31'4","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.373841+0000","last_change":"2023-06-23T18:45:36.940233+0000","last_active":"2023-06-23T18:45:37.373841+0000","last_peered":"2023-06-23T18:45:37.373841+0000","last_clean":"2023-06-23T18:45:37.373841+0000","last_became_active":"2023-06-23T18:45:36.939965+0000","last_became_peered":"2023-06-23T18:45:36.939965+0000","last_unstale":"2023-06-23T18:45:37.373841+0000","last_undegraded":"2023-06-23T18:45:37.373841+0000","last_fullsized":"2023-06-23T18:45:37.373841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:06:12.336322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.362727+0000","last_change":"2023-06-23T18:45:37.359956+0000","last_active":"2023-06-23T18:45:37.362727+0000","last_peered":"2023-06-23T18:45:37.362727+0000","last_clean":"2023-06-23T18:45:37.362727+0000","last_became_active":"2023-06-23T18:45:37.359659+0000","last_became_peered":"2023-06-23T18:45:37.359659+0000","last_unstale":"2023-06-23T18:45:37.362727+0000","last_undegraded":"2023-06-23T18:45:37.362727+0000","last_fullsized":"2023-06-23T18:45:37.362727+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:33:52.674356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.370075+0000","last_change":"2023-06-23T18:45:36.938067+0000","last_active":"2023-06-23T18:45:37.370075+0000","last_peered":"2023-06-23T18:45:37.370075+0000","last_clean":"2023-06-23T18:45:37.370075+0000","last_became_active":"2023-06-23T18:45:36.937795+0000","last_became_peered":"2023-06-23T18:45:36.937795+0000","last_unstale":"2023-06-23T18:45:37.370075+0000","last_undegraded":"2023-06-23T18:45:37.370075+0000","last_fullsized":"2023-06-23T18:45:37.370075+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:58:50.387659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.365387+0000","last_change":"2023-06-23T18:45:37.362128+0000","last_active":"2023-06-23T18:45:37.365387+0000","last_peered":"2023-06-23T18:45:37.365387+0000","last_clean":"2023-06-23T18:45:37.365387+0000","last_became_active":"2023-06-23T18:45:37.361861+0000","last_became_peered":"2023-06-23T18:45:37.361861+0000","last_unstale":"2023-06-23T18:45:37.365387+0000","last_undegraded":"2023-06-23T18:45:37.365387+0000","last_fullsized":"2023-06-23T18:45:37.365387+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:29.762207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.368611+0000","last_change":"2023-06-23T18:45:36.939656+0000","last_active":"2023-06-23T18:45:37.368611+0000","last_peered":"2023-06-23T18:45:37.368611+0000","last_clean":"2023-06-23T18:45:37.368611+0000","last_became_active":"2023-06-23T18:45:36.938611+0000","last_became_peered":"2023-06-23T18:45:36.938611+0000","last_unstale":"2023-06-23T18:45:37.368611+0000","last_undegraded":"2023-06-23T18:45:37.368611+0000","last_fullsized":"2023-06-23T18:45:37.368611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:57:06.102657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.373866+0000","last_change":"2023-06-23T18:45:37.372904+0000","last_active":"2023-06-23T18:45:37.373866+0000","last_peered":"2023-06-23T18:45:37.373866+0000","last_clean":"2023-06-23T18:45:37.373866+0000","last_became_active":"2023-06-23T18:45:37.372578+0000","last_became_peered":"2023-06-23T18:45:37.372578+0000","last_unstale":"2023-06-23T18:45:37.373866+0000","last_undegraded":"2023-06-23T18:45:37.373866+0000","last_fullsized":"2023-06-23T18:45:37.373866+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:02:06.197488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.374659+0000","last_change":"2023-06-23T18:45:36.937939+0000","last_active":"2023-06-23T18:45:37.374659+0000","last_peered":"2023-06-23T18:45:37.374659+0000","last_clean":"2023-06-23T18:45:37.374659+0000","last_became_active":"2023-06-23T18:45:36.937674+0000","last_became_peered":"2023-06-23T18:45:36.937674+0000","last_unstale":"2023-06-23T18:45:37.374659+0000","last_undegraded":"2023-06-23T18:45:37.374659+0000","last_fullsized":"2023-06-23T18:45:37.374659+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:02:05.189877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.364046+0000","last_change":"2023-06-23T18:45:37.355219+0000","last_active":"2023-06-23T18:45:37.364046+0000","last_peered":"2023-06-23T18:45:37.364046+0000","last_clean":"2023-06-23T18:45:37.364046+0000","last_became_active":"2023-06-23T18:45:37.354946+0000","last_became_peered":"2023-06-23T18:45:37.354946+0000","last_unstale":"2023-06-23T18:45:37.364046+0000","last_undegraded":"2023-06-23T18:45:37.364046+0000","last_fullsized":"2023-06-23T18:45:37.364046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:59:23.743660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.369507+0000","last_change":"2023-06-23T18:45:36.936405+0000","last_active":"2023-06-23T18:45:37.369507+0000","last_peered":"2023-06-23T18:45:37.369507+0000","last_clean":"2023-06-23T18:45:37.369507+0000","last_became_active":"2023-06-23T18:45:36.936123+0000","last_became_peered":"2023-06-23T18:45:36.936123+0000","last_unstale":"2023-06-23T18:45:37.369507+0000","last_undegraded":"2023-06-23T18:45:37.369507+0000","last_fullsized":"2023-06-23T18:45:37.369507+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:57:06.102657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.357674+0000","last_change":"2023-06-23T18:45:37.356242+0000","last_active":"2023-06-23T18:45:37.357674+0000","last_peered":"2023-06-23T18:45:37.357674+0000","last_clean":"2023-06-23T18:45:37.357674+0000","last_became_active":"2023-06-23T18:45:37.355948+0000","last_became_peered":"2023-06-23T18:45:37.355948+0000","last_unstale":"2023-06-23T18:45:37.357674+0000","last_undegraded":"2023-06-23T18:45:37.357674+0000","last_fullsized":"2023-06-23T18:45:37.357674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:13.700319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.367833+0000","last_change":"2023-06-23T18:45:36.941050+0000","last_active":"2023-06-23T18:45:37.367833+0000","last_peered":"2023-06-23T18:45:37.367833+0000","last_clean":"2023-06-23T18:45:37.367833+0000","last_became_active":"2023-06-23T18:45:36.940786+0000","last_became_peered":"2023-06-23T18:45:36.940786+0000","last_unstale":"2023-06-23T18:45:37.367833+0000","last_undegraded":"2023-06-23T18:45:37.367833+0000","last_fullsized":"2023-06-23T18:45:37.367833+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:41:42.690395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.364393+0000","last_change":"2023-06-23T18:45:37.358326+0000","last_active":"2023-06-23T18:45:37.364393+0000","last_peered":"2023-06-23T18:45:37.364393+0000","last_clean":"2023-06-23T18:45:37.364393+0000","last_became_active":"2023-06-23T18:45:37.358044+0000","last_became_peered":"2023-06-23T18:45:37.358044+0000","last_unstale":"2023-06-23T18:45:37.364393+0000","last_undegraded":"2023-06-23T18:45:37.364393+0000","last_fullsized":"2023-06-23T18:45:37.364393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:55:30.533014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.349420+0000","last_change":"2023-06-23T18:45:36.941302+0000","last_active":"2023-06-23T18:45:37.349420+0000","last_peered":"2023-06-23T18:45:37.349420+0000","last_clean":"2023-06-23T18:45:37.349420+0000","last_became_active":"2023-06-23T18:45:36.941007+0000","last_became_peered":"2023-06-23T18:45:36.941007+0000","last_unstale":"2023-06-23T18:45:37.349420+0000","last_undegraded":"2023-06-23T18:45:37.349420+0000","last_fullsized":"2023-06-23T18:45:37.349420+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:51:01.418238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.366291+0000","last_change":"2023-06-23T18:45:37.358265+0000","last_active":"2023-06-23T18:45:37.366291+0000","last_peered":"2023-06-23T18:45:37.366291+0000","last_clean":"2023-06-23T18:45:37.366291+0000","last_became_active":"2023-06-23T18:45:37.357894+0000","last_became_peered":"2023-06-23T18:45:37.357894+0000","last_unstale":"2023-06-23T18:45:37.366291+0000","last_undegraded":"2023-06-23T18:45:37.366291+0000","last_fullsized":"2023-06-23T18:45:37.366291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:57:32.624331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.351121+0000","last_change":"2023-06-23T18:45:36.935540+0000","last_active":"2023-06-23T18:45:37.351121+0000","last_peered":"2023-06-23T18:45:37.351121+0000","last_clean":"2023-06-23T18:45:37.351121+0000","last_became_active":"2023-06-23T18:45:36.935238+0000","last_became_peered":"2023-06-23T18:45:36.935238+0000","last_unstale":"2023-06-23T18:45:37.351121+0000","last_undegraded":"2023-06-23T18:45:37.351121+0000","last_fullsized":"2023-06-23T18:45:37.351121+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:13:14.894464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.362788+0000","last_change":"2023-06-23T18:45:37.361997+0000","last_active":"2023-06-23T18:45:37.362788+0000","last_peered":"2023-06-23T18:45:37.362788+0000","last_clean":"2023-06-23T18:45:37.362788+0000","last_became_active":"2023-06-23T18:45:37.361738+0000","last_became_peered":"2023-06-23T18:45:37.361738+0000","last_unstale":"2023-06-23T18:45:37.362788+0000","last_undegraded":"2023-06-23T18:45:37.362788+0000","last_fullsized":"2023-06-23T18:45:37.362788+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:23:58.005226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.360670+0000","last_change":"2023-06-23T18:45:36.936924+0000","last_active":"2023-06-23T18:45:37.360670+0000","last_peered":"2023-06-23T18:45:37.360670+0000","last_clean":"2023-06-23T18:45:37.360670+0000","last_became_active":"2023-06-23T18:45:36.936617+0000","last_became_peered":"2023-06-23T18:45:36.936617+0000","last_unstale":"2023-06-23T18:45:37.360670+0000","last_undegraded":"2023-06-23T18:45:37.360670+0000","last_fullsized":"2023-06-23T18:45:37.360670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:42:16.302504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.369872+0000","last_change":"2023-06-23T18:45:37.364345+0000","last_active":"2023-06-23T18:45:37.369872+0000","last_peered":"2023-06-23T18:45:37.369872+0000","last_clean":"2023-06-23T18:45:37.369872+0000","last_became_active":"2023-06-23T18:45:37.364015+0000","last_became_peered":"2023-06-23T18:45:37.364015+0000","last_unstale":"2023-06-23T18:45:37.369872+0000","last_undegraded":"2023-06-23T18:45:37.369872+0000","last_fullsized":"2023-06-23T18:45:37.369872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:26:11.887047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.346622+0000","last_change":"2023-06-23T18:45:36.938364+0000","last_active":"2023-06-23T18:45:37.346622+0000","last_peered":"2023-06-23T18:45:37.346622+0000","last_clean":"2023-06-23T18:45:37.346622+0000","last_became_active":"2023-06-23T18:45:36.938034+0000","last_became_peered":"2023-06-23T18:45:36.938034+0000","last_unstale":"2023-06-23T18:45:37.346622+0000","last_undegraded":"2023-06-23T18:45:37.346622+0000","last_fullsized":"2023-06-23T18:45:37.346622+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:58:37.314237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.365470+0000","last_change":"2023-06-23T18:45:37.357056+0000","last_active":"2023-06-23T18:45:37.365470+0000","last_peered":"2023-06-23T18:45:37.365470+0000","last_clean":"2023-06-23T18:45:37.365470+0000","last_became_active":"2023-06-23T18:45:37.356757+0000","last_became_peered":"2023-06-23T18:45:37.356757+0000","last_unstale":"2023-06-23T18:45:37.365470+0000","last_undegraded":"2023-06-23T18:45:37.365470+0000","last_fullsized":"2023-06-23T18:45:37.365470+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:13:26.565977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"31'3","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.370690+0000","last_change":"2023-06-23T18:45:36.938710+0000","last_active":"2023-06-23T18:45:37.370690+0000","last_peered":"2023-06-23T18:45:37.370690+0000","last_clean":"2023-06-23T18:45:37.370690+0000","last_became_active":"2023-06-23T18:45:36.938430+0000","last_became_peered":"2023-06-23T18:45:36.938430+0000","last_unstale":"2023-06-23T18:45:37.370690+0000","last_undegraded":"2023-06-23T18:45:37.370690+0000","last_fullsized":"2023-06-23T18:45:37.370690+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:51:01.418238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.364019+0000","last_change":"2023-06-23T18:45:37.360317+0000","last_active":"2023-06-23T18:45:37.364019+0000","last_peered":"2023-06-23T18:45:37.364019+0000","last_clean":"2023-06-23T18:45:37.364019+0000","last_became_active":"2023-06-23T18:45:37.359955+0000","last_became_peered":"2023-06-23T18:45:37.359955+0000","last_unstale":"2023-06-23T18:45:37.364019+0000","last_undegraded":"2023-06-23T18:45:37.364019+0000","last_fullsized":"2023-06-23T18:45:37.364019+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:50:06.418172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"31'6","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.375608+0000","last_change":"2023-06-23T18:45:36.938468+0000","last_active":"2023-06-23T18:45:37.375608+0000","last_peered":"2023-06-23T18:45:37.375608+0000","last_clean":"2023-06-23T18:45:37.375608+0000","last_became_active":"2023-06-23T18:45:36.938187+0000","last_became_peered":"2023-06-23T18:45:36.938187+0000","last_unstale":"2023-06-23T18:45:37.375608+0000","last_undegraded":"2023-06-23T18:45:37.375608+0000","last_fullsized":"2023-06-23T18:45:37.375608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:32:22.108504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.367217+0000","last_change":"2023-06-23T18:45:37.358481+0000","last_active":"2023-06-23T18:45:37.367217+0000","last_peered":"2023-06-23T18:45:37.367217+0000","last_clean":"2023-06-23T18:45:37.367217+0000","last_became_active":"2023-06-23T18:45:37.358233+0000","last_became_peered":"2023-06-23T18:45:37.358233+0000","last_unstale":"2023-06-23T18:45:37.367217+0000","last_undegraded":"2023-06-23T18:45:37.367217+0000","last_fullsized":"2023-06-23T18:45:37.367217+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:14:04.704583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.373857+0000","last_change":"2023-06-23T18:45:36.940555+0000","last_active":"2023-06-23T18:45:37.373857+0000","last_peered":"2023-06-23T18:45:37.373857+0000","last_clean":"2023-06-23T18:45:37.373857+0000","last_became_active":"2023-06-23T18:45:36.940278+0000","last_became_peered":"2023-06-23T18:45:36.940278+0000","last_unstale":"2023-06-23T18:45:37.373857+0000","last_undegraded":"2023-06-23T18:45:37.373857+0000","last_fullsized":"2023-06-23T18:45:37.373857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:19:07.621866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.372472+0000","last_change":"2023-06-23T18:45:37.359121+0000","last_active":"2023-06-23T18:45:37.372472+0000","last_peered":"2023-06-23T18:45:37.372472+0000","last_clean":"2023-06-23T18:45:37.372472+0000","last_became_active":"2023-06-23T18:45:37.358869+0000","last_became_peered":"2023-06-23T18:45:37.358869+0000","last_unstale":"2023-06-23T18:45:37.372472+0000","last_undegraded":"2023-06-23T18:45:37.372472+0000","last_fullsized":"2023-06-23T18:45:37.372472+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:55:30.533014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.350819+0000","last_change":"2023-06-23T18:45:36.943037+0000","last_active":"2023-06-23T18:45:37.350819+0000","last_peered":"2023-06-23T18:45:37.350819+0000","last_clean":"2023-06-23T18:45:37.350819+0000","last_became_active":"2023-06-23T18:45:36.942727+0000","last_became_peered":"2023-06-23T18:45:36.942727+0000","last_unstale":"2023-06-23T18:45:37.350819+0000","last_undegraded":"2023-06-23T18:45:37.350819+0000","last_fullsized":"2023-06-23T18:45:37.350819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:21:47.218774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.370059+0000","last_change":"2023-06-23T18:45:37.367920+0000","last_active":"2023-06-23T18:45:37.370059+0000","last_peered":"2023-06-23T18:45:37.370059+0000","last_clean":"2023-06-23T18:45:37.370059+0000","last_became_active":"2023-06-23T18:45:37.367649+0000","last_became_peered":"2023-06-23T18:45:37.367649+0000","last_unstale":"2023-06-23T18:45:37.370059+0000","last_undegraded":"2023-06-23T18:45:37.370059+0000","last_fullsized":"2023-06-23T18:45:37.370059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:13:15.902075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.359404+0000","last_change":"2023-06-23T18:45:36.937410+0000","last_active":"2023-06-23T18:45:37.359404+0000","last_peered":"2023-06-23T18:45:37.359404+0000","last_clean":"2023-06-23T18:45:37.359404+0000","last_became_active":"2023-06-23T18:45:36.937165+0000","last_became_peered":"2023-06-23T18:45:36.937165+0000","last_unstale":"2023-06-23T18:45:37.359404+0000","last_undegraded":"2023-06-23T18:45:37.359404+0000","last_fullsized":"2023-06-23T18:45:37.359404+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:51:01.418238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.373157+0000","last_change":"2023-06-23T18:45:37.359478+0000","last_active":"2023-06-23T18:45:37.373157+0000","last_peered":"2023-06-23T18:45:37.373157+0000","last_clean":"2023-06-23T18:45:37.373157+0000","last_became_active":"2023-06-23T18:45:37.359292+0000","last_became_peered":"2023-06-23T18:45:37.359292+0000","last_unstale":"2023-06-23T18:45:37.373157+0000","last_undegraded":"2023-06-23T18:45:37.373157+0000","last_fullsized":"2023-06-23T18:45:37.373157+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:07:06.615669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"31'8","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.374056+0000","last_change":"2023-06-23T18:45:36.940114+0000","last_active":"2023-06-23T18:45:37.374056+0000","last_peered":"2023-06-23T18:45:37.374056+0000","last_clean":"2023-06-23T18:45:37.374056+0000","last_became_active":"2023-06-23T18:45:36.939842+0000","last_became_peered":"2023-06-23T18:45:36.939842+0000","last_unstale":"2023-06-23T18:45:37.374056+0000","last_undegraded":"2023-06-23T18:45:37.374056+0000","last_fullsized":"2023-06-23T18:45:37.374056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:32:22.108504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.373737+0000","last_change":"2023-06-23T18:45:37.361543+0000","last_active":"2023-06-23T18:45:37.373737+0000","last_peered":"2023-06-23T18:45:37.373737+0000","last_clean":"2023-06-23T18:45:37.373737+0000","last_became_active":"2023-06-23T18:45:37.361319+0000","last_became_peered":"2023-06-23T18:45:37.361319+0000","last_unstale":"2023-06-23T18:45:37.373737+0000","last_undegraded":"2023-06-23T18:45:37.373737+0000","last_fullsized":"2023-06-23T18:45:37.373737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:29.762207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.370504+0000","last_change":"2023-06-23T18:45:36.939177+0000","last_active":"2023-06-23T18:45:37.370504+0000","last_peered":"2023-06-23T18:45:37.370504+0000","last_clean":"2023-06-23T18:45:37.370504+0000","last_became_active":"2023-06-23T18:45:36.938755+0000","last_became_peered":"2023-06-23T18:45:36.938755+0000","last_unstale":"2023-06-23T18:45:37.370504+0000","last_undegraded":"2023-06-23T18:45:37.370504+0000","last_fullsized":"2023-06-23T18:45:37.370504+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:04:49.025830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.358903+0000","last_change":"2023-06-23T18:45:37.356600+0000","last_active":"2023-06-23T18:45:37.358903+0000","last_peered":"2023-06-23T18:45:37.358903+0000","last_clean":"2023-06-23T18:45:37.358903+0000","last_became_active":"2023-06-23T18:45:37.355986+0000","last_became_peered":"2023-06-23T18:45:37.355986+0000","last_unstale":"2023-06-23T18:45:37.358903+0000","last_undegraded":"2023-06-23T18:45:37.358903+0000","last_fullsized":"2023-06-23T18:45:37.358903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:16:18.262645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.374128+0000","last_change":"2023-06-23T18:45:36.940645+0000","last_active":"2023-06-23T18:45:37.374128+0000","last_peered":"2023-06-23T18:45:37.374128+0000","last_clean":"2023-06-23T18:45:37.374128+0000","last_became_active":"2023-06-23T18:45:36.940267+0000","last_became_peered":"2023-06-23T18:45:36.940267+0000","last_unstale":"2023-06-23T18:45:37.374128+0000","last_undegraded":"2023-06-23T18:45:37.374128+0000","last_fullsized":"2023-06-23T18:45:37.374128+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:19:07.621866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.358277+0000","last_change":"2023-06-23T18:45:37.357267+0000","last_active":"2023-06-23T18:45:37.358277+0000","last_peered":"2023-06-23T18:45:37.358277+0000","last_clean":"2023-06-23T18:45:37.358277+0000","last_became_active":"2023-06-23T18:45:37.356959+0000","last_became_peered":"2023-06-23T18:45:37.356959+0000","last_unstale":"2023-06-23T18:45:37.358277+0000","last_undegraded":"2023-06-23T18:45:37.358277+0000","last_fullsized":"2023-06-23T18:45:37.358277+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:41:43.698006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.372960+0000","last_change":"2023-06-23T18:45:36.941559+0000","last_active":"2023-06-23T18:45:37.372960+0000","last_peered":"2023-06-23T18:45:37.372960+0000","last_clean":"2023-06-23T18:45:37.372960+0000","last_became_active":"2023-06-23T18:45:36.940649+0000","last_became_peered":"2023-06-23T18:45:36.940649+0000","last_unstale":"2023-06-23T18:45:37.372960+0000","last_undegraded":"2023-06-23T18:45:37.372960+0000","last_fullsized":"2023-06-23T18:45:37.372960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:22:15.198445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.374783+0000","last_change":"2023-06-23T18:45:37.373115+0000","last_active":"2023-06-23T18:45:37.374783+0000","last_peered":"2023-06-23T18:45:37.374783+0000","last_clean":"2023-06-23T18:45:37.374783+0000","last_became_active":"2023-06-23T18:45:37.372850+0000","last_became_peered":"2023-06-23T18:45:37.372850+0000","last_unstale":"2023-06-23T18:45:37.374783+0000","last_undegraded":"2023-06-23T18:45:37.374783+0000","last_fullsized":"2023-06-23T18:45:37.374783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:59:37.721277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.351575+0000","last_change":"2023-06-23T18:45:36.938063+0000","last_active":"2023-06-23T18:45:37.351575+0000","last_peered":"2023-06-23T18:45:37.351575+0000","last_clean":"2023-06-23T18:45:37.351575+0000","last_became_active":"2023-06-23T18:45:36.937758+0000","last_became_peered":"2023-06-23T18:45:36.937758+0000","last_unstale":"2023-06-23T18:45:37.351575+0000","last_undegraded":"2023-06-23T18:45:37.351575+0000","last_fullsized":"2023-06-23T18:45:37.351575+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:56:13.993890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.372626+0000","last_change":"2023-06-23T18:45:37.370689+0000","last_active":"2023-06-23T18:45:37.372626+0000","last_peered":"2023-06-23T18:45:37.372626+0000","last_clean":"2023-06-23T18:45:37.372626+0000","last_became_active":"2023-06-23T18:45:37.367676+0000","last_became_peered":"2023-06-23T18:45:37.367676+0000","last_unstale":"2023-06-23T18:45:37.372626+0000","last_undegraded":"2023-06-23T18:45:37.372626+0000","last_fullsized":"2023-06-23T18:45:37.372626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:54:01.544372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.371002+0000","last_change":"2023-06-23T18:45:36.938744+0000","last_active":"2023-06-23T18:45:37.371002+0000","last_peered":"2023-06-23T18:45:37.371002+0000","last_clean":"2023-06-23T18:45:37.371002+0000","last_became_active":"2023-06-23T18:45:36.938445+0000","last_became_peered":"2023-06-23T18:45:36.938445+0000","last_unstale":"2023-06-23T18:45:37.371002+0000","last_undegraded":"2023-06-23T18:45:37.371002+0000","last_fullsized":"2023-06-23T18:45:37.371002+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:44:12.590549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.365285+0000","last_change":"2023-06-23T18:45:37.357023+0000","last_active":"2023-06-23T18:45:37.365285+0000","last_peered":"2023-06-23T18:45:37.365285+0000","last_clean":"2023-06-23T18:45:37.365285+0000","last_became_active":"2023-06-23T18:45:37.356731+0000","last_became_peered":"2023-06-23T18:45:37.356731+0000","last_unstale":"2023-06-23T18:45:37.365285+0000","last_undegraded":"2023-06-23T18:45:37.365285+0000","last_fullsized":"2023-06-23T18:45:37.365285+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:16:18.262645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.346327+0000","last_change":"2023-06-23T18:45:36.940121+0000","last_active":"2023-06-23T18:45:37.346327+0000","last_peered":"2023-06-23T18:45:37.346327+0000","last_clean":"2023-06-23T18:45:37.346327+0000","last_became_active":"2023-06-23T18:45:36.939813+0000","last_became_peered":"2023-06-23T18:45:36.939813+0000","last_unstale":"2023-06-23T18:45:37.346327+0000","last_undegraded":"2023-06-23T18:45:37.346327+0000","last_fullsized":"2023-06-23T18:45:37.346327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:06:32.905760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.364191+0000","last_change":"2023-06-23T18:45:37.361318+0000","last_active":"2023-06-23T18:45:37.364191+0000","last_peered":"2023-06-23T18:45:37.364191+0000","last_clean":"2023-06-23T18:45:37.364191+0000","last_became_active":"2023-06-23T18:45:37.361032+0000","last_became_peered":"2023-06-23T18:45:37.361032+0000","last_unstale":"2023-06-23T18:45:37.364191+0000","last_undegraded":"2023-06-23T18:45:37.364191+0000","last_fullsized":"2023-06-23T18:45:37.364191+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:06:13.343933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.350782+0000","last_change":"2023-06-23T18:45:36.939541+0000","last_active":"2023-06-23T18:45:37.350782+0000","last_peered":"2023-06-23T18:45:37.350782+0000","last_clean":"2023-06-23T18:45:37.350782+0000","last_became_active":"2023-06-23T18:45:36.939260+0000","last_became_peered":"2023-06-23T18:45:36.939260+0000","last_unstale":"2023-06-23T18:45:37.350782+0000","last_undegraded":"2023-06-23T18:45:37.350782+0000","last_fullsized":"2023-06-23T18:45:37.350782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:07:05.608057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.373682+0000","last_change":"2023-06-23T18:45:37.358586+0000","last_active":"2023-06-23T18:45:37.373682+0000","last_peered":"2023-06-23T18:45:37.373682+0000","last_clean":"2023-06-23T18:45:37.373682+0000","last_became_active":"2023-06-23T18:45:37.358305+0000","last_became_peered":"2023-06-23T18:45:37.358305+0000","last_unstale":"2023-06-23T18:45:37.373682+0000","last_undegraded":"2023-06-23T18:45:37.373682+0000","last_fullsized":"2023-06-23T18:45:37.373682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:41:43.698006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.346887+0000","last_change":"2023-06-23T18:45:36.938133+0000","last_active":"2023-06-23T18:45:37.346887+0000","last_peered":"2023-06-23T18:45:37.346887+0000","last_clean":"2023-06-23T18:45:37.346887+0000","last_became_active":"2023-06-23T18:45:36.937814+0000","last_became_peered":"2023-06-23T18:45:36.937814+0000","last_unstale":"2023-06-23T18:45:37.346887+0000","last_undegraded":"2023-06-23T18:45:37.346887+0000","last_fullsized":"2023-06-23T18:45:37.346887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:30:54.940118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.365730+0000","last_change":"2023-06-23T18:45:37.363222+0000","last_active":"2023-06-23T18:45:37.365730+0000","last_peered":"2023-06-23T18:45:37.365730+0000","last_clean":"2023-06-23T18:45:37.365730+0000","last_became_active":"2023-06-23T18:45:37.362449+0000","last_became_peered":"2023-06-23T18:45:37.362449+0000","last_unstale":"2023-06-23T18:45:37.365730+0000","last_undegraded":"2023-06-23T18:45:37.365730+0000","last_fullsized":"2023-06-23T18:45:37.365730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:07:06.615669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.351131+0000","last_change":"2023-06-23T18:45:36.936215+0000","last_active":"2023-06-23T18:45:37.351131+0000","last_peered":"2023-06-23T18:45:37.351131+0000","last_clean":"2023-06-23T18:45:37.351131+0000","last_became_active":"2023-06-23T18:45:36.935882+0000","last_became_peered":"2023-06-23T18:45:36.935882+0000","last_unstale":"2023-06-23T18:45:37.351131+0000","last_undegraded":"2023-06-23T18:45:37.351131+0000","last_fullsized":"2023-06-23T18:45:37.351131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:02:38.888478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.352196+0000","last_change":"2023-06-23T18:44:45.192683+0000","last_active":"2023-06-23T18:45:37.352196+0000","last_peered":"2023-06-23T18:45:37.352196+0000","last_clean":"2023-06-23T18:45:37.352196+0000","last_became_active":"2023-06-23T18:44:45.192364+0000","last_became_peered":"2023-06-23T18:44:45.192364+0000","last_unstale":"2023-06-23T18:45:37.352196+0000","last_undegraded":"2023-06-23T18:45:37.352196+0000","last_fullsized":"2023-06-23T18:45:37.352196+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:05:14.480613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.370054+0000","last_change":"2023-06-23T18:45:37.365439+0000","last_active":"2023-06-23T18:45:37.370054+0000","last_peered":"2023-06-23T18:45:37.370054+0000","last_clean":"2023-06-23T18:45:37.370054+0000","last_became_active":"2023-06-23T18:45:37.365174+0000","last_became_peered":"2023-06-23T18:45:37.365174+0000","last_unstale":"2023-06-23T18:45:37.370054+0000","last_undegraded":"2023-06-23T18:45:37.370054+0000","last_fullsized":"2023-06-23T18:45:37.370054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:29.762207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.353524+0000","last_change":"2023-06-23T18:45:36.935157+0000","last_active":"2023-06-23T18:45:37.353524+0000","last_peered":"2023-06-23T18:45:37.353524+0000","last_clean":"2023-06-23T18:45:37.353524+0000","last_became_active":"2023-06-23T18:45:36.934859+0000","last_became_peered":"2023-06-23T18:45:36.934859+0000","last_unstale":"2023-06-23T18:45:37.353524+0000","last_undegraded":"2023-06-23T18:45:37.353524+0000","last_fullsized":"2023-06-23T18:45:37.353524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:26:10.879436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.357282+0000","last_change":"2023-06-23T18:44:45.194010+0000","last_active":"2023-06-23T18:45:37.357282+0000","last_peered":"2023-06-23T18:45:37.357282+0000","last_clean":"2023-06-23T18:45:37.357282+0000","last_became_active":"2023-06-23T18:44:45.193665+0000","last_became_peered":"2023-06-23T18:44:45.193665+0000","last_unstale":"2023-06-23T18:45:37.357282+0000","last_undegraded":"2023-06-23T18:45:37.357282+0000","last_fullsized":"2023-06-23T18:45:37.357282+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:55:10.851099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.362501+0000","last_change":"2023-06-23T18:45:37.358682+0000","last_active":"2023-06-23T18:45:37.362501+0000","last_peered":"2023-06-23T18:45:37.362501+0000","last_clean":"2023-06-23T18:45:37.362501+0000","last_became_active":"2023-06-23T18:45:37.358415+0000","last_became_peered":"2023-06-23T18:45:37.358415+0000","last_unstale":"2023-06-23T18:45:37.362501+0000","last_undegraded":"2023-06-23T18:45:37.362501+0000","last_fullsized":"2023-06-23T18:45:37.362501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:40:40.301810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.369632+0000","last_change":"2023-06-23T18:45:36.939026+0000","last_active":"2023-06-23T18:45:37.369632+0000","last_peered":"2023-06-23T18:45:37.369632+0000","last_clean":"2023-06-23T18:45:37.369632+0000","last_became_active":"2023-06-23T18:45:36.938397+0000","last_became_peered":"2023-06-23T18:45:36.938397+0000","last_unstale":"2023-06-23T18:45:37.369632+0000","last_undegraded":"2023-06-23T18:45:37.369632+0000","last_fullsized":"2023-06-23T18:45:37.369632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:33:51.666744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.349072+0000","last_change":"2023-06-23T18:44:45.192024+0000","last_active":"2023-06-23T18:45:37.349072+0000","last_peered":"2023-06-23T18:45:37.349072+0000","last_clean":"2023-06-23T18:45:37.349072+0000","last_became_active":"2023-06-23T18:44:45.191752+0000","last_became_peered":"2023-06-23T18:44:45.191752+0000","last_unstale":"2023-06-23T18:45:37.349072+0000","last_undegraded":"2023-06-23T18:45:37.349072+0000","last_fullsized":"2023-06-23T18:45:37.349072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:23:34.574171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":185,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.353120+0000","last_change":"2023-06-23T18:44:45.193018+0000","last_active":"2023-06-23T18:45:37.353120+0000","last_peered":"2023-06-23T18:45:37.353120+0000","last_clean":"2023-06-23T18:45:37.353120+0000","last_became_active":"2023-06-23T18:44:45.192689+0000","last_became_peered":"2023-06-23T18:44:45.192689+0000","last_unstale":"2023-06-23T18:45:37.353120+0000","last_undegraded":"2023-06-23T18:45:37.353120+0000","last_fullsized":"2023-06-23T18:45:37.353120+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:41:24.574488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.370010+0000","last_change":"2023-06-23T18:45:37.363613+0000","last_active":"2023-06-23T18:45:37.370010+0000","last_peered":"2023-06-23T18:45:37.370010+0000","last_clean":"2023-06-23T18:45:37.370010+0000","last_became_active":"2023-06-23T18:45:37.363335+0000","last_became_peered":"2023-06-23T18:45:37.363335+0000","last_unstale":"2023-06-23T18:45:37.370010+0000","last_undegraded":"2023-06-23T18:45:37.370010+0000","last_fullsized":"2023-06-23T18:45:37.370010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:19:08.629477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.346339+0000","last_change":"2023-06-23T18:45:36.938324+0000","last_active":"2023-06-23T18:45:37.346339+0000","last_peered":"2023-06-23T18:45:37.346339+0000","last_clean":"2023-06-23T18:45:37.346339+0000","last_became_active":"2023-06-23T18:45:36.937493+0000","last_became_peered":"2023-06-23T18:45:36.937493+0000","last_unstale":"2023-06-23T18:45:37.346339+0000","last_undegraded":"2023-06-23T18:45:37.346339+0000","last_fullsized":"2023-06-23T18:45:37.346339+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:03:32.100910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.350049+0000","last_change":"2023-06-23T18:44:45.577146+0000","last_active":"2023-06-23T18:45:37.350049+0000","last_peered":"2023-06-23T18:45:37.350049+0000","last_clean":"2023-06-23T18:45:37.350049+0000","last_became_active":"2023-06-23T18:44:45.576835+0000","last_became_peered":"2023-06-23T18:44:45.576835+0000","last_unstale":"2023-06-23T18:45:37.350049+0000","last_undegraded":"2023-06-23T18:45:37.350049+0000","last_fullsized":"2023-06-23T18:45:37.350049+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:47.160463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.374878+0000","last_change":"2023-06-23T18:45:37.373472+0000","last_active":"2023-06-23T18:45:37.374878+0000","last_peered":"2023-06-23T18:45:37.374878+0000","last_clean":"2023-06-23T18:45:37.374878+0000","last_became_active":"2023-06-23T18:45:37.373204+0000","last_became_peered":"2023-06-23T18:45:37.373204+0000","last_unstale":"2023-06-23T18:45:37.374878+0000","last_undegraded":"2023-06-23T18:45:37.374878+0000","last_fullsized":"2023-06-23T18:45:37.374878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:44:37.509204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.351523+0000","last_change":"2023-06-23T18:45:36.941721+0000","last_active":"2023-06-23T18:45:37.351523+0000","last_peered":"2023-06-23T18:45:37.351523+0000","last_clean":"2023-06-23T18:45:37.351523+0000","last_became_active":"2023-06-23T18:45:36.941456+0000","last_became_peered":"2023-06-23T18:45:36.941456+0000","last_unstale":"2023-06-23T18:45:37.351523+0000","last_undegraded":"2023-06-23T18:45:37.351523+0000","last_fullsized":"2023-06-23T18:45:37.351523+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:55:29.525403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.353085+0000","last_change":"2023-06-23T18:44:45.577304+0000","last_active":"2023-06-23T18:45:37.353085+0000","last_peered":"2023-06-23T18:45:37.353085+0000","last_clean":"2023-06-23T18:45:37.353085+0000","last_became_active":"2023-06-23T18:44:45.576846+0000","last_became_peered":"2023-06-23T18:44:45.576846+0000","last_unstale":"2023-06-23T18:45:37.353085+0000","last_undegraded":"2023-06-23T18:45:37.353085+0000","last_fullsized":"2023-06-23T18:45:37.353085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:55:10.851099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.373775+0000","last_change":"2023-06-23T18:45:37.366056+0000","last_active":"2023-06-23T18:45:37.373775+0000","last_peered":"2023-06-23T18:45:37.373775+0000","last_clean":"2023-06-23T18:45:37.373775+0000","last_became_active":"2023-06-23T18:45:37.365792+0000","last_became_peered":"2023-06-23T18:45:37.365792+0000","last_unstale":"2023-06-23T18:45:37.373775+0000","last_undegraded":"2023-06-23T18:45:37.373775+0000","last_fullsized":"2023-06-23T18:45:37.373775+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:21:19.322277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.350634+0000","last_change":"2023-06-23T18:45:36.936240+0000","last_active":"2023-06-23T18:45:37.350634+0000","last_peered":"2023-06-23T18:45:37.350634+0000","last_clean":"2023-06-23T18:45:37.350634+0000","last_became_active":"2023-06-23T18:45:36.935859+0000","last_became_peered":"2023-06-23T18:45:36.935859+0000","last_unstale":"2023-06-23T18:45:37.350634+0000","last_undegraded":"2023-06-23T18:45:37.350634+0000","last_fullsized":"2023-06-23T18:45:37.350634+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:04:49.025830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.346686+0000","last_change":"2023-06-23T18:44:45.577154+0000","last_active":"2023-06-23T18:45:37.346686+0000","last_peered":"2023-06-23T18:45:37.346686+0000","last_clean":"2023-06-23T18:45:37.346686+0000","last_became_active":"2023-06-23T18:44:45.576819+0000","last_became_peered":"2023-06-23T18:44:45.576819+0000","last_unstale":"2023-06-23T18:45:37.346686+0000","last_undegraded":"2023-06-23T18:45:37.346686+0000","last_fullsized":"2023-06-23T18:45:37.346686+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:57:58.659643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.366362+0000","last_change":"2023-06-23T18:45:37.363735+0000","last_active":"2023-06-23T18:45:37.366362+0000","last_peered":"2023-06-23T18:45:37.366362+0000","last_clean":"2023-06-23T18:45:37.366362+0000","last_became_active":"2023-06-23T18:45:37.363470+0000","last_became_peered":"2023-06-23T18:45:37.363470+0000","last_unstale":"2023-06-23T18:45:37.366362+0000","last_undegraded":"2023-06-23T18:45:37.366362+0000","last_fullsized":"2023-06-23T18:45:37.366362+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:20:21.173101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.356873+0000","last_change":"2023-06-23T18:45:36.936887+0000","last_active":"2023-06-23T18:45:37.356873+0000","last_peered":"2023-06-23T18:45:37.356873+0000","last_clean":"2023-06-23T18:45:37.356873+0000","last_became_active":"2023-06-23T18:45:36.936594+0000","last_became_peered":"2023-06-23T18:45:36.936594+0000","last_unstale":"2023-06-23T18:45:37.356873+0000","last_undegraded":"2023-06-23T18:45:37.356873+0000","last_fullsized":"2023-06-23T18:45:37.356873+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:58:50.387659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.355157+0000","last_change":"2023-06-23T18:44:45.577135+0000","last_active":"2023-06-23T18:45:37.355157+0000","last_peered":"2023-06-23T18:45:37.355157+0000","last_clean":"2023-06-23T18:45:37.355157+0000","last_became_active":"2023-06-23T18:44:45.576834+0000","last_became_peered":"2023-06-23T18:44:45.576834+0000","last_unstale":"2023-06-23T18:45:37.355157+0000","last_undegraded":"2023-06-23T18:45:37.355157+0000","last_fullsized":"2023-06-23T18:45:37.355157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:03:57.297814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.369242+0000","last_change":"2023-06-23T18:45:37.367343+0000","last_active":"2023-06-23T18:45:37.369242+0000","last_peered":"2023-06-23T18:45:37.369242+0000","last_clean":"2023-06-23T18:45:37.369242+0000","last_became_active":"2023-06-23T18:45:37.367052+0000","last_became_peered":"2023-06-23T18:45:37.367052+0000","last_unstale":"2023-06-23T18:45:37.369242+0000","last_undegraded":"2023-06-23T18:45:37.369242+0000","last_fullsized":"2023-06-23T18:45:37.369242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:29:34.046509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.348015+0000","last_change":"2023-06-23T18:45:36.936276+0000","last_active":"2023-06-23T18:45:37.348015+0000","last_peered":"2023-06-23T18:45:37.348015+0000","last_clean":"2023-06-23T18:45:37.348015+0000","last_became_active":"2023-06-23T18:45:36.935834+0000","last_became_peered":"2023-06-23T18:45:36.935834+0000","last_unstale":"2023-06-23T18:45:37.348015+0000","last_undegraded":"2023-06-23T18:45:37.348015+0000","last_fullsized":"2023-06-23T18:45:37.348015+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:50:02.620619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.354307+0000","last_change":"2023-06-23T18:44:45.192545+0000","last_active":"2023-06-23T18:45:37.354307+0000","last_peered":"2023-06-23T18:45:37.354307+0000","last_clean":"2023-06-23T18:45:37.354307+0000","last_became_active":"2023-06-23T18:44:45.192124+0000","last_became_peered":"2023-06-23T18:44:45.192124+0000","last_unstale":"2023-06-23T18:45:37.354307+0000","last_undegraded":"2023-06-23T18:45:37.354307+0000","last_fullsized":"2023-06-23T18:45:37.354307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:15:25.527018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":958464,"data_stored":731703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":352256,"data_stored":140283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":929792,"data_stored":722941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":352256,"data_stored":139735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":331776,"data_stored":131612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":335872,"data_stored":132573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":323584,"data_stored":125945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":139813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T18:45:41.493 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-23T18:45:41.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.645+0000 7f48772c5700 1 Processor -- start 2023-06-23T18:45:41.651 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.645+0000 7f48772c5700 1 -- start start 2023-06-23T18:45:41.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.646+0000 7f48772c5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f48700b8c70 0x7f4870148480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:41.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.646+0000 7f48772c5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f48701489c0 0x7f4870152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:41.653 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.646+0000 7f48772c5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48700b53b0 con 0x7f48701426a0 2023-06-23T18:45:41.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.646+0000 7f48772c5700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48700b4750 con 0x7f48701489c0 2023-06-23T18:45:41.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.646+0000 7f48772c5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48700722f0 con 0x7f48700b8c70 2023-06-23T18:45:41.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.646+0000 7f4875862700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f48701489c0 0x7f4870152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:41.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.646+0000 7f4875862700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f48701489c0 0x7f4870152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40294/0 (socket says 172.21.15.52:40294) 2023-06-23T18:45:41.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.646+0000 7f4875862700 1 -- 172.21.15.52:0/1553638518 learned_addr learned my addr 172.21.15.52:0/1553638518 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:41.654 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.646+0000 7f4874860700 1 --2- 172.21.15.52:0/1553638518 >> v2:172.21.15.89:3300/0 conn(0x7f48700b8c70 0x7f4870148480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:41.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.646+0000 7f4875862700 1 -- 172.21.15.52:0/1553638518 >> v2:172.21.15.89:3300/0 conn(0x7f48700b8c70 msgr2=0x7f4870148480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:41.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.646+0000 7f4875862700 1 --2- 172.21.15.52:0/1553638518 >> v2:172.21.15.89:3300/0 conn(0x7f48700b8c70 0x7f4870148480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:41.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.646+0000 7f4875862700 1 -- 172.21.15.52:0/1553638518 >> v1:172.21.15.89:6789/0 conn(0x7f48701426a0 legacy=0x7f4870071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:41.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.646+0000 7f4875862700 1 -- 172.21.15.52:0/1553638518 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4870142a70 con 0x7f48701489c0 2023-06-23T18:45:41.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.647+0000 7f4875862700 1 --2- 172.21.15.52:0/1553638518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48701489c0 0x7f4870152bb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f487006ef40 tx=0x7f486800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0a155a2fd8de9e server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:41.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.647+0000 7f4867fff700 1 -- 172.21.15.52:0/1553638518 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486800e070 con 0x7f48701489c0 2023-06-23T18:45:41.655 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.647+0000 7f4867fff700 1 -- 172.21.15.52:0/1553638518 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486800b910 con 0x7f48701489c0 2023-06-23T18:45:41.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.647+0000 7f4867fff700 1 -- 172.21.15.52:0/1553638518 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486800bcc0 con 0x7f48701489c0 2023-06-23T18:45:41.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.647+0000 7f48772c5700 1 -- 172.21.15.52:0/1553638518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48701489c0 msgr2=0x7f4870152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:41.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.647+0000 7f48772c5700 1 --2- 172.21.15.52:0/1553638518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48701489c0 0x7f4870152bb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f487006ef40 tx=0x7f486800b330 comp rx=0 tx=0).stop 2023-06-23T18:45:41.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.647+0000 7f48772c5700 1 -- 172.21.15.52:0/1553638518 shutdown_connections 2023-06-23T18:45:41.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.647+0000 7f48772c5700 1 --2- 172.21.15.52:0/1553638518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48701489c0 0x7f4870152bb0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:41.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.647+0000 7f48772c5700 1 --2- 172.21.15.52:0/1553638518 >> v2:172.21.15.89:3300/0 conn(0x7f48700b8c70 0x7f4870148480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:41.656 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.647+0000 7f48772c5700 1 -- 172.21.15.52:0/1553638518 >> 172.21.15.52:0/1553638518 conn(0x7f48700bd690 msgr2=0x7f48700b9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:41.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.647+0000 7f48772c5700 1 -- 172.21.15.52:0/1553638518 shutdown_connections 2023-06-23T18:45:41.657 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.647+0000 7f48772c5700 1 -- 172.21.15.52:0/1553638518 wait complete. 2023-06-23T18:45:41.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.648+0000 7f48772c5700 1 Processor -- start 2023-06-23T18:45:41.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.648+0000 7f48772c5700 1 -- start start 2023-06-23T18:45:41.659 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.649+0000 7f48772c5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48700b8c70 0x7f4870144800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:41.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.649+0000 7f48772c5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48701426a0 0x7f4870145610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:41.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.649+0000 7f48772c5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48701489c0 0x7f487013a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:41.660 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.649+0000 7f48772c5700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487006fed0 con 0x7f48700b8c70 2023-06-23T18:45:41.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.649+0000 7f48772c5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4870143a80 con 0x7f48701426a0 2023-06-23T18:45:41.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.649+0000 7f48772c5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4870143430 con 0x7f48701489c0 2023-06-23T18:45:41.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.649+0000 7f4875061700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48700b8c70 0x7f4870144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:41.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.649+0000 7f4875061700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48700b8c70 0x7f4870144800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40302/0 (socket says 172.21.15.52:40302) 2023-06-23T18:45:41.661 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.649+0000 7f4875061700 1 -- 172.21.15.52:0/3032141067 learned_addr learned my addr 172.21.15.52:0/3032141067 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:41.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.649+0000 7f4874860700 1 --2- 172.21.15.52:0/3032141067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48701426a0 0x7f4870145610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:41.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.649+0000 7f4875862700 1 --2- 172.21.15.52:0/3032141067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48701489c0 0x7f487013a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:41.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.649+0000 7f4875061700 1 -- 172.21.15.52:0/3032141067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48701489c0 msgr2=0x7f487013a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:41.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.649+0000 7f4875061700 1 --2- 172.21.15.52:0/3032141067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48701489c0 0x7f487013a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:41.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.649+0000 7f4875061700 1 -- 172.21.15.52:0/3032141067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48701426a0 msgr2=0x7f4870145610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:41.662 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.649+0000 7f4875061700 1 --2- 172.21.15.52:0/3032141067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48701426a0 0x7f4870145610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:41.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.649+0000 7f4875061700 1 -- 172.21.15.52:0/3032141067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4868009b30 con 0x7f48700b8c70 2023-06-23T18:45:41.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.649+0000 7f4875862700 1 --2- 172.21.15.52:0/3032141067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48701489c0 0x7f487013a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:41.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.650+0000 7f4875061700 1 --2- 172.21.15.52:0/3032141067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48700b8c70 0x7f4870144800 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f486000c4e0 tx=0x7f486000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:41.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.650+0000 7f4865ffb700 1 -- 172.21.15.52:0/3032141067 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48600052d0 con 0x7f48700b8c70 2023-06-23T18:45:41.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.650+0000 7f4865ffb700 1 -- 172.21.15.52:0/3032141067 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4860005430 con 0x7f48700b8c70 2023-06-23T18:45:41.664 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.650+0000 7f4865ffb700 1 -- 172.21.15.52:0/3032141067 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48600038c0 con 0x7f48700b8c70 2023-06-23T18:45:41.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.650+0000 7f48772c5700 1 -- 172.21.15.52:0/3032141067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4870143710 con 0x7f48700b8c70 2023-06-23T18:45:41.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.650+0000 7f48772c5700 1 -- 172.21.15.52:0/3032141067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48700b61d0 con 0x7f48700b8c70 2023-06-23T18:45:41.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.651+0000 7f48772c5700 1 -- 172.21.15.52:0/3032141067 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487004e1d0 con 0x7f48700b8c70 2023-06-23T18:45:41.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.651+0000 7f4865ffb700 1 -- 172.21.15.52:0/3032141067 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4860003a20 con 0x7f48700b8c70 2023-06-23T18:45:41.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.652+0000 7f4865ffb700 1 --2- 172.21.15.52:0/3032141067 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f485406ace0 0x7f485406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:41.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.652+0000 7f4865ffb700 1 -- 172.21.15.52:0/3032141067 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f48600887d0 con 0x7f48700b8c70 2023-06-23T18:45:41.665 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.652+0000 7f4874860700 1 --2- 172.21.15.52:0/3032141067 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f485406ace0 0x7f485406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:41.666 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.652+0000 7f4874860700 1 --2- 172.21.15.52:0/3032141067 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f485406ace0 0x7f485406d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f48700bc100 tx=0x7f486c009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:41.667 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.656+0000 7f4865ffb700 1 -- 172.21.15.52:0/3032141067 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4860053910 con 0x7f48700b8c70 2023-06-23T18:45:41.853 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.847+0000 7f48772c5700 1 -- 172.21.15.52:0/3032141067 --> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f48700b9f10 con 0x7f485406ace0 2023-06-23T18:45:41.861 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.855+0000 7f4865ffb700 1 -- 172.21.15.52:0/3032141067 <== mgr.4106 v2:172.21.15.89:6832/397406548 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286858 (secure 0 0 0) 0x7f486c011830 con 0x7f485406ace0 2023-06-23T18:45:41.864 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:41.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.858+0000 7f48772c5700 1 -- 172.21.15.52:0/3032141067 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f485406ace0 msgr2=0x7f485406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:41.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.858+0000 7f48772c5700 1 --2- 172.21.15.52:0/3032141067 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f485406ace0 0x7f485406d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f48700bc100 tx=0x7f486c009210 comp rx=0 tx=0).stop 2023-06-23T18:45:41.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.858+0000 7f48772c5700 1 -- 172.21.15.52:0/3032141067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48700b8c70 msgr2=0x7f4870144800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:41.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.858+0000 7f48772c5700 1 --2- 172.21.15.52:0/3032141067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48700b8c70 0x7f4870144800 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f486000c4e0 tx=0x7f486000c7f0 comp rx=0 tx=0).stop 2023-06-23T18:45:41.866 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.859+0000 7f48772c5700 1 -- 172.21.15.52:0/3032141067 shutdown_connections 2023-06-23T18:45:41.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.859+0000 7f48772c5700 1 --2- 172.21.15.52:0/3032141067 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f485406ace0 0x7f485406d190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:41.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.859+0000 7f48772c5700 1 --2- 172.21.15.52:0/3032141067 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f48701489c0 0x7f487013a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:41.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.859+0000 7f48772c5700 1 --2- 172.21.15.52:0/3032141067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f48700b8c70 0x7f4870144800 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:41.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.859+0000 7f48772c5700 1 --2- 172.21.15.52:0/3032141067 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f48701426a0 0x7f4870145610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:41.867 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.859+0000 7f48772c5700 1 -- 172.21.15.52:0/3032141067 >> 172.21.15.52:0/3032141067 conn(0x7f48700bd690 msgr2=0x7f48700b7280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:41.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.859+0000 7f48772c5700 1 -- 172.21.15.52:0/3032141067 shutdown_connections 2023-06-23T18:45:41.868 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:41.859+0000 7f48772c5700 1 -- 172.21.15.52:0/3032141067 wait complete. 2023-06-23T18:45:41.868 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2023-06-23T18:45:41.876 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-06-23T18:45:41.788744+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":95,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219464,"kb_used_data":3848,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755256,"statfs":{"total":773094113280,"available":772869382144,"internally_reserved":0,"allocated":3940352,"data_stored":2264605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.874308"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.373836+0000","last_change":"2023-06-23T18:45:37.372352+0000","last_active":"2023-06-23T18:45:37.373836+0000","last_peered":"2023-06-23T18:45:37.373836+0000","last_clean":"2023-06-23T18:45:37.373836+0000","last_became_active":"2023-06-23T18:45:37.372017+0000","last_became_peered":"2023-06-23T18:45:37.372017+0000","last_unstale":"2023-06-23T18:45:37.373836+0000","last_undegraded":"2023-06-23T18:45:37.373836+0000","last_fullsized":"2023-06-23T18:45:37.373836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:54:01.544372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.373798+0000","last_change":"2023-06-23T18:45:37.368374+0000","last_active":"2023-06-23T18:45:37.373798+0000","last_peered":"2023-06-23T18:45:37.373798+0000","last_clean":"2023-06-23T18:45:37.373798+0000","last_became_active":"2023-06-23T18:45:37.368094+0000","last_became_peered":"2023-06-23T18:45:37.368094+0000","last_unstale":"2023-06-23T18:45:37.373798+0000","last_undegraded":"2023-06-23T18:45:37.373798+0000","last_fullsized":"2023-06-23T18:45:37.373798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:06:07.216241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.366320+0000","last_change":"2023-06-23T18:45:37.359204+0000","last_active":"2023-06-23T18:45:37.366320+0000","last_peered":"2023-06-23T18:45:37.366320+0000","last_clean":"2023-06-23T18:45:37.366320+0000","last_became_active":"2023-06-23T18:45:37.358947+0000","last_became_peered":"2023-06-23T18:45:37.358947+0000","last_unstale":"2023-06-23T18:45:37.366320+0000","last_undegraded":"2023-06-23T18:45:37.366320+0000","last_fullsized":"2023-06-23T18:45:37.366320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:58:38.321849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.362770+0000","last_change":"2023-06-23T18:45:37.361899+0000","last_active":"2023-06-23T18:45:37.362770+0000","last_peered":"2023-06-23T18:45:37.362770+0000","last_clean":"2023-06-23T18:45:37.362770+0000","last_became_active":"2023-06-23T18:45:37.361647+0000","last_became_peered":"2023-06-23T18:45:37.361647+0000","last_unstale":"2023-06-23T18:45:37.362770+0000","last_undegraded":"2023-06-23T18:45:37.362770+0000","last_fullsized":"2023-06-23T18:45:37.362770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:22:07.840330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.359775+0000","last_change":"2023-06-23T18:45:37.357808+0000","last_active":"2023-06-23T18:45:37.359775+0000","last_peered":"2023-06-23T18:45:37.359775+0000","last_clean":"2023-06-23T18:45:37.359775+0000","last_became_active":"2023-06-23T18:45:37.357521+0000","last_became_peered":"2023-06-23T18:45:37.357521+0000","last_unstale":"2023-06-23T18:45:37.359775+0000","last_undegraded":"2023-06-23T18:45:37.359775+0000","last_fullsized":"2023-06-23T18:45:37.359775+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:02:31.427637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.362527+0000","last_change":"2023-06-23T18:45:37.358048+0000","last_active":"2023-06-23T18:45:37.362527+0000","last_peered":"2023-06-23T18:45:37.362527+0000","last_clean":"2023-06-23T18:45:37.362527+0000","last_became_active":"2023-06-23T18:45:37.357785+0000","last_became_peered":"2023-06-23T18:45:37.357785+0000","last_unstale":"2023-06-23T18:45:37.362527+0000","last_undegraded":"2023-06-23T18:45:37.362527+0000","last_fullsized":"2023-06-23T18:45:37.362527+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:13.700319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.374862+0000","last_change":"2023-06-23T18:45:37.372422+0000","last_active":"2023-06-23T18:45:37.374862+0000","last_peered":"2023-06-23T18:45:37.374862+0000","last_clean":"2023-06-23T18:45:37.374862+0000","last_became_active":"2023-06-23T18:45:37.372136+0000","last_became_peered":"2023-06-23T18:45:37.372136+0000","last_unstale":"2023-06-23T18:45:37.374862+0000","last_undegraded":"2023-06-23T18:45:37.374862+0000","last_fullsized":"2023-06-23T18:45:37.374862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:29:34.046509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.366474+0000","last_change":"2023-06-23T18:45:37.358083+0000","last_active":"2023-06-23T18:45:37.366474+0000","last_peered":"2023-06-23T18:45:37.366474+0000","last_clean":"2023-06-23T18:45:37.366474+0000","last_became_active":"2023-06-23T18:45:37.357802+0000","last_became_peered":"2023-06-23T18:45:37.357802+0000","last_unstale":"2023-06-23T18:45:37.366474+0000","last_undegraded":"2023-06-23T18:45:37.366474+0000","last_fullsized":"2023-06-23T18:45:37.366474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:02:39.896090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.367063+0000","last_change":"2023-06-23T18:45:37.357611+0000","last_active":"2023-06-23T18:45:37.367063+0000","last_peered":"2023-06-23T18:45:37.367063+0000","last_clean":"2023-06-23T18:45:37.367063+0000","last_became_active":"2023-06-23T18:45:37.357346+0000","last_became_peered":"2023-06-23T18:45:37.357346+0000","last_unstale":"2023-06-23T18:45:37.367063+0000","last_undegraded":"2023-06-23T18:45:37.367063+0000","last_fullsized":"2023-06-23T18:45:37.367063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:06:13.343933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.358185+0000","last_change":"2023-06-23T18:45:37.357169+0000","last_active":"2023-06-23T18:45:37.358185+0000","last_peered":"2023-06-23T18:45:37.358185+0000","last_clean":"2023-06-23T18:45:37.358185+0000","last_became_active":"2023-06-23T18:45:37.356237+0000","last_became_peered":"2023-06-23T18:45:37.356237+0000","last_unstale":"2023-06-23T18:45:37.358185+0000","last_undegraded":"2023-06-23T18:45:37.358185+0000","last_fullsized":"2023-06-23T18:45:37.358185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:59:23.743660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.356927+0000","last_change":"2023-06-23T18:45:37.354695+0000","last_active":"2023-06-23T18:45:37.356927+0000","last_peered":"2023-06-23T18:45:37.356927+0000","last_clean":"2023-06-23T18:45:37.356927+0000","last_became_active":"2023-06-23T18:45:37.354434+0000","last_became_peered":"2023-06-23T18:45:37.354434+0000","last_unstale":"2023-06-23T18:45:37.356927+0000","last_undegraded":"2023-06-23T18:45:37.356927+0000","last_fullsized":"2023-06-23T18:45:37.356927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:13:26.565977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.366322+0000","last_change":"2023-06-23T18:45:37.359516+0000","last_active":"2023-06-23T18:45:37.366322+0000","last_peered":"2023-06-23T18:45:37.366322+0000","last_clean":"2023-06-23T18:45:37.366322+0000","last_became_active":"2023-06-23T18:45:37.359239+0000","last_became_peered":"2023-06-23T18:45:37.359239+0000","last_unstale":"2023-06-23T18:45:37.366322+0000","last_undegraded":"2023-06-23T18:45:37.366322+0000","last_fullsized":"2023-06-23T18:45:37.366322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:44:37.509204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.357862+0000","last_change":"2023-06-23T18:45:37.355458+0000","last_active":"2023-06-23T18:45:37.357862+0000","last_peered":"2023-06-23T18:45:37.357862+0000","last_clean":"2023-06-23T18:45:37.357862+0000","last_became_active":"2023-06-23T18:45:37.355179+0000","last_became_peered":"2023-06-23T18:45:37.355179+0000","last_unstale":"2023-06-23T18:45:37.357862+0000","last_undegraded":"2023-06-23T18:45:37.357862+0000","last_fullsized":"2023-06-23T18:45:37.357862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:20:21.173101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.366347+0000","last_change":"2023-06-23T18:45:37.363389+0000","last_active":"2023-06-23T18:45:37.366347+0000","last_peered":"2023-06-23T18:45:37.366347+0000","last_clean":"2023-06-23T18:45:37.366347+0000","last_became_active":"2023-06-23T18:45:37.362806+0000","last_became_peered":"2023-06-23T18:45:37.362806+0000","last_unstale":"2023-06-23T18:45:37.366347+0000","last_undegraded":"2023-06-23T18:45:37.366347+0000","last_fullsized":"2023-06-23T18:45:37.366347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:57:32.624331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.370239+0000","last_change":"2023-06-23T18:45:37.368105+0000","last_active":"2023-06-23T18:45:37.370239+0000","last_peered":"2023-06-23T18:45:37.370239+0000","last_clean":"2023-06-23T18:45:37.370239+0000","last_became_active":"2023-06-23T18:45:37.367829+0000","last_became_peered":"2023-06-23T18:45:37.367829+0000","last_unstale":"2023-06-23T18:45:37.370239+0000","last_undegraded":"2023-06-23T18:45:37.370239+0000","last_fullsized":"2023-06-23T18:45:37.370239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:50:03.628231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.361215+0000","last_change":"2023-06-23T18:45:37.358866+0000","last_active":"2023-06-23T18:45:37.361215+0000","last_peered":"2023-06-23T18:45:37.361215+0000","last_clean":"2023-06-23T18:45:37.361215+0000","last_became_active":"2023-06-23T18:45:37.358571+0000","last_became_peered":"2023-06-23T18:45:37.358571+0000","last_unstale":"2023-06-23T18:45:37.361215+0000","last_undegraded":"2023-06-23T18:45:37.361215+0000","last_fullsized":"2023-06-23T18:45:37.361215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:02:06.197488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.361024+0000","last_change":"2023-06-23T18:45:37.358987+0000","last_active":"2023-06-23T18:45:37.361024+0000","last_peered":"2023-06-23T18:45:37.361024+0000","last_clean":"2023-06-23T18:45:37.361024+0000","last_became_active":"2023-06-23T18:45:37.358688+0000","last_became_peered":"2023-06-23T18:45:37.358688+0000","last_unstale":"2023-06-23T18:45:37.361024+0000","last_undegraded":"2023-06-23T18:45:37.361024+0000","last_fullsized":"2023-06-23T18:45:37.361024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:21:19.322277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.370277+0000","last_change":"2023-06-23T18:45:37.367997+0000","last_active":"2023-06-23T18:45:37.370277+0000","last_peered":"2023-06-23T18:45:37.370277+0000","last_clean":"2023-06-23T18:45:37.370277+0000","last_became_active":"2023-06-23T18:45:37.367716+0000","last_became_peered":"2023-06-23T18:45:37.367716+0000","last_unstale":"2023-06-23T18:45:37.370277+0000","last_undegraded":"2023-06-23T18:45:37.370277+0000","last_fullsized":"2023-06-23T18:45:37.370277+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:58:38.321849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.359748+0000","last_change":"2023-06-23T18:45:37.356302+0000","last_active":"2023-06-23T18:45:37.359748+0000","last_peered":"2023-06-23T18:45:37.359748+0000","last_clean":"2023-06-23T18:45:37.359748+0000","last_became_active":"2023-06-23T18:45:37.356047+0000","last_became_peered":"2023-06-23T18:45:37.356047+0000","last_unstale":"2023-06-23T18:45:37.359748+0000","last_undegraded":"2023-06-23T18:45:37.359748+0000","last_fullsized":"2023-06-23T18:45:37.359748+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:40:10.789625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.371194+0000","last_change":"2023-06-23T18:45:37.368599+0000","last_active":"2023-06-23T18:45:37.371194+0000","last_peered":"2023-06-23T18:45:37.371194+0000","last_clean":"2023-06-23T18:45:37.371194+0000","last_became_active":"2023-06-23T18:45:37.368310+0000","last_became_peered":"2023-06-23T18:45:37.368310+0000","last_unstale":"2023-06-23T18:45:37.371194+0000","last_undegraded":"2023-06-23T18:45:37.371194+0000","last_fullsized":"2023-06-23T18:45:37.371194+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:20:21.173101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.360837+0000","last_change":"2023-06-23T18:45:37.357763+0000","last_active":"2023-06-23T18:45:37.360837+0000","last_peered":"2023-06-23T18:45:37.360837+0000","last_clean":"2023-06-23T18:45:37.360837+0000","last_became_active":"2023-06-23T18:45:37.357411+0000","last_became_peered":"2023-06-23T18:45:37.357411+0000","last_unstale":"2023-06-23T18:45:37.360837+0000","last_undegraded":"2023-06-23T18:45:37.360837+0000","last_fullsized":"2023-06-23T18:45:37.360837+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:21:48.226385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.365711+0000","last_change":"2023-06-23T18:45:37.363051+0000","last_active":"2023-06-23T18:45:37.365711+0000","last_peered":"2023-06-23T18:45:37.365711+0000","last_clean":"2023-06-23T18:45:37.365711+0000","last_became_active":"2023-06-23T18:45:37.362035+0000","last_became_peered":"2023-06-23T18:45:37.362035+0000","last_unstale":"2023-06-23T18:45:37.365711+0000","last_undegraded":"2023-06-23T18:45:37.365711+0000","last_fullsized":"2023-06-23T18:45:37.365711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:26:11.887047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.370043+0000","last_change":"2023-06-23T18:45:37.368589+0000","last_active":"2023-06-23T18:45:37.370043+0000","last_peered":"2023-06-23T18:45:37.370043+0000","last_clean":"2023-06-23T18:45:37.370043+0000","last_became_active":"2023-06-23T18:45:37.368338+0000","last_became_peered":"2023-06-23T18:45:37.368338+0000","last_unstale":"2023-06-23T18:45:37.370043+0000","last_undegraded":"2023-06-23T18:45:37.370043+0000","last_fullsized":"2023-06-23T18:45:37.370043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:57:32.624331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.370889+0000","last_change":"2023-06-23T18:45:37.367504+0000","last_active":"2023-06-23T18:45:37.370889+0000","last_peered":"2023-06-23T18:45:37.370889+0000","last_clean":"2023-06-23T18:45:37.370889+0000","last_became_active":"2023-06-23T18:45:37.367258+0000","last_became_peered":"2023-06-23T18:45:37.367258+0000","last_unstale":"2023-06-23T18:45:37.370889+0000","last_undegraded":"2023-06-23T18:45:37.370889+0000","last_fullsized":"2023-06-23T18:45:37.370889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:59:01.005562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.364125+0000","last_change":"2023-06-23T18:45:37.360609+0000","last_active":"2023-06-23T18:45:37.364125+0000","last_peered":"2023-06-23T18:45:37.364125+0000","last_clean":"2023-06-23T18:45:37.364125+0000","last_became_active":"2023-06-23T18:45:37.360298+0000","last_became_peered":"2023-06-23T18:45:37.360298+0000","last_unstale":"2023-06-23T18:45:37.364125+0000","last_undegraded":"2023-06-23T18:45:37.364125+0000","last_fullsized":"2023-06-23T18:45:37.364125+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:44:37.509204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.362013+0000","last_change":"2023-06-23T18:45:37.360481+0000","last_active":"2023-06-23T18:45:37.362013+0000","last_peered":"2023-06-23T18:45:37.362013+0000","last_clean":"2023-06-23T18:45:37.362013+0000","last_became_active":"2023-06-23T18:45:37.360219+0000","last_became_peered":"2023-06-23T18:45:37.360219+0000","last_unstale":"2023-06-23T18:45:37.362013+0000","last_undegraded":"2023-06-23T18:45:37.362013+0000","last_fullsized":"2023-06-23T18:45:37.362013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:38:49.279079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.366133+0000","last_change":"2023-06-23T18:45:37.363594+0000","last_active":"2023-06-23T18:45:37.366133+0000","last_peered":"2023-06-23T18:45:37.366133+0000","last_clean":"2023-06-23T18:45:37.366133+0000","last_became_active":"2023-06-23T18:45:37.362677+0000","last_became_peered":"2023-06-23T18:45:37.362677+0000","last_unstale":"2023-06-23T18:45:37.366133+0000","last_undegraded":"2023-06-23T18:45:37.366133+0000","last_fullsized":"2023-06-23T18:45:37.366133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:33:52.674356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.374865+0000","last_change":"2023-06-23T18:45:37.372450+0000","last_active":"2023-06-23T18:45:37.374865+0000","last_peered":"2023-06-23T18:45:37.374865+0000","last_clean":"2023-06-23T18:45:37.374865+0000","last_became_active":"2023-06-23T18:45:37.372232+0000","last_became_peered":"2023-06-23T18:45:37.372232+0000","last_unstale":"2023-06-23T18:45:37.374865+0000","last_undegraded":"2023-06-23T18:45:37.374865+0000","last_fullsized":"2023-06-23T18:45:37.374865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:24:27.309798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.368496+0000","last_change":"2023-06-23T18:45:37.364560+0000","last_active":"2023-06-23T18:45:37.368496+0000","last_peered":"2023-06-23T18:45:37.368496+0000","last_clean":"2023-06-23T18:45:37.368496+0000","last_became_active":"2023-06-23T18:45:37.364209+0000","last_became_peered":"2023-06-23T18:45:37.364209+0000","last_unstale":"2023-06-23T18:45:37.368496+0000","last_undegraded":"2023-06-23T18:45:37.368496+0000","last_fullsized":"2023-06-23T18:45:37.368496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:24:27.309798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.368600+0000","last_change":"2023-06-23T18:45:37.367655+0000","last_active":"2023-06-23T18:45:37.368600+0000","last_peered":"2023-06-23T18:45:37.368600+0000","last_clean":"2023-06-23T18:45:37.368600+0000","last_became_active":"2023-06-23T18:45:37.367373+0000","last_became_peered":"2023-06-23T18:45:37.367373+0000","last_unstale":"2023-06-23T18:45:37.368600+0000","last_undegraded":"2023-06-23T18:45:37.368600+0000","last_fullsized":"2023-06-23T18:45:37.368600+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:13:26.565977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.371840+0000","last_change":"2023-06-23T18:45:37.368718+0000","last_active":"2023-06-23T18:45:37.371840+0000","last_peered":"2023-06-23T18:45:37.371840+0000","last_clean":"2023-06-23T18:45:37.371840+0000","last_became_active":"2023-06-23T18:45:37.368426+0000","last_became_peered":"2023-06-23T18:45:37.368426+0000","last_unstale":"2023-06-23T18:45:37.371840+0000","last_undegraded":"2023-06-23T18:45:37.371840+0000","last_fullsized":"2023-06-23T18:45:37.371840+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:50:06.418172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.362726+0000","last_change":"2023-06-23T18:45:37.359942+0000","last_active":"2023-06-23T18:45:37.362726+0000","last_peered":"2023-06-23T18:45:37.362726+0000","last_clean":"2023-06-23T18:45:37.362726+0000","last_became_active":"2023-06-23T18:45:37.359415+0000","last_became_peered":"2023-06-23T18:45:37.359415+0000","last_unstale":"2023-06-23T18:45:37.362726+0000","last_undegraded":"2023-06-23T18:45:37.362726+0000","last_fullsized":"2023-06-23T18:45:37.362726+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:58:51.395271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.361509+0000","last_change":"2023-06-23T18:45:37.359478+0000","last_active":"2023-06-23T18:45:37.361509+0000","last_peered":"2023-06-23T18:45:37.361509+0000","last_clean":"2023-06-23T18:45:37.361509+0000","last_became_active":"2023-06-23T18:45:37.359097+0000","last_became_peered":"2023-06-23T18:45:37.359097+0000","last_unstale":"2023-06-23T18:45:37.361509+0000","last_undegraded":"2023-06-23T18:45:37.361509+0000","last_fullsized":"2023-06-23T18:45:37.361509+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:06:07.216241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"31'4","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.373841+0000","last_change":"2023-06-23T18:45:36.940233+0000","last_active":"2023-06-23T18:45:37.373841+0000","last_peered":"2023-06-23T18:45:37.373841+0000","last_clean":"2023-06-23T18:45:37.373841+0000","last_became_active":"2023-06-23T18:45:36.939965+0000","last_became_peered":"2023-06-23T18:45:36.939965+0000","last_unstale":"2023-06-23T18:45:37.373841+0000","last_undegraded":"2023-06-23T18:45:37.373841+0000","last_fullsized":"2023-06-23T18:45:37.373841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:06:12.336322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.362727+0000","last_change":"2023-06-23T18:45:37.359956+0000","last_active":"2023-06-23T18:45:37.362727+0000","last_peered":"2023-06-23T18:45:37.362727+0000","last_clean":"2023-06-23T18:45:37.362727+0000","last_became_active":"2023-06-23T18:45:37.359659+0000","last_became_peered":"2023-06-23T18:45:37.359659+0000","last_unstale":"2023-06-23T18:45:37.362727+0000","last_undegraded":"2023-06-23T18:45:37.362727+0000","last_fullsized":"2023-06-23T18:45:37.362727+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:33:52.674356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.370075+0000","last_change":"2023-06-23T18:45:36.938067+0000","last_active":"2023-06-23T18:45:37.370075+0000","last_peered":"2023-06-23T18:45:37.370075+0000","last_clean":"2023-06-23T18:45:37.370075+0000","last_became_active":"2023-06-23T18:45:36.937795+0000","last_became_peered":"2023-06-23T18:45:36.937795+0000","last_unstale":"2023-06-23T18:45:37.370075+0000","last_undegraded":"2023-06-23T18:45:37.370075+0000","last_fullsized":"2023-06-23T18:45:37.370075+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:58:50.387659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.365387+0000","last_change":"2023-06-23T18:45:37.362128+0000","last_active":"2023-06-23T18:45:37.365387+0000","last_peered":"2023-06-23T18:45:37.365387+0000","last_clean":"2023-06-23T18:45:37.365387+0000","last_became_active":"2023-06-23T18:45:37.361861+0000","last_became_peered":"2023-06-23T18:45:37.361861+0000","last_unstale":"2023-06-23T18:45:37.365387+0000","last_undegraded":"2023-06-23T18:45:37.365387+0000","last_fullsized":"2023-06-23T18:45:37.365387+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:29.762207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.368611+0000","last_change":"2023-06-23T18:45:36.939656+0000","last_active":"2023-06-23T18:45:37.368611+0000","last_peered":"2023-06-23T18:45:37.368611+0000","last_clean":"2023-06-23T18:45:37.368611+0000","last_became_active":"2023-06-23T18:45:36.938611+0000","last_became_peered":"2023-06-23T18:45:36.938611+0000","last_unstale":"2023-06-23T18:45:37.368611+0000","last_undegraded":"2023-06-23T18:45:37.368611+0000","last_fullsized":"2023-06-23T18:45:37.368611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:57:06.102657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.373866+0000","last_change":"2023-06-23T18:45:37.372904+0000","last_active":"2023-06-23T18:45:37.373866+0000","last_peered":"2023-06-23T18:45:37.373866+0000","last_clean":"2023-06-23T18:45:37.373866+0000","last_became_active":"2023-06-23T18:45:37.372578+0000","last_became_peered":"2023-06-23T18:45:37.372578+0000","last_unstale":"2023-06-23T18:45:37.373866+0000","last_undegraded":"2023-06-23T18:45:37.373866+0000","last_fullsized":"2023-06-23T18:45:37.373866+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:02:06.197488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.374659+0000","last_change":"2023-06-23T18:45:36.937939+0000","last_active":"2023-06-23T18:45:37.374659+0000","last_peered":"2023-06-23T18:45:37.374659+0000","last_clean":"2023-06-23T18:45:37.374659+0000","last_became_active":"2023-06-23T18:45:36.937674+0000","last_became_peered":"2023-06-23T18:45:36.937674+0000","last_unstale":"2023-06-23T18:45:37.374659+0000","last_undegraded":"2023-06-23T18:45:37.374659+0000","last_fullsized":"2023-06-23T18:45:37.374659+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:02:05.189877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.364046+0000","last_change":"2023-06-23T18:45:37.355219+0000","last_active":"2023-06-23T18:45:37.364046+0000","last_peered":"2023-06-23T18:45:37.364046+0000","last_clean":"2023-06-23T18:45:37.364046+0000","last_became_active":"2023-06-23T18:45:37.354946+0000","last_became_peered":"2023-06-23T18:45:37.354946+0000","last_unstale":"2023-06-23T18:45:37.364046+0000","last_undegraded":"2023-06-23T18:45:37.364046+0000","last_fullsized":"2023-06-23T18:45:37.364046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:59:23.743660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.369507+0000","last_change":"2023-06-23T18:45:36.936405+0000","last_active":"2023-06-23T18:45:37.369507+0000","last_peered":"2023-06-23T18:45:37.369507+0000","last_clean":"2023-06-23T18:45:37.369507+0000","last_became_active":"2023-06-23T18:45:36.936123+0000","last_became_peered":"2023-06-23T18:45:36.936123+0000","last_unstale":"2023-06-23T18:45:37.369507+0000","last_undegraded":"2023-06-23T18:45:37.369507+0000","last_fullsized":"2023-06-23T18:45:37.369507+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:57:06.102657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.357674+0000","last_change":"2023-06-23T18:45:37.356242+0000","last_active":"2023-06-23T18:45:37.357674+0000","last_peered":"2023-06-23T18:45:37.357674+0000","last_clean":"2023-06-23T18:45:37.357674+0000","last_became_active":"2023-06-23T18:45:37.355948+0000","last_became_peered":"2023-06-23T18:45:37.355948+0000","last_unstale":"2023-06-23T18:45:37.357674+0000","last_undegraded":"2023-06-23T18:45:37.357674+0000","last_fullsized":"2023-06-23T18:45:37.357674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:13.700319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.367833+0000","last_change":"2023-06-23T18:45:36.941050+0000","last_active":"2023-06-23T18:45:37.367833+0000","last_peered":"2023-06-23T18:45:37.367833+0000","last_clean":"2023-06-23T18:45:37.367833+0000","last_became_active":"2023-06-23T18:45:36.940786+0000","last_became_peered":"2023-06-23T18:45:36.940786+0000","last_unstale":"2023-06-23T18:45:37.367833+0000","last_undegraded":"2023-06-23T18:45:37.367833+0000","last_fullsized":"2023-06-23T18:45:37.367833+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:41:42.690395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.364393+0000","last_change":"2023-06-23T18:45:37.358326+0000","last_active":"2023-06-23T18:45:37.364393+0000","last_peered":"2023-06-23T18:45:37.364393+0000","last_clean":"2023-06-23T18:45:37.364393+0000","last_became_active":"2023-06-23T18:45:37.358044+0000","last_became_peered":"2023-06-23T18:45:37.358044+0000","last_unstale":"2023-06-23T18:45:37.364393+0000","last_undegraded":"2023-06-23T18:45:37.364393+0000","last_fullsized":"2023-06-23T18:45:37.364393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:55:30.533014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.349420+0000","last_change":"2023-06-23T18:45:36.941302+0000","last_active":"2023-06-23T18:45:37.349420+0000","last_peered":"2023-06-23T18:45:37.349420+0000","last_clean":"2023-06-23T18:45:37.349420+0000","last_became_active":"2023-06-23T18:45:36.941007+0000","last_became_peered":"2023-06-23T18:45:36.941007+0000","last_unstale":"2023-06-23T18:45:37.349420+0000","last_undegraded":"2023-06-23T18:45:37.349420+0000","last_fullsized":"2023-06-23T18:45:37.349420+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:51:01.418238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.366291+0000","last_change":"2023-06-23T18:45:37.358265+0000","last_active":"2023-06-23T18:45:37.366291+0000","last_peered":"2023-06-23T18:45:37.366291+0000","last_clean":"2023-06-23T18:45:37.366291+0000","last_became_active":"2023-06-23T18:45:37.357894+0000","last_became_peered":"2023-06-23T18:45:37.357894+0000","last_unstale":"2023-06-23T18:45:37.366291+0000","last_undegraded":"2023-06-23T18:45:37.366291+0000","last_fullsized":"2023-06-23T18:45:37.366291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:57:32.624331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.351121+0000","last_change":"2023-06-23T18:45:36.935540+0000","last_active":"2023-06-23T18:45:37.351121+0000","last_peered":"2023-06-23T18:45:37.351121+0000","last_clean":"2023-06-23T18:45:37.351121+0000","last_became_active":"2023-06-23T18:45:36.935238+0000","last_became_peered":"2023-06-23T18:45:36.935238+0000","last_unstale":"2023-06-23T18:45:37.351121+0000","last_undegraded":"2023-06-23T18:45:37.351121+0000","last_fullsized":"2023-06-23T18:45:37.351121+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:13:14.894464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.362788+0000","last_change":"2023-06-23T18:45:37.361997+0000","last_active":"2023-06-23T18:45:37.362788+0000","last_peered":"2023-06-23T18:45:37.362788+0000","last_clean":"2023-06-23T18:45:37.362788+0000","last_became_active":"2023-06-23T18:45:37.361738+0000","last_became_peered":"2023-06-23T18:45:37.361738+0000","last_unstale":"2023-06-23T18:45:37.362788+0000","last_undegraded":"2023-06-23T18:45:37.362788+0000","last_fullsized":"2023-06-23T18:45:37.362788+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T00:23:58.005226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.360670+0000","last_change":"2023-06-23T18:45:36.936924+0000","last_active":"2023-06-23T18:45:37.360670+0000","last_peered":"2023-06-23T18:45:37.360670+0000","last_clean":"2023-06-23T18:45:37.360670+0000","last_became_active":"2023-06-23T18:45:36.936617+0000","last_became_peered":"2023-06-23T18:45:36.936617+0000","last_unstale":"2023-06-23T18:45:37.360670+0000","last_undegraded":"2023-06-23T18:45:37.360670+0000","last_fullsized":"2023-06-23T18:45:37.360670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:42:16.302504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.369872+0000","last_change":"2023-06-23T18:45:37.364345+0000","last_active":"2023-06-23T18:45:37.369872+0000","last_peered":"2023-06-23T18:45:37.369872+0000","last_clean":"2023-06-23T18:45:37.369872+0000","last_became_active":"2023-06-23T18:45:37.364015+0000","last_became_peered":"2023-06-23T18:45:37.364015+0000","last_unstale":"2023-06-23T18:45:37.369872+0000","last_undegraded":"2023-06-23T18:45:37.369872+0000","last_fullsized":"2023-06-23T18:45:37.369872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:26:11.887047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.346622+0000","last_change":"2023-06-23T18:45:36.938364+0000","last_active":"2023-06-23T18:45:37.346622+0000","last_peered":"2023-06-23T18:45:37.346622+0000","last_clean":"2023-06-23T18:45:37.346622+0000","last_became_active":"2023-06-23T18:45:36.938034+0000","last_became_peered":"2023-06-23T18:45:36.938034+0000","last_unstale":"2023-06-23T18:45:37.346622+0000","last_undegraded":"2023-06-23T18:45:37.346622+0000","last_fullsized":"2023-06-23T18:45:37.346622+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:58:37.314237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.365470+0000","last_change":"2023-06-23T18:45:37.357056+0000","last_active":"2023-06-23T18:45:37.365470+0000","last_peered":"2023-06-23T18:45:37.365470+0000","last_clean":"2023-06-23T18:45:37.365470+0000","last_became_active":"2023-06-23T18:45:37.356757+0000","last_became_peered":"2023-06-23T18:45:37.356757+0000","last_unstale":"2023-06-23T18:45:37.365470+0000","last_undegraded":"2023-06-23T18:45:37.365470+0000","last_fullsized":"2023-06-23T18:45:37.365470+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:13:26.565977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"31'3","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.370690+0000","last_change":"2023-06-23T18:45:36.938710+0000","last_active":"2023-06-23T18:45:37.370690+0000","last_peered":"2023-06-23T18:45:37.370690+0000","last_clean":"2023-06-23T18:45:37.370690+0000","last_became_active":"2023-06-23T18:45:36.938430+0000","last_became_peered":"2023-06-23T18:45:36.938430+0000","last_unstale":"2023-06-23T18:45:37.370690+0000","last_undegraded":"2023-06-23T18:45:37.370690+0000","last_fullsized":"2023-06-23T18:45:37.370690+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:51:01.418238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.364019+0000","last_change":"2023-06-23T18:45:37.360317+0000","last_active":"2023-06-23T18:45:37.364019+0000","last_peered":"2023-06-23T18:45:37.364019+0000","last_clean":"2023-06-23T18:45:37.364019+0000","last_became_active":"2023-06-23T18:45:37.359955+0000","last_became_peered":"2023-06-23T18:45:37.359955+0000","last_unstale":"2023-06-23T18:45:37.364019+0000","last_undegraded":"2023-06-23T18:45:37.364019+0000","last_fullsized":"2023-06-23T18:45:37.364019+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:50:06.418172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"31'6","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.375608+0000","last_change":"2023-06-23T18:45:36.938468+0000","last_active":"2023-06-23T18:45:37.375608+0000","last_peered":"2023-06-23T18:45:37.375608+0000","last_clean":"2023-06-23T18:45:37.375608+0000","last_became_active":"2023-06-23T18:45:36.938187+0000","last_became_peered":"2023-06-23T18:45:36.938187+0000","last_unstale":"2023-06-23T18:45:37.375608+0000","last_undegraded":"2023-06-23T18:45:37.375608+0000","last_fullsized":"2023-06-23T18:45:37.375608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:32:22.108504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.367217+0000","last_change":"2023-06-23T18:45:37.358481+0000","last_active":"2023-06-23T18:45:37.367217+0000","last_peered":"2023-06-23T18:45:37.367217+0000","last_clean":"2023-06-23T18:45:37.367217+0000","last_became_active":"2023-06-23T18:45:37.358233+0000","last_became_peered":"2023-06-23T18:45:37.358233+0000","last_unstale":"2023-06-23T18:45:37.367217+0000","last_undegraded":"2023-06-23T18:45:37.367217+0000","last_fullsized":"2023-06-23T18:45:37.367217+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:14:04.704583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.373857+0000","last_change":"2023-06-23T18:45:36.940555+0000","last_active":"2023-06-23T18:45:37.373857+0000","last_peered":"2023-06-23T18:45:37.373857+0000","last_clean":"2023-06-23T18:45:37.373857+0000","last_became_active":"2023-06-23T18:45:36.940278+0000","last_became_peered":"2023-06-23T18:45:36.940278+0000","last_unstale":"2023-06-23T18:45:37.373857+0000","last_undegraded":"2023-06-23T18:45:37.373857+0000","last_fullsized":"2023-06-23T18:45:37.373857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:19:07.621866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.372472+0000","last_change":"2023-06-23T18:45:37.359121+0000","last_active":"2023-06-23T18:45:37.372472+0000","last_peered":"2023-06-23T18:45:37.372472+0000","last_clean":"2023-06-23T18:45:37.372472+0000","last_became_active":"2023-06-23T18:45:37.358869+0000","last_became_peered":"2023-06-23T18:45:37.358869+0000","last_unstale":"2023-06-23T18:45:37.372472+0000","last_undegraded":"2023-06-23T18:45:37.372472+0000","last_fullsized":"2023-06-23T18:45:37.372472+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:55:30.533014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.350819+0000","last_change":"2023-06-23T18:45:36.943037+0000","last_active":"2023-06-23T18:45:37.350819+0000","last_peered":"2023-06-23T18:45:37.350819+0000","last_clean":"2023-06-23T18:45:37.350819+0000","last_became_active":"2023-06-23T18:45:36.942727+0000","last_became_peered":"2023-06-23T18:45:36.942727+0000","last_unstale":"2023-06-23T18:45:37.350819+0000","last_undegraded":"2023-06-23T18:45:37.350819+0000","last_fullsized":"2023-06-23T18:45:37.350819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:21:47.218774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.370059+0000","last_change":"2023-06-23T18:45:37.367920+0000","last_active":"2023-06-23T18:45:37.370059+0000","last_peered":"2023-06-23T18:45:37.370059+0000","last_clean":"2023-06-23T18:45:37.370059+0000","last_became_active":"2023-06-23T18:45:37.367649+0000","last_became_peered":"2023-06-23T18:45:37.367649+0000","last_unstale":"2023-06-23T18:45:37.370059+0000","last_undegraded":"2023-06-23T18:45:37.370059+0000","last_fullsized":"2023-06-23T18:45:37.370059+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:13:15.902075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.359404+0000","last_change":"2023-06-23T18:45:36.937410+0000","last_active":"2023-06-23T18:45:37.359404+0000","last_peered":"2023-06-23T18:45:37.359404+0000","last_clean":"2023-06-23T18:45:37.359404+0000","last_became_active":"2023-06-23T18:45:36.937165+0000","last_became_peered":"2023-06-23T18:45:36.937165+0000","last_unstale":"2023-06-23T18:45:37.359404+0000","last_undegraded":"2023-06-23T18:45:37.359404+0000","last_fullsized":"2023-06-23T18:45:37.359404+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:51:01.418238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.373157+0000","last_change":"2023-06-23T18:45:37.359478+0000","last_active":"2023-06-23T18:45:37.373157+0000","last_peered":"2023-06-23T18:45:37.373157+0000","last_clean":"2023-06-23T18:45:37.373157+0000","last_became_active":"2023-06-23T18:45:37.359292+0000","last_became_peered":"2023-06-23T18:45:37.359292+0000","last_unstale":"2023-06-23T18:45:37.373157+0000","last_undegraded":"2023-06-23T18:45:37.373157+0000","last_fullsized":"2023-06-23T18:45:37.373157+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:07:06.615669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"31'8","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.374056+0000","last_change":"2023-06-23T18:45:36.940114+0000","last_active":"2023-06-23T18:45:37.374056+0000","last_peered":"2023-06-23T18:45:37.374056+0000","last_clean":"2023-06-23T18:45:37.374056+0000","last_became_active":"2023-06-23T18:45:36.939842+0000","last_became_peered":"2023-06-23T18:45:36.939842+0000","last_unstale":"2023-06-23T18:45:37.374056+0000","last_undegraded":"2023-06-23T18:45:37.374056+0000","last_fullsized":"2023-06-23T18:45:37.374056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:32:22.108504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.373737+0000","last_change":"2023-06-23T18:45:37.361543+0000","last_active":"2023-06-23T18:45:37.373737+0000","last_peered":"2023-06-23T18:45:37.373737+0000","last_clean":"2023-06-23T18:45:37.373737+0000","last_became_active":"2023-06-23T18:45:37.361319+0000","last_became_peered":"2023-06-23T18:45:37.361319+0000","last_unstale":"2023-06-23T18:45:37.373737+0000","last_undegraded":"2023-06-23T18:45:37.373737+0000","last_fullsized":"2023-06-23T18:45:37.373737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:29.762207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.370504+0000","last_change":"2023-06-23T18:45:36.939177+0000","last_active":"2023-06-23T18:45:37.370504+0000","last_peered":"2023-06-23T18:45:37.370504+0000","last_clean":"2023-06-23T18:45:37.370504+0000","last_became_active":"2023-06-23T18:45:36.938755+0000","last_became_peered":"2023-06-23T18:45:36.938755+0000","last_unstale":"2023-06-23T18:45:37.370504+0000","last_undegraded":"2023-06-23T18:45:37.370504+0000","last_fullsized":"2023-06-23T18:45:37.370504+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:04:49.025830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.358903+0000","last_change":"2023-06-23T18:45:37.356600+0000","last_active":"2023-06-23T18:45:37.358903+0000","last_peered":"2023-06-23T18:45:37.358903+0000","last_clean":"2023-06-23T18:45:37.358903+0000","last_became_active":"2023-06-23T18:45:37.355986+0000","last_became_peered":"2023-06-23T18:45:37.355986+0000","last_unstale":"2023-06-23T18:45:37.358903+0000","last_undegraded":"2023-06-23T18:45:37.358903+0000","last_fullsized":"2023-06-23T18:45:37.358903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:16:18.262645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.374128+0000","last_change":"2023-06-23T18:45:36.940645+0000","last_active":"2023-06-23T18:45:37.374128+0000","last_peered":"2023-06-23T18:45:37.374128+0000","last_clean":"2023-06-23T18:45:37.374128+0000","last_became_active":"2023-06-23T18:45:36.940267+0000","last_became_peered":"2023-06-23T18:45:36.940267+0000","last_unstale":"2023-06-23T18:45:37.374128+0000","last_undegraded":"2023-06-23T18:45:37.374128+0000","last_fullsized":"2023-06-23T18:45:37.374128+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:19:07.621866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.358277+0000","last_change":"2023-06-23T18:45:37.357267+0000","last_active":"2023-06-23T18:45:37.358277+0000","last_peered":"2023-06-23T18:45:37.358277+0000","last_clean":"2023-06-23T18:45:37.358277+0000","last_became_active":"2023-06-23T18:45:37.356959+0000","last_became_peered":"2023-06-23T18:45:37.356959+0000","last_unstale":"2023-06-23T18:45:37.358277+0000","last_undegraded":"2023-06-23T18:45:37.358277+0000","last_fullsized":"2023-06-23T18:45:37.358277+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:41:43.698006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.372960+0000","last_change":"2023-06-23T18:45:36.941559+0000","last_active":"2023-06-23T18:45:37.372960+0000","last_peered":"2023-06-23T18:45:37.372960+0000","last_clean":"2023-06-23T18:45:37.372960+0000","last_became_active":"2023-06-23T18:45:36.940649+0000","last_became_peered":"2023-06-23T18:45:36.940649+0000","last_unstale":"2023-06-23T18:45:37.372960+0000","last_undegraded":"2023-06-23T18:45:37.372960+0000","last_fullsized":"2023-06-23T18:45:37.372960+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:22:15.198445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.374783+0000","last_change":"2023-06-23T18:45:37.373115+0000","last_active":"2023-06-23T18:45:37.374783+0000","last_peered":"2023-06-23T18:45:37.374783+0000","last_clean":"2023-06-23T18:45:37.374783+0000","last_became_active":"2023-06-23T18:45:37.372850+0000","last_became_peered":"2023-06-23T18:45:37.372850+0000","last_unstale":"2023-06-23T18:45:37.374783+0000","last_undegraded":"2023-06-23T18:45:37.374783+0000","last_fullsized":"2023-06-23T18:45:37.374783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:59:37.721277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.351575+0000","last_change":"2023-06-23T18:45:36.938063+0000","last_active":"2023-06-23T18:45:37.351575+0000","last_peered":"2023-06-23T18:45:37.351575+0000","last_clean":"2023-06-23T18:45:37.351575+0000","last_became_active":"2023-06-23T18:45:36.937758+0000","last_became_peered":"2023-06-23T18:45:36.937758+0000","last_unstale":"2023-06-23T18:45:37.351575+0000","last_undegraded":"2023-06-23T18:45:37.351575+0000","last_fullsized":"2023-06-23T18:45:37.351575+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:56:13.993890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.372626+0000","last_change":"2023-06-23T18:45:37.370689+0000","last_active":"2023-06-23T18:45:37.372626+0000","last_peered":"2023-06-23T18:45:37.372626+0000","last_clean":"2023-06-23T18:45:37.372626+0000","last_became_active":"2023-06-23T18:45:37.367676+0000","last_became_peered":"2023-06-23T18:45:37.367676+0000","last_unstale":"2023-06-23T18:45:37.372626+0000","last_undegraded":"2023-06-23T18:45:37.372626+0000","last_fullsized":"2023-06-23T18:45:37.372626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:54:01.544372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.371002+0000","last_change":"2023-06-23T18:45:36.938744+0000","last_active":"2023-06-23T18:45:37.371002+0000","last_peered":"2023-06-23T18:45:37.371002+0000","last_clean":"2023-06-23T18:45:37.371002+0000","last_became_active":"2023-06-23T18:45:36.938445+0000","last_became_peered":"2023-06-23T18:45:36.938445+0000","last_unstale":"2023-06-23T18:45:37.371002+0000","last_undegraded":"2023-06-23T18:45:37.371002+0000","last_fullsized":"2023-06-23T18:45:37.371002+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:44:12.590549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.365285+0000","last_change":"2023-06-23T18:45:37.357023+0000","last_active":"2023-06-23T18:45:37.365285+0000","last_peered":"2023-06-23T18:45:37.365285+0000","last_clean":"2023-06-23T18:45:37.365285+0000","last_became_active":"2023-06-23T18:45:37.356731+0000","last_became_peered":"2023-06-23T18:45:37.356731+0000","last_unstale":"2023-06-23T18:45:37.365285+0000","last_undegraded":"2023-06-23T18:45:37.365285+0000","last_fullsized":"2023-06-23T18:45:37.365285+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:16:18.262645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.346327+0000","last_change":"2023-06-23T18:45:36.940121+0000","last_active":"2023-06-23T18:45:37.346327+0000","last_peered":"2023-06-23T18:45:37.346327+0000","last_clean":"2023-06-23T18:45:37.346327+0000","last_became_active":"2023-06-23T18:45:36.939813+0000","last_became_peered":"2023-06-23T18:45:36.939813+0000","last_unstale":"2023-06-23T18:45:37.346327+0000","last_undegraded":"2023-06-23T18:45:37.346327+0000","last_fullsized":"2023-06-23T18:45:37.346327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:06:32.905760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.364191+0000","last_change":"2023-06-23T18:45:37.361318+0000","last_active":"2023-06-23T18:45:37.364191+0000","last_peered":"2023-06-23T18:45:37.364191+0000","last_clean":"2023-06-23T18:45:37.364191+0000","last_became_active":"2023-06-23T18:45:37.361032+0000","last_became_peered":"2023-06-23T18:45:37.361032+0000","last_unstale":"2023-06-23T18:45:37.364191+0000","last_undegraded":"2023-06-23T18:45:37.364191+0000","last_fullsized":"2023-06-23T18:45:37.364191+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:06:13.343933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.350782+0000","last_change":"2023-06-23T18:45:36.939541+0000","last_active":"2023-06-23T18:45:37.350782+0000","last_peered":"2023-06-23T18:45:37.350782+0000","last_clean":"2023-06-23T18:45:37.350782+0000","last_became_active":"2023-06-23T18:45:36.939260+0000","last_became_peered":"2023-06-23T18:45:36.939260+0000","last_unstale":"2023-06-23T18:45:37.350782+0000","last_undegraded":"2023-06-23T18:45:37.350782+0000","last_fullsized":"2023-06-23T18:45:37.350782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:07:05.608057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.373682+0000","last_change":"2023-06-23T18:45:37.358586+0000","last_active":"2023-06-23T18:45:37.373682+0000","last_peered":"2023-06-23T18:45:37.373682+0000","last_clean":"2023-06-23T18:45:37.373682+0000","last_became_active":"2023-06-23T18:45:37.358305+0000","last_became_peered":"2023-06-23T18:45:37.358305+0000","last_unstale":"2023-06-23T18:45:37.373682+0000","last_undegraded":"2023-06-23T18:45:37.373682+0000","last_fullsized":"2023-06-23T18:45:37.373682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:41:43.698006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.346887+0000","last_change":"2023-06-23T18:45:36.938133+0000","last_active":"2023-06-23T18:45:37.346887+0000","last_peered":"2023-06-23T18:45:37.346887+0000","last_clean":"2023-06-23T18:45:37.346887+0000","last_became_active":"2023-06-23T18:45:36.937814+0000","last_became_peered":"2023-06-23T18:45:36.937814+0000","last_unstale":"2023-06-23T18:45:37.346887+0000","last_undegraded":"2023-06-23T18:45:37.346887+0000","last_fullsized":"2023-06-23T18:45:37.346887+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:30:54.940118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.365730+0000","last_change":"2023-06-23T18:45:37.363222+0000","last_active":"2023-06-23T18:45:37.365730+0000","last_peered":"2023-06-23T18:45:37.365730+0000","last_clean":"2023-06-23T18:45:37.365730+0000","last_became_active":"2023-06-23T18:45:37.362449+0000","last_became_peered":"2023-06-23T18:45:37.362449+0000","last_unstale":"2023-06-23T18:45:37.365730+0000","last_undegraded":"2023-06-23T18:45:37.365730+0000","last_fullsized":"2023-06-23T18:45:37.365730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:07:06.615669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.351131+0000","last_change":"2023-06-23T18:45:36.936215+0000","last_active":"2023-06-23T18:45:37.351131+0000","last_peered":"2023-06-23T18:45:37.351131+0000","last_clean":"2023-06-23T18:45:37.351131+0000","last_became_active":"2023-06-23T18:45:36.935882+0000","last_became_peered":"2023-06-23T18:45:36.935882+0000","last_unstale":"2023-06-23T18:45:37.351131+0000","last_undegraded":"2023-06-23T18:45:37.351131+0000","last_fullsized":"2023-06-23T18:45:37.351131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:02:38.888478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.352196+0000","last_change":"2023-06-23T18:44:45.192683+0000","last_active":"2023-06-23T18:45:37.352196+0000","last_peered":"2023-06-23T18:45:37.352196+0000","last_clean":"2023-06-23T18:45:37.352196+0000","last_became_active":"2023-06-23T18:44:45.192364+0000","last_became_peered":"2023-06-23T18:44:45.192364+0000","last_unstale":"2023-06-23T18:45:37.352196+0000","last_undegraded":"2023-06-23T18:45:37.352196+0000","last_fullsized":"2023-06-23T18:45:37.352196+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:05:14.480613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.370054+0000","last_change":"2023-06-23T18:45:37.365439+0000","last_active":"2023-06-23T18:45:37.370054+0000","last_peered":"2023-06-23T18:45:37.370054+0000","last_clean":"2023-06-23T18:45:37.370054+0000","last_became_active":"2023-06-23T18:45:37.365174+0000","last_became_peered":"2023-06-23T18:45:37.365174+0000","last_unstale":"2023-06-23T18:45:37.370054+0000","last_undegraded":"2023-06-23T18:45:37.370054+0000","last_fullsized":"2023-06-23T18:45:37.370054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:41:29.762207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.353524+0000","last_change":"2023-06-23T18:45:36.935157+0000","last_active":"2023-06-23T18:45:37.353524+0000","last_peered":"2023-06-23T18:45:37.353524+0000","last_clean":"2023-06-23T18:45:37.353524+0000","last_became_active":"2023-06-23T18:45:36.934859+0000","last_became_peered":"2023-06-23T18:45:36.934859+0000","last_unstale":"2023-06-23T18:45:37.353524+0000","last_undegraded":"2023-06-23T18:45:37.353524+0000","last_fullsized":"2023-06-23T18:45:37.353524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:26:10.879436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.357282+0000","last_change":"2023-06-23T18:44:45.194010+0000","last_active":"2023-06-23T18:45:37.357282+0000","last_peered":"2023-06-23T18:45:37.357282+0000","last_clean":"2023-06-23T18:45:37.357282+0000","last_became_active":"2023-06-23T18:44:45.193665+0000","last_became_peered":"2023-06-23T18:44:45.193665+0000","last_unstale":"2023-06-23T18:45:37.357282+0000","last_undegraded":"2023-06-23T18:45:37.357282+0000","last_fullsized":"2023-06-23T18:45:37.357282+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:55:10.851099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.362501+0000","last_change":"2023-06-23T18:45:37.358682+0000","last_active":"2023-06-23T18:45:37.362501+0000","last_peered":"2023-06-23T18:45:37.362501+0000","last_clean":"2023-06-23T18:45:37.362501+0000","last_became_active":"2023-06-23T18:45:37.358415+0000","last_became_peered":"2023-06-23T18:45:37.358415+0000","last_unstale":"2023-06-23T18:45:37.362501+0000","last_undegraded":"2023-06-23T18:45:37.362501+0000","last_fullsized":"2023-06-23T18:45:37.362501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:40:40.301810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"31'2","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.369632+0000","last_change":"2023-06-23T18:45:36.939026+0000","last_active":"2023-06-23T18:45:37.369632+0000","last_peered":"2023-06-23T18:45:37.369632+0000","last_clean":"2023-06-23T18:45:37.369632+0000","last_became_active":"2023-06-23T18:45:36.938397+0000","last_became_peered":"2023-06-23T18:45:36.938397+0000","last_unstale":"2023-06-23T18:45:37.369632+0000","last_undegraded":"2023-06-23T18:45:37.369632+0000","last_fullsized":"2023-06-23T18:45:37.369632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:33:51.666744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.349072+0000","last_change":"2023-06-23T18:44:45.192024+0000","last_active":"2023-06-23T18:45:37.349072+0000","last_peered":"2023-06-23T18:45:37.349072+0000","last_clean":"2023-06-23T18:45:37.349072+0000","last_became_active":"2023-06-23T18:44:45.191752+0000","last_became_peered":"2023-06-23T18:44:45.191752+0000","last_unstale":"2023-06-23T18:45:37.349072+0000","last_undegraded":"2023-06-23T18:45:37.349072+0000","last_fullsized":"2023-06-23T18:45:37.349072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T22:23:34.574171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":185,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.353120+0000","last_change":"2023-06-23T18:44:45.193018+0000","last_active":"2023-06-23T18:45:37.353120+0000","last_peered":"2023-06-23T18:45:37.353120+0000","last_clean":"2023-06-23T18:45:37.353120+0000","last_became_active":"2023-06-23T18:44:45.192689+0000","last_became_peered":"2023-06-23T18:44:45.192689+0000","last_unstale":"2023-06-23T18:45:37.353120+0000","last_undegraded":"2023-06-23T18:45:37.353120+0000","last_fullsized":"2023-06-23T18:45:37.353120+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T01:41:24.574488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.370010+0000","last_change":"2023-06-23T18:45:37.363613+0000","last_active":"2023-06-23T18:45:37.370010+0000","last_peered":"2023-06-23T18:45:37.370010+0000","last_clean":"2023-06-23T18:45:37.370010+0000","last_became_active":"2023-06-23T18:45:37.363335+0000","last_became_peered":"2023-06-23T18:45:37.363335+0000","last_unstale":"2023-06-23T18:45:37.370010+0000","last_undegraded":"2023-06-23T18:45:37.370010+0000","last_fullsized":"2023-06-23T18:45:37.370010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T06:19:08.629477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.346339+0000","last_change":"2023-06-23T18:45:36.938324+0000","last_active":"2023-06-23T18:45:37.346339+0000","last_peered":"2023-06-23T18:45:37.346339+0000","last_clean":"2023-06-23T18:45:37.346339+0000","last_became_active":"2023-06-23T18:45:36.937493+0000","last_became_peered":"2023-06-23T18:45:36.937493+0000","last_unstale":"2023-06-23T18:45:37.346339+0000","last_undegraded":"2023-06-23T18:45:37.346339+0000","last_fullsized":"2023-06-23T18:45:37.346339+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:03:32.100910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.350049+0000","last_change":"2023-06-23T18:44:45.577146+0000","last_active":"2023-06-23T18:45:37.350049+0000","last_peered":"2023-06-23T18:45:37.350049+0000","last_clean":"2023-06-23T18:45:37.350049+0000","last_became_active":"2023-06-23T18:44:45.576835+0000","last_became_peered":"2023-06-23T18:44:45.576835+0000","last_unstale":"2023-06-23T18:45:37.350049+0000","last_undegraded":"2023-06-23T18:45:37.350049+0000","last_fullsized":"2023-06-23T18:45:37.350049+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T03:01:47.160463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.374878+0000","last_change":"2023-06-23T18:45:37.373472+0000","last_active":"2023-06-23T18:45:37.374878+0000","last_peered":"2023-06-23T18:45:37.374878+0000","last_clean":"2023-06-23T18:45:37.374878+0000","last_became_active":"2023-06-23T18:45:37.373204+0000","last_became_peered":"2023-06-23T18:45:37.373204+0000","last_unstale":"2023-06-23T18:45:37.374878+0000","last_undegraded":"2023-06-23T18:45:37.374878+0000","last_fullsized":"2023-06-23T18:45:37.374878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T19:44:37.509204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.351523+0000","last_change":"2023-06-23T18:45:36.941721+0000","last_active":"2023-06-23T18:45:37.351523+0000","last_peered":"2023-06-23T18:45:37.351523+0000","last_clean":"2023-06-23T18:45:37.351523+0000","last_became_active":"2023-06-23T18:45:36.941456+0000","last_became_peered":"2023-06-23T18:45:36.941456+0000","last_unstale":"2023-06-23T18:45:37.351523+0000","last_undegraded":"2023-06-23T18:45:37.351523+0000","last_fullsized":"2023-06-23T18:45:37.351523+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:55:29.525403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.353085+0000","last_change":"2023-06-23T18:44:45.577304+0000","last_active":"2023-06-23T18:45:37.353085+0000","last_peered":"2023-06-23T18:45:37.353085+0000","last_clean":"2023-06-23T18:45:37.353085+0000","last_became_active":"2023-06-23T18:44:45.576846+0000","last_became_peered":"2023-06-23T18:44:45.576846+0000","last_unstale":"2023-06-23T18:45:37.353085+0000","last_undegraded":"2023-06-23T18:45:37.353085+0000","last_fullsized":"2023-06-23T18:45:37.353085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:55:10.851099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.373775+0000","last_change":"2023-06-23T18:45:37.366056+0000","last_active":"2023-06-23T18:45:37.373775+0000","last_peered":"2023-06-23T18:45:37.373775+0000","last_clean":"2023-06-23T18:45:37.373775+0000","last_became_active":"2023-06-23T18:45:37.365792+0000","last_became_peered":"2023-06-23T18:45:37.365792+0000","last_unstale":"2023-06-23T18:45:37.373775+0000","last_undegraded":"2023-06-23T18:45:37.373775+0000","last_fullsized":"2023-06-23T18:45:37.373775+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T02:21:19.322277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.350634+0000","last_change":"2023-06-23T18:45:36.936240+0000","last_active":"2023-06-23T18:45:37.350634+0000","last_peered":"2023-06-23T18:45:37.350634+0000","last_clean":"2023-06-23T18:45:37.350634+0000","last_became_active":"2023-06-23T18:45:36.935859+0000","last_became_peered":"2023-06-23T18:45:36.935859+0000","last_unstale":"2023-06-23T18:45:37.350634+0000","last_undegraded":"2023-06-23T18:45:37.350634+0000","last_fullsized":"2023-06-23T18:45:37.350634+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:04:49.025830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":35,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.346686+0000","last_change":"2023-06-23T18:44:45.577154+0000","last_active":"2023-06-23T18:45:37.346686+0000","last_peered":"2023-06-23T18:45:37.346686+0000","last_clean":"2023-06-23T18:45:37.346686+0000","last_became_active":"2023-06-23T18:44:45.576819+0000","last_became_peered":"2023-06-23T18:44:45.576819+0000","last_unstale":"2023-06-23T18:45:37.346686+0000","last_undegraded":"2023-06-23T18:45:37.346686+0000","last_fullsized":"2023-06-23T18:45:37.346686+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:57:58.659643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.366362+0000","last_change":"2023-06-23T18:45:37.363735+0000","last_active":"2023-06-23T18:45:37.366362+0000","last_peered":"2023-06-23T18:45:37.366362+0000","last_clean":"2023-06-23T18:45:37.366362+0000","last_became_active":"2023-06-23T18:45:37.363470+0000","last_became_peered":"2023-06-23T18:45:37.363470+0000","last_unstale":"2023-06-23T18:45:37.366362+0000","last_undegraded":"2023-06-23T18:45:37.366362+0000","last_fullsized":"2023-06-23T18:45:37.366362+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T23:20:21.173101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.356873+0000","last_change":"2023-06-23T18:45:36.936887+0000","last_active":"2023-06-23T18:45:37.356873+0000","last_peered":"2023-06-23T18:45:37.356873+0000","last_clean":"2023-06-23T18:45:37.356873+0000","last_became_active":"2023-06-23T18:45:36.936594+0000","last_became_peered":"2023-06-23T18:45:36.936594+0000","last_unstale":"2023-06-23T18:45:37.356873+0000","last_undegraded":"2023-06-23T18:45:37.356873+0000","last_fullsized":"2023-06-23T18:45:37.356873+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T18:58:50.387659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.355157+0000","last_change":"2023-06-23T18:44:45.577135+0000","last_active":"2023-06-23T18:45:37.355157+0000","last_peered":"2023-06-23T18:45:37.355157+0000","last_clean":"2023-06-23T18:45:37.355157+0000","last_became_active":"2023-06-23T18:44:45.576834+0000","last_became_peered":"2023-06-23T18:44:45.576834+0000","last_unstale":"2023-06-23T18:45:37.355157+0000","last_undegraded":"2023-06-23T18:45:37.355157+0000","last_fullsized":"2023-06-23T18:45:37.355157+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T05:03:57.297814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.369242+0000","last_change":"2023-06-23T18:45:37.367343+0000","last_active":"2023-06-23T18:45:37.369242+0000","last_peered":"2023-06-23T18:45:37.369242+0000","last_clean":"2023-06-23T18:45:37.369242+0000","last_became_active":"2023-06-23T18:45:37.367052+0000","last_became_peered":"2023-06-23T18:45:37.367052+0000","last_unstale":"2023-06-23T18:45:37.369242+0000","last_undegraded":"2023-06-23T18:45:37.369242+0000","last_fullsized":"2023-06-23T18:45:37.369242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:36.908632+0000","last_clean_scrub_stamp":"2023-06-23T18:45:36.908632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T21:29:34.046509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.348015+0000","last_change":"2023-06-23T18:45:36.936276+0000","last_active":"2023-06-23T18:45:37.348015+0000","last_peered":"2023-06-23T18:45:37.348015+0000","last_clean":"2023-06-23T18:45:37.348015+0000","last_became_active":"2023-06-23T18:45:36.935834+0000","last_became_peered":"2023-06-23T18:45:36.935834+0000","last_unstale":"2023-06-23T18:45:37.348015+0000","last_undegraded":"2023-06-23T18:45:37.348015+0000","last_fullsized":"2023-06-23T18:45:37.348015+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:45:35.901021+0000","last_clean_scrub_stamp":"2023-06-23T18:45:35.901021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-25T04:50:02.620619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-06-23T18:45:37.354307+0000","last_change":"2023-06-23T18:44:45.192545+0000","last_active":"2023-06-23T18:45:37.354307+0000","last_peered":"2023-06-23T18:45:37.354307+0000","last_clean":"2023-06-23T18:45:37.354307+0000","last_became_active":"2023-06-23T18:44:45.192124+0000","last_became_peered":"2023-06-23T18:44:45.192124+0000","last_unstale":"2023-06-23T18:45:37.354307+0000","last_undegraded":"2023-06-23T18:45:37.354307+0000","last_fullsized":"2023-06-23T18:45:37.354307+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-23T18:44:44.173005+0000","last_clean_scrub_stamp":"2023-06-23T18:44:44.173005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-24T20:15:25.527018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":958464,"data_stored":731703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":352256,"data_stored":140283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":929792,"data_stored":722941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":352256,"data_stored":139735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":331776,"data_stored":131612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":328,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":335872,"data_stored":132573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":323584,"data_stored":125945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":139813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-23T18:45:41.883 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-23T18:45:41.884 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-06-23T18:45:42.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.044+0000 7fb01e6ef700 1 Processor -- start 2023-06-23T18:45:42.050 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.044+0000 7fb01e6ef700 1 -- start start 2023-06-23T18:45:42.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.045+0000 7fb01e6ef700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb01814b170 0x7fb0180ba4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:42.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.045+0000 7fb01e6ef700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb0180a5bf0 0x7fb0180b8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:42.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.045+0000 7fb01e6ef700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb01814dc20 0x7fb01814e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:42.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.045+0000 7fb01e6ef700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb018069ef0 con 0x7fb01814b170 2023-06-23T18:45:42.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.045+0000 7fb01e6ef700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01806a1d0 con 0x7fb0180a5bf0 2023-06-23T18:45:42.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.045+0000 7fb01e6ef700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01806a4b0 con 0x7fb01814dc20 2023-06-23T18:45:42.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.045+0000 7fb017fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb01814b170 0x7fb0180ba4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:42.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.045+0000 7fb017fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fb01814b170 0x7fb0180ba4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40310/0 (socket says 172.21.15.52:40310) 2023-06-23T18:45:42.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.045+0000 7fb017fff700 1 -- 172.21.15.52:0/3763583359 learned_addr learned my addr 172.21.15.52:0/3763583359 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:42.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.045+0000 7fb01cc8c700 1 --2- 172.21.15.52:0/3763583359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb01814dc20 0x7fb01814e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:42.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.045+0000 7fb0177fe700 1 --2- 172.21.15.52:0/3763583359 >> v2:172.21.15.89:3300/0 conn(0x7fb0180a5bf0 0x7fb0180b8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:42.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.045+0000 7fb017fff700 1 -- 172.21.15.52:0/3763583359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb01814dc20 msgr2=0x7fb01814e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:42.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.045+0000 7fb017fff700 1 --2- 172.21.15.52:0/3763583359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb01814dc20 0x7fb01814e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:42.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.045+0000 7fb017fff700 1 -- 172.21.15.52:0/3763583359 >> v2:172.21.15.89:3300/0 conn(0x7fb0180a5bf0 msgr2=0x7fb0180b8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:42.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.045+0000 7fb017fff700 1 --2- 172.21.15.52:0/3763583359 >> v2:172.21.15.89:3300/0 conn(0x7fb0180a5bf0 0x7fb0180b8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:42.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.045+0000 7fb017fff700 1 -- 172.21.15.52:0/3763583359 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01806a790 con 0x7fb01814b170 2023-06-23T18:45:42.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.045+0000 7fb017fff700 1 --2- 172.21.15.52:0/3763583359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb01814b170 0x7fb0180ba4b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb018066c90 tx=0x7fb008009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2474d494542ab6 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:42.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.046+0000 7fb016ffd700 1 -- 172.21.15.52:0/3763583359 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb008011830 con 0x7fb01814b170 2023-06-23T18:45:42.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.046+0000 7fb016ffd700 1 -- 172.21.15.52:0/3763583359 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb008011990 con 0x7fb01814b170 2023-06-23T18:45:42.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.046+0000 7fb016ffd700 1 -- 172.21.15.52:0/3763583359 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb008011d20 con 0x7fb01814b170 2023-06-23T18:45:42.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.046+0000 7fb01e6ef700 1 -- 172.21.15.52:0/3763583359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb01814b170 msgr2=0x7fb0180ba4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:42.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.046+0000 7fb01e6ef700 1 --2- 172.21.15.52:0/3763583359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb01814b170 0x7fb0180ba4b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb018066c90 tx=0x7fb008009bd0 comp rx=0 tx=0).stop 2023-06-23T18:45:42.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.046+0000 7fb01e6ef700 1 -- 172.21.15.52:0/3763583359 shutdown_connections 2023-06-23T18:45:42.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.046+0000 7fb01e6ef700 1 --2- 172.21.15.52:0/3763583359 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb01814dc20 0x7fb01814e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:42.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.046+0000 7fb01e6ef700 1 --2- 172.21.15.52:0/3763583359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb01814b170 0x7fb0180ba4b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:42.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.046+0000 7fb01e6ef700 1 --2- 172.21.15.52:0/3763583359 >> v2:172.21.15.89:3300/0 conn(0x7fb0180a5bf0 0x7fb0180b8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:42.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.046+0000 7fb01e6ef700 1 -- 172.21.15.52:0/3763583359 >> 172.21.15.52:0/3763583359 conn(0x7fb0180c06f0 msgr2=0x7fb0180c0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:42.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.046+0000 7fb01e6ef700 1 -- 172.21.15.52:0/3763583359 shutdown_connections 2023-06-23T18:45:42.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.046+0000 7fb01e6ef700 1 -- 172.21.15.52:0/3763583359 wait complete. 2023-06-23T18:45:42.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.047+0000 7fb01e6ef700 1 Processor -- start 2023-06-23T18:45:42.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.048+0000 7fb01e6ef700 1 -- start start 2023-06-23T18:45:42.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.048+0000 7fb01e6ef700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0180a5bf0 0x7fb0180b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:42.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.048+0000 7fb01e6ef700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb01814b170 0x7fb018146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:42.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.048+0000 7fb01e6ef700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb01814dc20 0x7fb018147190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:42.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.048+0000 7fb01e6ef700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0181e0600 con 0x7fb0180a5bf0 2023-06-23T18:45:42.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.048+0000 7fb01e6ef700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0181476d0 con 0x7fb01814dc20 2023-06-23T18:45:42.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.048+0000 7fb01e6ef700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0181dfcf0 con 0x7fb01814b170 2023-06-23T18:45:42.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.048+0000 7fb017fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0180a5bf0 0x7fb0180b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:42.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.048+0000 7fb017fff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0180a5bf0 0x7fb0180b4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40326/0 (socket says 172.21.15.52:40326) 2023-06-23T18:45:42.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.048+0000 7fb017fff700 1 -- 172.21.15.52:0/1208258311 learned_addr learned my addr 172.21.15.52:0/1208258311 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:42.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.048+0000 7fb0177fe700 1 --2- 172.21.15.52:0/1208258311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb01814b170 0x7fb018146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:42.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.048+0000 7fb01cc8c700 1 --2- 172.21.15.52:0/1208258311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb01814dc20 0x7fb018147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:42.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.049+0000 7fb017fff700 1 -- 172.21.15.52:0/1208258311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb01814b170 msgr2=0x7fb018146c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:42.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.049+0000 7fb017fff700 1 --2- 172.21.15.52:0/1208258311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb01814b170 0x7fb018146c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:42.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.049+0000 7fb017fff700 1 -- 172.21.15.52:0/1208258311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb01814dc20 msgr2=0x7fb018147190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:42.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.049+0000 7fb017fff700 1 --2- 172.21.15.52:0/1208258311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb01814dc20 0x7fb018147190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:42.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.049+0000 7fb017fff700 1 -- 172.21.15.52:0/1208258311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb008009550 con 0x7fb0180a5bf0 2023-06-23T18:45:42.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.049+0000 7fb017fff700 1 --2- 172.21.15.52:0/1208258311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0180a5bf0 0x7fb0180b4790 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb008000c00 tx=0x7fb008004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:42.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.049+0000 7fb014ff9700 1 -- 172.21.15.52:0/1208258311 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb008004240 con 0x7fb0180a5bf0 2023-06-23T18:45:42.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.049+0000 7fb014ff9700 1 -- 172.21.15.52:0/1208258311 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00801f070 con 0x7fb0180a5bf0 2023-06-23T18:45:42.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.049+0000 7fb01e6ef700 1 -- 172.21.15.52:0/1208258311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0181dff40 con 0x7fb0180a5bf0 2023-06-23T18:45:42.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.049+0000 7fb014ff9700 1 -- 172.21.15.52:0/1208258311 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0080036a0 con 0x7fb0180a5bf0 2023-06-23T18:45:42.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.049+0000 7fb01e6ef700 1 -- 172.21.15.52:0/1208258311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb018145740 con 0x7fb0180a5bf0 2023-06-23T18:45:42.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.050+0000 7fb01e6ef700 1 -- 172.21.15.52:0/1208258311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01804e1d0 con 0x7fb0180a5bf0 2023-06-23T18:45:42.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.050+0000 7fb014ff9700 1 -- 172.21.15.52:0/1208258311 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb008021030 con 0x7fb0180a5bf0 2023-06-23T18:45:42.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.051+0000 7fb014ff9700 1 --2- 172.21.15.52:0/1208258311 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7faff806ace0 0x7faff806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:42.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.051+0000 7fb014ff9700 1 -- 172.21.15.52:0/1208258311 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb00808a610 con 0x7fb0180a5bf0 2023-06-23T18:45:42.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.051+0000 7fb0177fe700 1 --2- 172.21.15.52:0/1208258311 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7faff806ace0 0x7faff806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:42.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.052+0000 7fb0177fe700 1 --2- 172.21.15.52:0/1208258311 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7faff806ace0 0x7faff806d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb0181d5020 tx=0x7fb000009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:42.062 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.056+0000 7fb014ff9700 1 -- 172.21.15.52:0/1208258311 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb0080556b0 con 0x7fb0180a5bf0 2023-06-23T18:45:42.342 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.337+0000 7fb01e6ef700 1 -- 172.21.15.52:0/1208258311 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb0181d5050 con 0x7fb0180a5bf0 2023-06-23T18:45:42.346 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.341+0000 7fb014ff9700 1 -- 172.21.15.52:0/1208258311 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7fb008058cd0 con 0x7fb0180a5bf0 2023-06-23T18:45:42.346 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2023-06-23T18:45:42.347 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDx55Vkbva3CRAABdlhryMtWjf5jsU2sSwuwg== 2023-06-23T18:45:42.347 INFO:teuthology.orchestra.run.smithi052.stdout: caps mds = "allow" 2023-06-23T18:45:42.347 INFO:teuthology.orchestra.run.smithi052.stdout: caps mon = "allow r" 2023-06-23T18:45:42.347 INFO:teuthology.orchestra.run.smithi052.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-06-23T18:45:42.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.343+0000 7fb01e6ef700 1 -- 172.21.15.52:0/1208258311 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7faff806ace0 msgr2=0x7faff806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:42.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.343+0000 7fb01e6ef700 1 --2- 172.21.15.52:0/1208258311 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7faff806ace0 0x7faff806d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb0181d5020 tx=0x7fb000009210 comp rx=0 tx=0).stop 2023-06-23T18:45:42.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.343+0000 7fb01e6ef700 1 -- 172.21.15.52:0/1208258311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0180a5bf0 msgr2=0x7fb0180b4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:42.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.343+0000 7fb01e6ef700 1 --2- 172.21.15.52:0/1208258311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0180a5bf0 0x7fb0180b4790 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb008000c00 tx=0x7fb008004750 comp rx=0 tx=0).stop 2023-06-23T18:45:42.349 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.343+0000 7fb01e6ef700 1 -- 172.21.15.52:0/1208258311 shutdown_connections 2023-06-23T18:45:42.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.343+0000 7fb01e6ef700 1 --2- 172.21.15.52:0/1208258311 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7faff806ace0 0x7faff806d190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:42.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.343+0000 7fb01e6ef700 1 --2- 172.21.15.52:0/1208258311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb01814dc20 0x7fb018147190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:42.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.343+0000 7fb01e6ef700 1 --2- 172.21.15.52:0/1208258311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0180a5bf0 0x7fb0180b4790 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:42.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.343+0000 7fb01e6ef700 1 --2- 172.21.15.52:0/1208258311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb01814b170 0x7fb018146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:42.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.343+0000 7fb01e6ef700 1 -- 172.21.15.52:0/1208258311 >> 172.21.15.52:0/1208258311 conn(0x7fb0180c06f0 msgr2=0x7fb018149520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:42.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.343+0000 7fb01e6ef700 1 -- 172.21.15.52:0/1208258311 shutdown_connections 2023-06-23T18:45:42.350 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.343+0000 7fb01e6ef700 1 -- 172.21.15.52:0/1208258311 wait complete. 2023-06-23T18:45:42.351 INFO:teuthology.orchestra.run.smithi052.stderr:updated caps for client.0 2023-06-23T18:45:42.361 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T18:45:42.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.480+0000 7f952fe4e700 1 Processor -- start 2023-06-23T18:45:42.486 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.481+0000 7f952fe4e700 1 -- start start 2023-06-23T18:45:42.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.481+0000 7f952fe4e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9528148b90 0x7f9528153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:42.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.481+0000 7f952fe4e700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95280b53b0 con 0x7f95280b8c70 2023-06-23T18:45:42.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.481+0000 7f952fe4e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95280722f0 con 0x7f95281426a0 2023-06-23T18:45:42.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.481+0000 7f952fe4e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95280b4750 con 0x7f9528148b90 2023-06-23T18:45:42.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.481+0000 7f952d3e9700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f95280b8c70 0x7f9528148480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51780/0 (socket says 172.21.15.52:51780) 2023-06-23T18:45:42.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.481+0000 7f952d3e9700 1 -- 172.21.15.52:0/921366022 learned_addr learned my addr 172.21.15.52:0/921366022 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:42.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.481+0000 7f952e3eb700 1 --2- 172.21.15.52:0/921366022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9528148b90 0x7f9528153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:42.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.482+0000 7f952cbe8700 1 -- 172.21.15.52:0/921366022 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40369410 0 0) 0x7f95280b53b0 con 0x7f95280b8c70 2023-06-23T18:45:42.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.482+0000 7f952cbe8700 1 -- 172.21.15.52:0/921366022 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95140035b0 con 0x7f95280b8c70 2023-06-23T18:45:42.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.482+0000 7f952cbe8700 1 -- 172.21.15.52:0/921366022 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2549401306 0 0) 0x7f95280722f0 con 0x7f95281426a0 2023-06-23T18:45:42.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.482+0000 7f952cbe8700 1 -- 172.21.15.52:0/921366022 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95280b53b0 con 0x7f95281426a0 2023-06-23T18:45:42.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.482+0000 7f952e3eb700 1 -- 172.21.15.52:0/921366022 >> v1:172.21.15.89:6789/0 conn(0x7f95281426a0 legacy=0x7f9528071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:42.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.482+0000 7f952e3eb700 1 -- 172.21.15.52:0/921366022 >> v1:172.21.15.52:6789/0 conn(0x7f95280b8c70 legacy=0x7f9528148480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:42.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.482+0000 7f952e3eb700 1 -- 172.21.15.52:0/921366022 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9528142a70 con 0x7f9528148b90 2023-06-23T18:45:42.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.482+0000 7f952e3eb700 1 --2- 172.21.15.52:0/921366022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9528148b90 0x7f9528153bc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9520009dc0 tx=0x7f952000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a55856a17fe065fa server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:42.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.482+0000 7f952cbe8700 1 -- 172.21.15.52:0/921366022 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952000e070 con 0x7f9528148b90 2023-06-23T18:45:42.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.482+0000 7f952cbe8700 1 -- 172.21.15.52:0/921366022 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952000bb20 con 0x7f9528148b90 2023-06-23T18:45:42.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.482+0000 7f952cbe8700 1 -- 172.21.15.52:0/921366022 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520012430 con 0x7f9528148b90 2023-06-23T18:45:42.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.483+0000 7f952fe4e700 1 -- 172.21.15.52:0/921366022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9528148b90 msgr2=0x7f9528153bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:42.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.483+0000 7f952fe4e700 1 --2- 172.21.15.52:0/921366022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9528148b90 0x7f9528153bc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9520009dc0 tx=0x7f952000b330 comp rx=0 tx=0).stop 2023-06-23T18:45:42.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.483+0000 7f952fe4e700 1 -- 172.21.15.52:0/921366022 shutdown_connections 2023-06-23T18:45:42.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.483+0000 7f952fe4e700 1 --2- 172.21.15.52:0/921366022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9528148b90 0x7f9528153bc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:42.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.483+0000 7f952fe4e700 1 -- 172.21.15.52:0/921366022 >> 172.21.15.52:0/921366022 conn(0x7f95280bd690 msgr2=0x7f95280b9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:42.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.483+0000 7f952fe4e700 1 -- 172.21.15.52:0/921366022 shutdown_connections 2023-06-23T18:45:42.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.483+0000 7f952fe4e700 1 -- 172.21.15.52:0/921366022 wait complete. 2023-06-23T18:45:42.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.484+0000 7f952fe4e700 1 Processor -- start 2023-06-23T18:45:42.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.484+0000 7f952fe4e700 1 -- start start 2023-06-23T18:45:42.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.485+0000 7f952fe4e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95280b8c70 0x7f9528146d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:42.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.485+0000 7f952fe4e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95281426a0 0x7f9528143e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:42.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.485+0000 7f952fe4e700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9528148b90 0x7f9528144bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:42.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.485+0000 7f952fe4e700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95281432b0 con 0x7f9528148b90 2023-06-23T18:45:42.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.485+0000 7f952fe4e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9528147280 con 0x7f95281426a0 2023-06-23T18:45:42.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.485+0000 7f952fe4e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95281436d0 con 0x7f95280b8c70 2023-06-23T18:45:42.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.485+0000 7f952e3eb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9528148b90 0x7f9528144bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:42.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.485+0000 7f952e3eb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9528148b90 0x7f9528144bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40340/0 (socket says 172.21.15.52:40340) 2023-06-23T18:45:42.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.485+0000 7f952e3eb700 1 -- 172.21.15.52:0/3269637798 learned_addr learned my addr 172.21.15.52:0/3269637798 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:42.494 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.485+0000 7f952d3e9700 1 --2- 172.21.15.52:0/3269637798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95281426a0 0x7f9528143e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:42.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.485+0000 7f952dbea700 1 --2- 172.21.15.52:0/3269637798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95280b8c70 0x7f9528146d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:42.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.485+0000 7f952e3eb700 1 -- 172.21.15.52:0/3269637798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95280b8c70 msgr2=0x7f9528146d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:42.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.485+0000 7f952e3eb700 1 --2- 172.21.15.52:0/3269637798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95280b8c70 0x7f9528146d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:42.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.485+0000 7f952e3eb700 1 -- 172.21.15.52:0/3269637798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95281426a0 msgr2=0x7f9528143e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:42.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.485+0000 7f952e3eb700 1 --2- 172.21.15.52:0/3269637798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95281426a0 0x7f9528143e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:42.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.485+0000 7f952e3eb700 1 -- 172.21.15.52:0/3269637798 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9520009a70 con 0x7f9528148b90 2023-06-23T18:45:42.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.485+0000 7f952dbea700 1 --2- 172.21.15.52:0/3269637798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95280b8c70 0x7f9528146d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:45:42.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.485+0000 7f952e3eb700 1 --2- 172.21.15.52:0/3269637798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9528148b90 0x7f9528144bc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9520014040 tx=0x7f9520004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:42.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.485+0000 7f951e7fc700 1 -- 172.21.15.52:0/3269637798 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952001c810 con 0x7f9528148b90 2023-06-23T18:45:42.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.485+0000 7f951e7fc700 1 -- 172.21.15.52:0/3269637798 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9520020070 con 0x7f9528148b90 2023-06-23T18:45:42.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.485+0000 7f952fe4e700 1 -- 172.21.15.52:0/3269637798 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9528142c80 con 0x7f9528148b90 2023-06-23T18:45:42.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.485+0000 7f951e7fc700 1 -- 172.21.15.52:0/3269637798 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952001cbf0 con 0x7f9528148b90 2023-06-23T18:45:42.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.485+0000 7f952fe4e700 1 -- 172.21.15.52:0/3269637798 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9528147c90 con 0x7f9528148b90 2023-06-23T18:45:42.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.486+0000 7f952fe4e700 1 -- 172.21.15.52:0/3269637798 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95281433f0 con 0x7f9528148b90 2023-06-23T18:45:42.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.487+0000 7f951e7fc700 1 -- 172.21.15.52:0/3269637798 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f952001cd50 con 0x7f9528148b90 2023-06-23T18:45:42.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.487+0000 7f951e7fc700 1 --2- 172.21.15.52:0/3269637798 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f950c06ace0 0x7f950c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:42.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.487+0000 7f951e7fc700 1 -- 172.21.15.52:0/3269637798 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9520022070 con 0x7f9528148b90 2023-06-23T18:45:42.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.487+0000 7f952dbea700 1 --2- 172.21.15.52:0/3269637798 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f950c06ace0 0x7f950c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:42.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.488+0000 7f952dbea700 1 --2- 172.21.15.52:0/3269637798 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f950c06ace0 0x7f950c06d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f95240011e0 tx=0x7f9524009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:42.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.492+0000 7f951e7fc700 1 -- 172.21.15.52:0/3269637798 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f95281433f0 con 0x7f9528148b90 2023-06-23T18:45:42.739 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.734+0000 7f952fe4e700 1 -- 172.21.15.52:0/3269637798 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95281433f0 con 0x7f9528148b90 2023-06-23T18:45:42.740 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.734+0000 7f951e7fc700 1 -- 172.21.15.52:0/3269637798 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+3914 (secure 0 0 0) 0x7f95281433f0 con 0x7f9528148b90 2023-06-23T18:45:42.740 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:45:42.740 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/2419745169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2419745169},{"type":"v1","addr":"172.21.15.89:6835","nonce":2419745169}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4846,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6834/1941545390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":1941545390},{"type":"v1","addr":"172.21.15.52:6834","nonce":1941545390}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-23T18:45:37.342046+0000","modified":"2023-06-23T18:45:40.353120+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4849},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4849":{"gid":4849,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6835/2041592035","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6833","nonce":2041592035},{"type":"v1","addr":"172.21.15.52:6835","nonce":2041592035}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-23T18:45:42.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.736+0000 7f952fe4e700 1 -- 172.21.15.52:0/3269637798 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f950c06ace0 msgr2=0x7f950c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:42.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.736+0000 7f952fe4e700 1 --2- 172.21.15.52:0/3269637798 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f950c06ace0 0x7f950c06d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f95240011e0 tx=0x7f9524009040 comp rx=0 tx=0).stop 2023-06-23T18:45:42.742 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.736+0000 7f952fe4e700 1 -- 172.21.15.52:0/3269637798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9528148b90 msgr2=0x7f9528144bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:42.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.736+0000 7f952fe4e700 1 --2- 172.21.15.52:0/3269637798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9528148b90 0x7f9528144bc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9520014040 tx=0x7f9520004ad0 comp rx=0 tx=0).stop 2023-06-23T18:45:42.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.736+0000 7f952fe4e700 1 -- 172.21.15.52:0/3269637798 shutdown_connections 2023-06-23T18:45:42.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.736+0000 7f952fe4e700 1 --2- 172.21.15.52:0/3269637798 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f950c06ace0 0x7f950c06d190 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:42.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.736+0000 7f952fe4e700 1 --2- 172.21.15.52:0/3269637798 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9528148b90 0x7f9528144bc0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:42.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.736+0000 7f952fe4e700 1 --2- 172.21.15.52:0/3269637798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f95280b8c70 0x7f9528146d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:42.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.736+0000 7f952fe4e700 1 --2- 172.21.15.52:0/3269637798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95281426a0 0x7f9528143e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:42.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.736+0000 7f952fe4e700 1 -- 172.21.15.52:0/3269637798 >> 172.21.15.52:0/3269637798 conn(0x7f95280bd690 msgr2=0x7f9528065b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:42.743 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.736+0000 7f952fe4e700 1 -- 172.21.15.52:0/3269637798 shutdown_connections 2023-06-23T18:45:42.744 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:42.736+0000 7f952fe4e700 1 -- 172.21.15.52:0/3269637798 wait complete. 2023-06-23T18:45:42.744 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 16 2023-06-23T18:45:43.056 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-23T18:45:37.342046+0000', 'modified': '2023-06-23T18:45:40.353120+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4849}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4849': {'gid': 4849, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.52:6835/2041592035', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6833', 'nonce': 2041592035}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 2041592035}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-23T18:45:43.057 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-23T18:45:43.057 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-06-23T18:45:43.186 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.181+0000 7f03d236d700 1 Processor -- start 2023-06-23T18:45:43.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.181+0000 7f03d236d700 1 -- start start 2023-06-23T18:45:43.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.182+0000 7f03d236d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f03cc1446e0 0x7f03cc06fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.187 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.182+0000 7f03d236d700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03cc0b67d0 con 0x7f03cc0b6c60 2023-06-23T18:45:43.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.182+0000 7f03d236d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03cc06b610 con 0x7f03cc0b8fe0 2023-06-23T18:45:43.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.182+0000 7f03d236d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03cc0723d0 con 0x7f03cc1446e0 2023-06-23T18:45:43.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.182+0000 7f03cb7fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f03cc0b6c60 0x7f03cc06af00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51792/0 (socket says 172.21.15.52:51792) 2023-06-23T18:45:43.188 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.182+0000 7f03cb7fe700 1 -- 172.21.15.52:0/1168624217 learned_addr learned my addr 172.21.15.52:0/1168624217 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:43.191 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.182+0000 7f03caffd700 1 -- 172.21.15.52:0/1168624217 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929575308 0 0) 0x7f03cc0b67d0 con 0x7f03cc0b6c60 2023-06-23T18:45:43.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.182+0000 7f03cbfff700 1 --2- 172.21.15.52:0/1168624217 >> v2:172.21.15.89:3300/0 conn(0x7f03cc1446e0 0x7f03cc06fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.182+0000 7f03caffd700 1 -- 172.21.15.52:0/1168624217 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03b40035b0 con 0x7f03cc0b6c60 2023-06-23T18:45:43.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.182+0000 7f03caffd700 1 -- 172.21.15.52:0/1168624217 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 677881601 0 0) 0x7f03b40035b0 con 0x7f03cc0b6c60 2023-06-23T18:45:43.192 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.182+0000 7f03caffd700 1 -- 172.21.15.52:0/1168624217 >> v2:172.21.15.89:3300/0 conn(0x7f03cc1446e0 msgr2=0x7f03cc06fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:43.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.182+0000 7f03caffd700 1 --2- 172.21.15.52:0/1168624217 >> v2:172.21.15.89:3300/0 conn(0x7f03cc1446e0 0x7f03cc06fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.182+0000 7f03caffd700 1 -- 172.21.15.52:0/1168624217 >> v1:172.21.15.89:6789/0 conn(0x7f03cc0b8fe0 legacy=0x7f03cc154d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:43.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.182+0000 7f03caffd700 1 -- 172.21.15.52:0/1168624217 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc0720f0 con 0x7f03cc0b6c60 2023-06-23T18:45:43.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.182+0000 7f03caffd700 1 -- 172.21.15.52:0/1168624217 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7f03c0001670 con 0x7f03cc0b6c60 2023-06-23T18:45:43.193 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.182+0000 7f03caffd700 1 -- 172.21.15.52:0/1168624217 >> v1:172.21.15.52:6789/0 conn(0x7f03cc0b6c60 legacy=0x7f03cc06af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:43.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.182+0000 7f03caffd700 1 --2- 172.21.15.52:0/1168624217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03b4003a50 0x7f03b4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.182+0000 7f03caffd700 1 --2- 172.21.15.52:0/1168624217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03b4004850 0x7f03b4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.183+0000 7f03caffd700 1 --2- 172.21.15.52:0/1168624217 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03b4005200 0x7f03b400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.194 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.183+0000 7f03caffd700 1 -- 172.21.15.52:0/1168624217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc0723d0 con 0x7f03b4004850 2023-06-23T18:45:43.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.183+0000 7f03caffd700 1 -- 172.21.15.52:0/1168624217 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b400c0c0 con 0x7f03b4005200 2023-06-23T18:45:43.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.183+0000 7f03caffd700 1 -- 172.21.15.52:0/1168624217 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b400c280 con 0x7f03b4003a50 2023-06-23T18:45:43.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.183+0000 7f03cb7fe700 1 --2- 172.21.15.52:0/1168624217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03b4004850 0x7f03b4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.183+0000 7f03d090a700 1 --2- 172.21.15.52:0/1168624217 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03b4005200 0x7f03b400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.195 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.183+0000 7f03cbfff700 1 --2- 172.21.15.52:0/1168624217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03b4003a50 0x7f03b4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.183+0000 7f03cb7fe700 1 -- 172.21.15.52:0/1168624217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03b4003a50 msgr2=0x7f03b4003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:43.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.183+0000 7f03cb7fe700 1 --2- 172.21.15.52:0/1168624217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03b4003a50 0x7f03b4003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.183+0000 7f03cb7fe700 1 -- 172.21.15.52:0/1168624217 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03b4005200 msgr2=0x7f03b400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:43.196 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.183+0000 7f03cb7fe700 1 --2- 172.21.15.52:0/1168624217 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03b4005200 0x7f03b400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.183+0000 7f03d090a700 1 -- 172.21.15.52:0/1168624217 reap_dead start 2023-06-23T18:45:43.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.183+0000 7f03cb7fe700 1 -- 172.21.15.52:0/1168624217 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b40035b0 con 0x7f03b4004850 2023-06-23T18:45:43.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.183+0000 7f03cb7fe700 1 --2- 172.21.15.52:0/1168624217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03b4004850 0x7f03b4004cc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f03c000c160 tx=0x7f03b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb7bd6069053fee1 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:43.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.183+0000 7f03caffd700 1 -- 172.21.15.52:0/1168624217 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c0007b70 con 0x7f03b4004850 2023-06-23T18:45:43.197 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.183+0000 7f03caffd700 1 -- 172.21.15.52:0/1168624217 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c000cd00 con 0x7f03b4004850 2023-06-23T18:45:43.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.183+0000 7f03caffd700 1 -- 172.21.15.52:0/1168624217 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c0005ba0 con 0x7f03b4004850 2023-06-23T18:45:43.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.184+0000 7f03d236d700 1 -- 172.21.15.52:0/1168624217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03b4004850 msgr2=0x7f03b4004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:43.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.184+0000 7f03d236d700 1 --2- 172.21.15.52:0/1168624217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03b4004850 0x7f03b4004cc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f03c000c160 tx=0x7f03b4005880 comp rx=0 tx=0).stop 2023-06-23T18:45:43.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.184+0000 7f03d236d700 1 -- 172.21.15.52:0/1168624217 shutdown_connections 2023-06-23T18:45:43.198 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.184+0000 7f03d236d700 1 --2- 172.21.15.52:0/1168624217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03b4004850 0x7f03b4004cc0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.184+0000 7f03d236d700 1 -- 172.21.15.52:0/1168624217 >> 172.21.15.52:0/1168624217 conn(0x7f03cc0bd690 msgr2=0x7f03cc0b9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:43.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.184+0000 7f03d236d700 1 -- 172.21.15.52:0/1168624217 shutdown_connections 2023-06-23T18:45:43.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.184+0000 7f03d236d700 1 -- 172.21.15.52:0/1168624217 wait complete. 2023-06-23T18:45:43.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.185+0000 7f03d236d700 1 Processor -- start 2023-06-23T18:45:43.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.186+0000 7f03d236d700 1 -- start start 2023-06-23T18:45:43.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.186+0000 7f03d236d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03b4004850 0x7f03cc14e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.186+0000 7f03d236d700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03cc14c120 0x7f03cc0b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.186+0000 7f03d236d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03cc13e380 0x7f03cc13e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.186+0000 7f03d236d700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc0b5500 con 0x7f03cc14c120 2023-06-23T18:45:43.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.186+0000 7f03d236d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc14cdc0 con 0x7f03b4004850 2023-06-23T18:45:43.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.186+0000 7f03d236d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc13fa70 con 0x7f03cc13e380 2023-06-23T18:45:43.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.186+0000 7f03cb7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03cc14c120 0x7f03cc0b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.186+0000 7f03cb7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03cc14c120 0x7f03cc0b4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40362/0 (socket says 172.21.15.52:40362) 2023-06-23T18:45:43.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.186+0000 7f03cb7fe700 1 -- 172.21.15.52:0/3173060626 learned_addr learned my addr 172.21.15.52:0/3173060626 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:43.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.187+0000 7f03cbfff700 1 --2- 172.21.15.52:0/3173060626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03b4004850 0x7f03cc14e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.187+0000 7f03d090a700 1 --2- 172.21.15.52:0/3173060626 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03cc13e380 0x7f03cc13e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.187+0000 7f03cb7fe700 1 -- 172.21.15.52:0/3173060626 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03cc13e380 msgr2=0x7f03cc13e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:43.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.187+0000 7f03cb7fe700 1 --2- 172.21.15.52:0/3173060626 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03cc13e380 0x7f03cc13e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.187+0000 7f03cb7fe700 1 -- 172.21.15.52:0/3173060626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03b4004850 msgr2=0x7f03cc14e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:43.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.187+0000 7f03cb7fe700 1 --2- 172.21.15.52:0/3173060626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03b4004850 0x7f03cc14e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.187+0000 7f03cb7fe700 1 -- 172.21.15.52:0/3173060626 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc14c550 con 0x7f03cc14c120 2023-06-23T18:45:43.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.187+0000 7f03cbfff700 1 --2- 172.21.15.52:0/3173060626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03b4004850 0x7f03cc14e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:45:43.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.187+0000 7f03cb7fe700 1 --2- 172.21.15.52:0/3173060626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03cc14c120 0x7f03cc0b4fc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f03b400c090 tx=0x7f03c0001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:43.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.187+0000 7f03c8ff9700 1 -- 172.21.15.52:0/3173060626 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c00070d0 con 0x7f03cc14c120 2023-06-23T18:45:43.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.187+0000 7f03c8ff9700 1 -- 172.21.15.52:0/3173060626 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c0007270 con 0x7f03cc14c120 2023-06-23T18:45:43.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.187+0000 7f03d236d700 1 -- 172.21.15.52:0/3173060626 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03cc14de40 con 0x7f03cc14c120 2023-06-23T18:45:43.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.187+0000 7f03c8ff9700 1 -- 172.21.15.52:0/3173060626 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c0007620 con 0x7f03cc14c120 2023-06-23T18:45:43.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.187+0000 7f03d236d700 1 -- 172.21.15.52:0/3173060626 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03cc13fcc0 con 0x7f03cc14c120 2023-06-23T18:45:43.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.188+0000 7f03c8ff9700 1 -- 172.21.15.52:0/3173060626 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f03c001e430 con 0x7f03cc14c120 2023-06-23T18:45:43.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.189+0000 7f03c8ff9700 1 --2- 172.21.15.52:0/3173060626 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f03b806ad10 0x7f03b806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.189+0000 7f03c8ff9700 1 -- 172.21.15.52:0/3173060626 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f03c008a760 con 0x7f03cc14c120 2023-06-23T18:45:43.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.189+0000 7f03cbfff700 1 --2- 172.21.15.52:0/3173060626 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f03b806ad10 0x7f03b806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.189+0000 7f03cbfff700 1 --2- 172.21.15.52:0/3173060626 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f03b806ad10 0x7f03b806d1c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f03bc009bd0 tx=0x7f03bc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:43.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.191+0000 7f03de508b80 1 Processor -- start 2023-06-23T18:45:43.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.191+0000 7f03de508b80 1 -- start start 2023-06-23T18:45:43.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.192+0000 7f03de508b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55fa4e8d2110 0x55fa4e8ffc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.192+0000 7f03de508b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fa4e904830 0x55fa4e900190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.192+0000 7f03de508b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8cde60 0x55fa4e8ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.192+0000 7f03de508b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa4e848ea0 con 0x55fa4e8cde60 2023-06-23T18:45:43.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.192+0000 7f03de508b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa4e7bc600 con 0x55fa4e904830 2023-06-23T18:45:43.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.192+0000 7f03de508b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa4e82b910 con 0x55fa4e8d2110 2023-06-23T18:45:43.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.192+0000 7f03d090a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8cde60 0x55fa4e8ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.192+0000 7f03cbfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55fa4e8d2110 0x55fa4e8ffc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.192+0000 7f03d090a700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8cde60 0x55fa4e8ce2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40364/0 (socket says 172.21.15.52:40364) 2023-06-23T18:45:43.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.192+0000 7f03cb7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fa4e904830 0x55fa4e900190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.192+0000 7f03d090a700 1 -- 172.21.15.52:0/4239634912 learned_addr learned my addr 172.21.15.52:0/4239634912 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:43.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.192+0000 7f03d090a700 1 -- 172.21.15.52:0/4239634912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55fa4e8d2110 msgr2=0x55fa4e8ffc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:43.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.192+0000 7f03d090a700 1 --2- 172.21.15.52:0/4239634912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55fa4e8d2110 0x55fa4e8ffc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.192+0000 7f03d090a700 1 -- 172.21.15.52:0/4239634912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fa4e904830 msgr2=0x55fa4e900190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:43.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.192+0000 7f03d090a700 1 --2- 172.21.15.52:0/4239634912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fa4e904830 0x55fa4e900190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.192+0000 7f03d090a700 1 -- 172.21.15.52:0/4239634912 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa4e618790 con 0x55fa4e8cde60 2023-06-23T18:45:43.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.192+0000 7f03d090a700 1 --2- 172.21.15.52:0/4239634912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8cde60 0x55fa4e8ce2d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f03cc06c940 tx=0x7f03c4001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f1915ec33857f7 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:43.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.192+0000 7f03b1ffb700 1 -- 172.21.15.52:0/4239634912 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c40050c0 con 0x55fa4e8cde60 2023-06-23T18:45:43.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.192+0000 7f03b1ffb700 1 -- 172.21.15.52:0/4239634912 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c4005220 con 0x55fa4e8cde60 2023-06-23T18:45:43.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.192+0000 7f03b1ffb700 1 -- 172.21.15.52:0/4239634912 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c4005590 con 0x55fa4e8cde60 2023-06-23T18:45:43.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.193+0000 7f03de508b80 1 -- 172.21.15.52:0/4239634912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8cde60 msgr2=0x55fa4e8ce2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:43.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.193+0000 7f03de508b80 1 --2- 172.21.15.52:0/4239634912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8cde60 0x55fa4e8ce2d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f03cc06c940 tx=0x7f03c4001af0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.193+0000 7f03de508b80 1 -- 172.21.15.52:0/4239634912 shutdown_connections 2023-06-23T18:45:43.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.193+0000 7f03de508b80 1 --2- 172.21.15.52:0/4239634912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8cde60 0x55fa4e8ce2d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.193+0000 7f03de508b80 1 --2- 172.21.15.52:0/4239634912 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55fa4e8d2110 0x55fa4e8ffc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.193+0000 7f03de508b80 1 --2- 172.21.15.52:0/4239634912 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fa4e904830 0x55fa4e900190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.193+0000 7f03de508b80 1 -- 172.21.15.52:0/4239634912 >> 172.21.15.52:0/4239634912 conn(0x55fa4e8c8c90 msgr2=0x55fa4e8d2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:43.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.193+0000 7f03de508b80 1 -- 172.21.15.52:0/4239634912 shutdown_connections 2023-06-23T18:45:43.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.193+0000 7f03de508b80 1 -- 172.21.15.52:0/4239634912 wait complete. 2023-06-23T18:45:43.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.194+0000 7f03de508b80 1 -- start start 2023-06-23T18:45:43.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.194+0000 7f03de508b80 1 Processor -- start 2023-06-23T18:45:43.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.194+0000 7f03de508b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8cde60 0x55fa4e919af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.194+0000 7f03de508b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fa4e8d2110 0x55fa4e918fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.194+0000 7f03de508b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55fa4e904830 0x55fa4e902ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.195+0000 7f03de508b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa4e824be0 con 0x55fa4e8cde60 2023-06-23T18:45:43.216 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.195+0000 7f03de508b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa4e7e25b0 con 0x55fa4e8d2110 2023-06-23T18:45:43.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.195+0000 7f03de508b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa4e7c8910 con 0x55fa4e904830 2023-06-23T18:45:43.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.195+0000 7f03cbfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8cde60 0x55fa4e919af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.195+0000 7f03de508b80 10 client.0 _ll_register_callbacks cb 0x55fa4e7e0b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-23T18:45:43.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.195+0000 7f03cbfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8cde60 0x55fa4e919af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40368/0 (socket says 172.21.15.52:40368) 2023-06-23T18:45:43.217 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.195+0000 7f03cbfff700 1 -- 172.21.15.52:0/2871167406 learned_addr learned my addr 172.21.15.52:0/2871167406 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:43.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.195+0000 7f03cb7fe700 1 --2- 172.21.15.52:0/2871167406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fa4e8d2110 0x55fa4e918fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.195+0000 7f03d090a700 1 --2- 172.21.15.52:0/2871167406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55fa4e904830 0x55fa4e902ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.218 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.195+0000 7f03cbfff700 1 -- 172.21.15.52:0/2871167406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55fa4e904830 msgr2=0x55fa4e902ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:43.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.195+0000 7f03cbfff700 1 --2- 172.21.15.52:0/2871167406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55fa4e904830 0x55fa4e902ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.195+0000 7f03cbfff700 1 -- 172.21.15.52:0/2871167406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fa4e8d2110 msgr2=0x55fa4e918fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:43.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.195+0000 7f03cbfff700 1 --2- 172.21.15.52:0/2871167406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fa4e8d2110 0x55fa4e918fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.195+0000 7f03cbfff700 1 -- 172.21.15.52:0/2871167406 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c400f040 con 0x55fa4e8cde60 2023-06-23T18:45:43.219 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.195+0000 7f03cbfff700 1 --2- 172.21.15.52:0/2871167406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8cde60 0x55fa4e919af0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f03bc013c00 tx=0x7f03bc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a4efccc0670243 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:43.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.195+0000 7f03aaffd700 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-06-23T18:45:43.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.195+0000 7f03aaffd700 1 -- 172.21.15.52:0/2871167406 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc003cc0 con 0x55fa4e8cde60 2023-06-23T18:45:43.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.195+0000 7f03aaffd700 1 -- 172.21.15.52:0/2871167406 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f03bc020040 con 0x55fa4e8cde60 2023-06-23T18:45:43.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.195+0000 7f03de508b80 1 -- 172.21.15.52:0/2871167406 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa4e8c62a0 con 0x55fa4e8cde60 2023-06-23T18:45:43.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.195+0000 7f03aaffd700 1 -- 172.21.15.52:0/2871167406 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03bc003e20 con 0x55fa4e8cde60 2023-06-23T18:45:43.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.195+0000 7f03de508b80 10 client.5154 fetch_fsmap learned FSMap version 16 2023-06-23T18:45:43.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.195+0000 7f03de508b80 1 -- 172.21.15.52:0/2871167406 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55fa4e7050a0 con 0x55fa4e8cde60 2023-06-23T18:45:43.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.196+0000 7f03aaffd700 1 -- 172.21.15.52:0/2871167406 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fa4e8c62a0 con 0x55fa4e8cde60 2023-06-23T18:45:43.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.196+0000 7f03aaffd700 1 -- 172.21.15.52:0/2871167406 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 16) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f03bc025430 con 0x55fa4e8cde60 2023-06-23T18:45:43.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.196+0000 7f03de508b80 10 client.5154 fetch_fsmap finished waiting for FSMap version 16 2023-06-23T18:45:43.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.196+0000 7f03de508b80 10 client.5154 resolve_mds: resolved name 'c' to daemon mds.c 2023-06-23T18:45:43.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.196+0000 7f03de508b80 20 client.5154 populate_metadata read hostname 'smithi052' 2023-06-23T18:45:43.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.196+0000 7f03de508b80 1 --2- 172.21.15.52:0/2871167406 >> [v2:172.21.15.52:6833/2041592035,v1:172.21.15.52:6835/2041592035] conn(0x55fa4e8f6900 0x55fa4e915f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.196+0000 7f03de508b80 4 client.5154 mds_command: new command op to 4849 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-23T18:45:43.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.196+0000 7f03de508b80 1 -- 172.21.15.52:0/2871167406 --> [v2:172.21.15.52:6833/2041592035,v1:172.21.15.52:6835/2041592035] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fa4e8a2910 con 0x55fa4e8f6900 2023-06-23T18:45:43.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.196+0000 7f03cb7fe700 1 --2- 172.21.15.52:0/2871167406 >> [v2:172.21.15.52:6833/2041592035,v1:172.21.15.52:6835/2041592035] conn(0x55fa4e8f6900 0x55fa4e915f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.196+0000 7f03aaffd700 10 client.5154 ms_handle_connect on v2:172.21.15.52:6833/2041592035 2023-06-23T18:45:43.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.196+0000 7f03cb7fe700 1 --2- 172.21.15.52:0/2871167406 >> [v2:172.21.15.52:6833/2041592035,v1:172.21.15.52:6835/2041592035] conn(0x55fa4e8f6900 0x55fa4e915f50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e38c85b8af0fcc60 server_cookie=50efc49a16ed096 in_seq=0 out_seq=0 2023-06-23T18:45:43.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.197+0000 7f03aaffd700 1 -- 172.21.15.52:0/2871167406 <== mds.0 v2:172.21.15.52:6833/2041592035 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55fa4e8a2910 con 0x55fa4e8f6900 2023-06-23T18:45:43.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.197+0000 7f03aaffd700 10 client.5154 handle_command_reply: tid=0 2023-06-23T18:45:43.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.197+0000 7f03de508b80 1 client.5154 shutdown 2023-06-23T18:45:43.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.197+0000 7f03de508b80 1 -- 172.21.15.52:0/2871167406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8cde60 msgr2=0x55fa4e919af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:43.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.197+0000 7f03de508b80 1 --2- 172.21.15.52:0/2871167406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8cde60 0x55fa4e919af0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f03bc013c00 tx=0x7f03bc0047c0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.197+0000 7f03de508b80 1 -- 172.21.15.52:0/2871167406 shutdown_connections 2023-06-23T18:45:43.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.197+0000 7f03de508b80 1 --2- 172.21.15.52:0/2871167406 >> [v2:172.21.15.52:6833/2041592035,v1:172.21.15.52:6835/2041592035] conn(0x55fa4e8f6900 0x55fa4e915f50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.197+0000 7f03de508b80 1 --2- 172.21.15.52:0/2871167406 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55fa4e904830 0x55fa4e902ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.197+0000 7f03de508b80 1 --2- 172.21.15.52:0/2871167406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8cde60 0x55fa4e919af0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.197+0000 7f03aaffd700 0 client.5154 ms_handle_reset on v2:172.21.15.52:6833/2041592035 2023-06-23T18:45:43.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.197+0000 7f03de508b80 1 --2- 172.21.15.52:0/2871167406 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fa4e8d2110 0x55fa4e918fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.197+0000 7f03de508b80 1 -- 172.21.15.52:0/2871167406 >> 172.21.15.52:0/2871167406 conn(0x55fa4e8c8c90 msgr2=0x55fa4e8cd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:43.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.197+0000 7f03de508b80 1 -- 172.21.15.52:0/2871167406 shutdown_connections 2023-06-23T18:45:43.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.197+0000 7f03de508b80 1 -- 172.21.15.52:0/2871167406 wait complete. 2023-06-23T18:45:43.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.197+0000 7f03de508b80 20 client.5154 trim_cache size 0 max 16384 2023-06-23T18:45:43.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.215+0000 7f03de508b80 1 Processor -- start 2023-06-23T18:45:43.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.215+0000 7f03de508b80 1 -- start start 2023-06-23T18:45:43.228 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.215+0000 7f03de508b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8cde60 0x55fa4e8d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.215+0000 7f03de508b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fa4e8d2110 0x55fa4e91f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.215+0000 7f03de508b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55fa4e904830 0x55fa4e908080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.215+0000 7f03de508b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa4e619390 con 0x55fa4e8cde60 2023-06-23T18:45:43.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.215+0000 7f03de508b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa4e8cadb0 con 0x55fa4e8d2110 2023-06-23T18:45:43.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.215+0000 7f03de508b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa4e8f7d60 con 0x55fa4e904830 2023-06-23T18:45:43.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.216+0000 7f03cbfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8cde60 0x55fa4e8d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.229 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.216+0000 7f03cbfff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8cde60 0x55fa4e8d00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40378/0 (socket says 172.21.15.52:40378) 2023-06-23T18:45:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.216+0000 7f03cbfff700 1 -- 172.21.15.52:0/2953428108 learned_addr learned my addr 172.21.15.52:0/2953428108 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.216+0000 7f03cbfff700 1 -- 172.21.15.52:0/2953428108 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55fa4e904830 msgr2=0x55fa4e908080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.216+0000 7f03cbfff700 1 --2- 172.21.15.52:0/2953428108 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55fa4e904830 0x55fa4e908080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.216+0000 7f03cbfff700 1 -- 172.21.15.52:0/2953428108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fa4e8d2110 msgr2=0x55fa4e91f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.216+0000 7f03cbfff700 1 --2- 172.21.15.52:0/2953428108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fa4e8d2110 0x55fa4e91f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.216+0000 7f03cbfff700 1 -- 172.21.15.52:0/2953428108 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa4e7eab10 con 0x55fa4e8cde60 2023-06-23T18:45:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.216+0000 7f03cbfff700 1 --2- 172.21.15.52:0/2953428108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8cde60 0x55fa4e8d00d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f03bc006e90 tx=0x7f03bc024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6eca2a537a5214a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:43.230 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.216+0000 7f03b27fc700 1 -- 172.21.15.52:0/2953428108 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc009840 con 0x55fa4e8cde60 2023-06-23T18:45:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.216+0000 7f03b27fc700 1 -- 172.21.15.52:0/2953428108 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc013930 con 0x55fa4e8cde60 2023-06-23T18:45:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.216+0000 7f03b27fc700 1 -- 172.21.15.52:0/2953428108 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc0258f0 con 0x55fa4e8cde60 2023-06-23T18:45:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.217+0000 7f03de508b80 1 -- 172.21.15.52:0/2953428108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8cde60 msgr2=0x55fa4e8d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.217+0000 7f03de508b80 1 --2- 172.21.15.52:0/2953428108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8cde60 0x55fa4e8d00d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f03bc006e90 tx=0x7f03bc024000 comp rx=0 tx=0).stop 2023-06-23T18:45:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.217+0000 7f03de508b80 1 -- 172.21.15.52:0/2953428108 shutdown_connections 2023-06-23T18:45:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.217+0000 7f03de508b80 1 --2- 172.21.15.52:0/2953428108 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55fa4e904830 0x55fa4e908080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.217+0000 7f03de508b80 1 --2- 172.21.15.52:0/2953428108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8cde60 0x55fa4e8d00d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.231 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.217+0000 7f03de508b80 1 --2- 172.21.15.52:0/2953428108 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fa4e8d2110 0x55fa4e91f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.217+0000 7f03de508b80 1 -- 172.21.15.52:0/2953428108 >> 172.21.15.52:0/2953428108 conn(0x55fa4e8c8c90 msgr2=0x55fa4e8f8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:43.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.217+0000 7f03de508b80 1 -- 172.21.15.52:0/2953428108 shutdown_connections 2023-06-23T18:45:43.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.217+0000 7f03de508b80 1 -- 172.21.15.52:0/2953428108 wait complete. 2023-06-23T18:45:43.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.217+0000 7f03de508b80 1 -- start start 2023-06-23T18:45:43.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.217+0000 7f03de508b80 1 Processor -- start 2023-06-23T18:45:43.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.218+0000 7f03de508b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fa4e8cde60 0x55fa4e971390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.232 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.218+0000 7f03de508b80 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8d2110 0x55fa4e9676c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.218+0000 7f03de508b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55fa4e904830 0x55fa4e967c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.218+0000 7f03de508b80 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa4e8ce980 con 0x55fa4e8d2110 2023-06-23T18:45:43.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.218+0000 7f03de508b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa4e971da0 con 0x55fa4e8cde60 2023-06-23T18:45:43.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.218+0000 7f03de508b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa4e8ce7d0 con 0x55fa4e904830 2023-06-23T18:45:43.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.218+0000 7f03de508b80 10 client.0 _ll_register_callbacks cb 0x7f03bc013880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-23T18:45:43.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.218+0000 7f03cb7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8d2110 0x55fa4e9676c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.233 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.218+0000 7f03cb7fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8d2110 0x55fa4e9676c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40384/0 (socket says 172.21.15.52:40384) 2023-06-23T18:45:43.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.218+0000 7f03cb7fe700 1 -- 172.21.15.52:0/1270398631 learned_addr learned my addr 172.21.15.52:0/1270398631 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:43.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.218+0000 7f03cbfff700 1 --2- 172.21.15.52:0/1270398631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fa4e8cde60 0x55fa4e971390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.218+0000 7f03d090a700 1 --2- 172.21.15.52:0/1270398631 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55fa4e904830 0x55fa4e967c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.218+0000 7f03cb7fe700 1 -- 172.21.15.52:0/1270398631 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55fa4e904830 msgr2=0x55fa4e967c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:43.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.218+0000 7f03cb7fe700 1 --2- 172.21.15.52:0/1270398631 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55fa4e904830 0x55fa4e967c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.218+0000 7f03cb7fe700 1 -- 172.21.15.52:0/1270398631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fa4e8cde60 msgr2=0x55fa4e971390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:43.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.218+0000 7f03cb7fe700 1 --2- 172.21.15.52:0/1270398631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fa4e8cde60 0x55fa4e971390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.234 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.218+0000 7f03cb7fe700 1 -- 172.21.15.52:0/1270398631 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa4e7050a0 con 0x55fa4e8d2110 2023-06-23T18:45:43.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.219+0000 7f03cb7fe700 1 --2- 172.21.15.52:0/1270398631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8d2110 0x55fa4e9676c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f03c0059140 tx=0x7f03c005d550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf335366888932a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:43.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.219+0000 7f03aaffd700 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2023-06-23T18:45:43.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.219+0000 7f03aaffd700 1 -- 172.21.15.52:0/1270398631 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c0007ca0 con 0x55fa4e8d2110 2023-06-23T18:45:43.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.219+0000 7f03aaffd700 1 -- 172.21.15.52:0/1270398631 <== mon.0 v2:172.21.15.52:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f03c0088b20 con 0x55fa4e8d2110 2023-06-23T18:45:43.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.219+0000 7f03de508b80 1 -- 172.21.15.52:0/1270398631 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f03c4005220 con 0x55fa4e8d2110 2023-06-23T18:45:43.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.219+0000 7f03aaffd700 1 -- 172.21.15.52:0/1270398631 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03c005f0b0 con 0x55fa4e8d2110 2023-06-23T18:45:43.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.219+0000 7f03de508b80 10 client.5160 fetch_fsmap learned FSMap version 16 2023-06-23T18:45:43.235 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.219+0000 7f03de508b80 1 -- 172.21.15.52:0/1270398631 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55fa4e6791d0 con 0x55fa4e8d2110 2023-06-23T18:45:43.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.219+0000 7f03aaffd700 1 -- 172.21.15.52:0/1270398631 <== mon.0 v2:172.21.15.52:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c4005220 con 0x55fa4e8d2110 2023-06-23T18:45:43.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.219+0000 7f03aaffd700 1 -- 172.21.15.52:0/1270398631 <== mon.0 v2:172.21.15.52:3300/0 5 ==== fsmap(e 16) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f03c0058930 con 0x55fa4e8d2110 2023-06-23T18:45:43.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.219+0000 7f03de508b80 10 client.5160 fetch_fsmap finished waiting for FSMap version 16 2023-06-23T18:45:43.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.219+0000 7f03de508b80 10 client.5160 resolve_mds: resolved name 'c' to daemon mds.c 2023-06-23T18:45:43.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.219+0000 7f03de508b80 20 client.5160 populate_metadata read hostname 'smithi052' 2023-06-23T18:45:43.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.219+0000 7f03de508b80 1 --2- 172.21.15.52:0/1270398631 >> [v2:172.21.15.52:6833/2041592035,v1:172.21.15.52:6835/2041592035] conn(0x55fa4e8cd830 0x55fa4e8fdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.236 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.219+0000 7f03de508b80 4 client.5160 mds_command: new command op to 4849 tid=0[{"prefix": "status"}] 2023-06-23T18:45:43.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.219+0000 7f03de508b80 1 -- 172.21.15.52:0/1270398631 --> [v2:172.21.15.52:6833/2041592035,v1:172.21.15.52:6835/2041592035] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fa4e81dd20 con 0x55fa4e8cd830 2023-06-23T18:45:43.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.219+0000 7f03cbfff700 1 --2- 172.21.15.52:0/1270398631 >> [v2:172.21.15.52:6833/2041592035,v1:172.21.15.52:6835/2041592035] conn(0x55fa4e8cd830 0x55fa4e8fdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.220+0000 7f03aaffd700 10 client.5160 ms_handle_connect on v2:172.21.15.52:6833/2041592035 2023-06-23T18:45:43.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.220+0000 7f03cbfff700 1 --2- 172.21.15.52:0/1270398631 >> [v2:172.21.15.52:6833/2041592035,v1:172.21.15.52:6835/2041592035] conn(0x55fa4e8cd830 0x55fa4e8fdb40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0728c355edf4e45 server_cookie=f7ee122b7e215386 in_seq=0 out_seq=0 2023-06-23T18:45:43.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.220+0000 7f03aaffd700 1 -- 172.21.15.52:0/1270398631 <== mds.0 v2:172.21.15.52:6833/2041592035 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55fa4e81dd20 con 0x55fa4e8cd830 2023-06-23T18:45:43.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.220+0000 7f03aaffd700 10 client.5160 handle_command_reply: tid=0 2023-06-23T18:45:43.237 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.220+0000 7f03de508b80 1 client.5160 shutdown 2023-06-23T18:45:43.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.220+0000 7f03de508b80 1 -- 172.21.15.52:0/1270398631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8d2110 msgr2=0x55fa4e9676c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:43.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.220+0000 7f03de508b80 1 --2- 172.21.15.52:0/1270398631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8d2110 0x55fa4e9676c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f03c0059140 tx=0x7f03c005d550 comp rx=0 tx=0).stop 2023-06-23T18:45:43.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.220+0000 7f03de508b80 1 -- 172.21.15.52:0/1270398631 shutdown_connections 2023-06-23T18:45:43.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.220+0000 7f03de508b80 1 --2- 172.21.15.52:0/1270398631 >> [v2:172.21.15.52:6833/2041592035,v1:172.21.15.52:6835/2041592035] conn(0x55fa4e8cd830 0x55fa4e8fdb40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.220+0000 7f03de508b80 1 --2- 172.21.15.52:0/1270398631 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55fa4e904830 0x55fa4e967c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.220+0000 7f03de508b80 1 --2- 172.21.15.52:0/1270398631 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55fa4e8cde60 0x55fa4e971390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.238 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.220+0000 7f03aaffd700 0 client.5160 ms_handle_reset on v2:172.21.15.52:6833/2041592035 2023-06-23T18:45:43.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.220+0000 7f03de508b80 1 --2- 172.21.15.52:0/1270398631 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fa4e8d2110 0x55fa4e9676c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.220+0000 7f03de508b80 1 -- 172.21.15.52:0/1270398631 >> 172.21.15.52:0/1270398631 conn(0x55fa4e8c8c90 msgr2=0x55fa4e902b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:43.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.220+0000 7f03de508b80 1 -- 172.21.15.52:0/1270398631 shutdown_connections 2023-06-23T18:45:43.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.220+0000 7f03de508b80 1 -- 172.21.15.52:0/1270398631 wait complete. 2023-06-23T18:45:43.239 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.220+0000 7f03de508b80 20 client.5160 trim_cache size 0 max 16384 2023-06-23T18:45:43.239 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2023-06-23T18:45:43.240 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "cd0d1792-8aa8-49a7-9e5c-ba51edbbb077", 2023-06-23T18:45:43.240 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2023-06-23T18:45:43.240 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4849, 2023-06-23T18:45:43.240 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2023-06-23T18:45:43.240 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2023-06-23T18:45:43.240 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2023-06-23T18:45:43.240 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 5.8776623350000001, 2023-06-23T18:45:43.241 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 16, 2023-06-23T18:45:43.241 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 32, 2023-06-23T18:45:43.241 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 32, 2023-06-23T18:45:43.241 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 14.159236131 2023-06-23T18:45:43.241 INFO:teuthology.orchestra.run.smithi052.stdout:} 2023-06-23T18:45:43.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.221+0000 7f03d236d700 1 -- 172.21.15.52:0/3173060626 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f03b806ad10 msgr2=0x7f03b806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:43.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.221+0000 7f03d236d700 1 --2- 172.21.15.52:0/3173060626 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f03b806ad10 0x7f03b806d1c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f03bc009bd0 tx=0x7f03bc008040 comp rx=0 tx=0).stop 2023-06-23T18:45:43.242 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.221+0000 7f03d236d700 1 -- 172.21.15.52:0/3173060626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03cc14c120 msgr2=0x7f03cc0b4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:43.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.221+0000 7f03d236d700 1 --2- 172.21.15.52:0/3173060626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03cc14c120 0x7f03cc0b4fc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f03b400c090 tx=0x7f03c0001930 comp rx=0 tx=0).stop 2023-06-23T18:45:43.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.221+0000 7f03d236d700 1 -- 172.21.15.52:0/3173060626 shutdown_connections 2023-06-23T18:45:43.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.221+0000 7f03d236d700 1 --2- 172.21.15.52:0/3173060626 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f03b806ad10 0x7f03b806d1c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.221+0000 7f03d236d700 1 --2- 172.21.15.52:0/3173060626 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f03cc13e380 0x7f03cc13e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.221+0000 7f03d236d700 1 --2- 172.21.15.52:0/3173060626 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f03b4004850 0x7f03cc14e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.221+0000 7f03d236d700 1 --2- 172.21.15.52:0/3173060626 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03cc14c120 0x7f03cc0b4fc0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.243 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.221+0000 7f03d236d700 1 -- 172.21.15.52:0/3173060626 >> 172.21.15.52:0/3173060626 conn(0x7f03cc0bd690 msgr2=0x7f03cc0b7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:43.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.221+0000 7f03d236d700 1 -- 172.21.15.52:0/3173060626 shutdown_connections 2023-06-23T18:45:43.244 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.221+0000 7f03d236d700 1 -- 172.21.15.52:0/3173060626 wait complete. 2023-06-23T18:45:43.244 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-23T18:45:43.369 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.363+0000 7f2fb6577700 1 Processor -- start 2023-06-23T18:45:43.370 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.363+0000 7f2fb6577700 1 -- start start 2023-06-23T18:45:43.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.364+0000 7f2fb6577700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2fb0144920 0x7f2fb0155db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.364+0000 7f2fb6577700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb00b7aa0 con 0x7f2fb01444a0 2023-06-23T18:45:43.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.364+0000 7f2fb6577700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb00b5f30 con 0x7f2fb006a0d0 2023-06-23T18:45:43.372 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.364+0000 7f2fb6577700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb00bcfc0 con 0x7f2fb0144920 2023-06-23T18:45:43.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.364+0000 7f2faf7fe700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f2fb01444a0 0x7f2fb00b54e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:51808/0 (socket says 172.21.15.52:51808) 2023-06-23T18:45:43.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.364+0000 7f2faf7fe700 1 -- 172.21.15.52:0/581450744 learned_addr learned my addr 172.21.15.52:0/581450744 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:45:43.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.364+0000 7f2fb4b14700 1 --2- 172.21.15.52:0/581450744 >> v2:172.21.15.89:3300/0 conn(0x7f2fb0144920 0x7f2fb0155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.364+0000 7f2faeffd700 1 -- 172.21.15.52:0/581450744 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3177573422 0 0) 0x7f2fb00b7aa0 con 0x7f2fb01444a0 2023-06-23T18:45:43.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.364+0000 7f2faeffd700 1 -- 172.21.15.52:0/581450744 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f9c0035b0 con 0x7f2fb01444a0 2023-06-23T18:45:43.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2faeffd700 1 -- 172.21.15.52:0/581450744 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 530706288 0 0) 0x7f2f9c0035b0 con 0x7f2fb01444a0 2023-06-23T18:45:43.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2faeffd700 1 -- 172.21.15.52:0/581450744 >> v2:172.21.15.89:3300/0 conn(0x7f2fb0144920 msgr2=0x7f2fb0155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:43.373 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2faeffd700 1 --2- 172.21.15.52:0/581450744 >> v2:172.21.15.89:3300/0 conn(0x7f2fb0144920 0x7f2fb0155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2faeffd700 1 -- 172.21.15.52:0/581450744 >> v1:172.21.15.89:6789/0 conn(0x7f2fb006a0d0 legacy=0x7f2fb00bc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:43.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2faeffd700 1 -- 172.21.15.52:0/581450744 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb00b6210 con 0x7f2fb01444a0 2023-06-23T18:45:43.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2faeffd700 1 -- 172.21.15.52:0/581450744 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7f2f98001670 con 0x7f2fb01444a0 2023-06-23T18:45:43.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2faeffd700 1 -- 172.21.15.52:0/581450744 >> v1:172.21.15.52:6789/0 conn(0x7f2fb01444a0 legacy=0x7f2fb00b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:43.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2faeffd700 1 --2- 172.21.15.52:0/581450744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f9c003a00 0x7f2f9c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2faeffd700 1 --2- 172.21.15.52:0/581450744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f9c004850 0x7f2f9c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.374 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2faeffd700 1 --2- 172.21.15.52:0/581450744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f9c005200 0x7f2f9c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2faeffd700 1 -- 172.21.15.52:0/581450744 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00bcfc0 con 0x7f2f9c004850 2023-06-23T18:45:43.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2faeffd700 1 -- 172.21.15.52:0/581450744 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c00c080 con 0x7f2f9c005200 2023-06-23T18:45:43.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2faeffd700 1 -- 172.21.15.52:0/581450744 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9c00c240 con 0x7f2f9c003a00 2023-06-23T18:45:43.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2faf7fe700 1 --2- 172.21.15.52:0/581450744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f9c004850 0x7f2f9c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2faffff700 1 --2- 172.21.15.52:0/581450744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f9c003a00 0x7f2f9c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2fb4b14700 1 --2- 172.21.15.52:0/581450744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f9c005200 0x7f2f9c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2faf7fe700 1 -- 172.21.15.52:0/581450744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f9c003a00 msgr2=0x7f2f9c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:43.375 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2faf7fe700 1 --2- 172.21.15.52:0/581450744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f9c003a00 0x7f2f9c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2faf7fe700 1 -- 172.21.15.52:0/581450744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f9c005200 msgr2=0x7f2f9c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:45:43.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2faf7fe700 1 --2- 172.21.15.52:0/581450744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f9c005200 0x7f2f9c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2faf7fe700 1 -- 172.21.15.52:0/581450744 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9c0035b0 con 0x7f2f9c004850 2023-06-23T18:45:43.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2faffff700 1 --2- 172.21.15.52:0/581450744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f9c003a00 0x7f2f9c003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:43.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2fb4b14700 1 --2- 172.21.15.52:0/581450744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f9c005200 0x7f2f9c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:45:43.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2fb4b14700 1 -- 172.21.15.52:0/581450744 reap_dead start 2023-06-23T18:45:43.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2faf7fe700 1 --2- 172.21.15.52:0/581450744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f9c004850 0x7f2f9c004cc0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2f9800c240 tx=0x7f2f9c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6228ffb85ab6c01e server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:43.376 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2faeffd700 1 -- 172.21.15.52:0/581450744 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f98007c10 con 0x7f2f9c004850 2023-06-23T18:45:43.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2faeffd700 1 -- 172.21.15.52:0/581450744 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9800cde0 con 0x7f2f9c004850 2023-06-23T18:45:43.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.365+0000 7f2faeffd700 1 -- 172.21.15.52:0/581450744 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f98005ba0 con 0x7f2f9c004850 2023-06-23T18:45:43.377 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.366+0000 7f2fb6577700 1 -- 172.21.15.52:0/581450744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f9c004850 msgr2=0x7f2f9c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:43.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.366+0000 7f2fb6577700 1 --2- 172.21.15.52:0/581450744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f9c004850 0x7f2f9c004cc0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2f9800c240 tx=0x7f2f9c005880 comp rx=0 tx=0).stop 2023-06-23T18:45:43.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.366+0000 7f2fb6577700 1 -- 172.21.15.52:0/581450744 shutdown_connections 2023-06-23T18:45:43.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.366+0000 7f2fb6577700 1 --2- 172.21.15.52:0/581450744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2f9c004850 0x7f2f9c004cc0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.379 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.366+0000 7f2fb6577700 1 -- 172.21.15.52:0/581450744 >> 172.21.15.52:0/581450744 conn(0x7f2fb006bb90 msgr2=0x7f2fb006bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:43.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.366+0000 7f2fb6577700 1 -- 172.21.15.52:0/581450744 shutdown_connections 2023-06-23T18:45:43.380 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.366+0000 7f2fb6577700 1 -- 172.21.15.52:0/581450744 wait complete. 2023-06-23T18:45:43.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.367+0000 7f2fb6577700 1 Processor -- start 2023-06-23T18:45:43.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.367+0000 7f2fb6577700 1 -- start start 2023-06-23T18:45:43.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.368+0000 7f2fb6577700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f9c004850 0x7f2fb00bf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.368+0000 7f2fb6577700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fb0142890 0x7f2fb01d1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.368+0000 7f2fb6577700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fb013fc60 0x7f2fb01400d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.382 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.368+0000 7f2fb6577700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00bf820 con 0x7f2fb013fc60 2023-06-23T18:45:43.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.368+0000 7f2fb6577700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00b8460 con 0x7f2fb0142890 2023-06-23T18:45:43.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.368+0000 7f2fb6577700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00c0130 con 0x7f2f9c004850 2023-06-23T18:45:43.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.368+0000 7f2fb4b14700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fb013fc60 0x7f2fb01400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.368+0000 7f2fb4b14700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fb013fc60 0x7f2fb01400d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:40416/0 (socket says 172.21.15.52:40416) 2023-06-23T18:45:43.383 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.368+0000 7f2fb4b14700 1 -- 172.21.15.52:0/439393553 learned_addr learned my addr 172.21.15.52:0/439393553 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:45:43.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.368+0000 7f2faffff700 1 --2- 172.21.15.52:0/439393553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f9c004850 0x7f2fb00bf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.368+0000 7f2faf7fe700 1 --2- 172.21.15.52:0/439393553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fb0142890 0x7f2fb01d1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.368+0000 7f2fb4b14700 1 -- 172.21.15.52:0/439393553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f9c004850 msgr2=0x7f2fb00bf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:43.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.368+0000 7f2fb4b14700 1 --2- 172.21.15.52:0/439393553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f9c004850 0x7f2fb00bf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.368+0000 7f2fb4b14700 1 -- 172.21.15.52:0/439393553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fb0142890 msgr2=0x7f2fb01d1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:43.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.368+0000 7f2fb4b14700 1 --2- 172.21.15.52:0/439393553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fb0142890 0x7f2fb01d1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.384 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.368+0000 7f2fb4b14700 1 -- 172.21.15.52:0/439393553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb0149b70 con 0x7f2fb013fc60 2023-06-23T18:45:43.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.368+0000 7f2faf7fe700 1 --2- 172.21.15.52:0/439393553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fb0142890 0x7f2fb01d1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:45:43.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.368+0000 7f2faffff700 1 --2- 172.21.15.52:0/439393553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f9c004850 0x7f2fb00bf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:45:43.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.368+0000 7f2fb4b14700 1 --2- 172.21.15.52:0/439393553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fb013fc60 0x7f2fb01400d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2fb008abe0 tx=0x7f2fa80104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:43.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.369+0000 7f2facff9700 1 -- 172.21.15.52:0/439393553 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa801b070 con 0x7f2fb013fc60 2023-06-23T18:45:43.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.369+0000 7f2facff9700 1 -- 172.21.15.52:0/439393553 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa800f040 con 0x7f2fb013fc60 2023-06-23T18:45:43.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.369+0000 7f2fb6577700 1 -- 172.21.15.52:0/439393553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb00b8690 con 0x7f2fb013fc60 2023-06-23T18:45:43.385 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.369+0000 7f2facff9700 1 -- 172.21.15.52:0/439393553 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa800e050 con 0x7f2fb013fc60 2023-06-23T18:45:43.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.369+0000 7f2fb6577700 1 -- 172.21.15.52:0/439393553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb0142090 con 0x7f2fb013fc60 2023-06-23T18:45:43.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.370+0000 7f2fb6577700 1 -- 172.21.15.52:0/439393553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb01426e0 con 0x7f2fb013fc60 2023-06-23T18:45:43.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.370+0000 7f2facff9700 1 -- 172.21.15.52:0/439393553 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2fa8015440 con 0x7f2fb013fc60 2023-06-23T18:45:43.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.371+0000 7f2facff9700 1 --2- 172.21.15.52:0/439393553 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2f9006ace0 0x7f2f9006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:45:43.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.371+0000 7f2facff9700 1 -- 172.21.15.52:0/439393553 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2fa80895e0 con 0x7f2fb013fc60 2023-06-23T18:45:43.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.371+0000 7f2faffff700 1 --2- 172.21.15.52:0/439393553 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2f9006ace0 0x7f2f9006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:45:43.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.371+0000 7f2faffff700 1 --2- 172.21.15.52:0/439393553 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2f9006ace0 0x7f2f9006d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0000c00 tx=0x7f2fa0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:45:43.386 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.375+0000 7f2facff9700 1 -- 172.21.15.52:0/439393553 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2fa8054690 con 0x7f2fb013fc60 2023-06-23T18:45:43.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.621+0000 7f2fb6577700 1 -- 172.21.15.52:0/439393553 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2fb004e1d0 con 0x7f2fb013fc60 2023-06-23T18:45:43.627 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.621+0000 7f2facff9700 1 -- 172.21.15.52:0/439393553 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2fa8057cb0 con 0x7f2fb013fc60 2023-06-23T18:45:43.628 INFO:teuthology.orchestra.run.smithi052.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-23T18:45:43.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.623+0000 7f2fb6577700 1 -- 172.21.15.52:0/439393553 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2f9006ace0 msgr2=0x7f2f9006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:43.629 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.623+0000 7f2fb6577700 1 --2- 172.21.15.52:0/439393553 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2f9006ace0 0x7f2f9006d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0000c00 tx=0x7f2fa0009040 comp rx=0 tx=0).stop 2023-06-23T18:45:43.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.623+0000 7f2fb6577700 1 -- 172.21.15.52:0/439393553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fb013fc60 msgr2=0x7f2fb01400d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:45:43.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.623+0000 7f2fb6577700 1 --2- 172.21.15.52:0/439393553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fb013fc60 0x7f2fb01400d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2fb008abe0 tx=0x7f2fa80104a0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.623+0000 7f2fb6577700 1 -- 172.21.15.52:0/439393553 shutdown_connections 2023-06-23T18:45:43.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.623+0000 7f2fb6577700 1 --2- 172.21.15.52:0/439393553 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f2f9006ace0 0x7f2f9006d190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.623+0000 7f2fb6577700 1 --2- 172.21.15.52:0/439393553 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fb013fc60 0x7f2fb01400d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.623+0000 7f2fb6577700 1 --2- 172.21.15.52:0/439393553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f9c004850 0x7f2fb00bf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.630 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.623+0000 7f2fb6577700 1 --2- 172.21.15.52:0/439393553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fb0142890 0x7f2fb01d1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:45:43.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.623+0000 7f2fb6577700 1 -- 172.21.15.52:0/439393553 >> 172.21.15.52:0/439393553 conn(0x7f2fb006bb90 msgr2=0x7f2fb01d0500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:45:43.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.624+0000 7f2fb6577700 1 -- 172.21.15.52:0/439393553 shutdown_connections 2023-06-23T18:45:43.631 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:45:43.624+0000 7f2fb6577700 1 -- 172.21.15.52:0/439393553 wait complete. 2023-06-23T18:45:43.641 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-06-23T18:45:43.642 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-23T18:45:43.642 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi158.front.sepia.ceph.com 2023-06-23T18:45:43.642 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-23T18:45:43.643 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-23T18:45:43.643 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-06-23T18:45:43.643 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-06-23T18:45:43.643 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-23T18:45:43.644 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-23T18:45:43.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:43.644 DEBUG:teuthology.orchestra.run.smithi158:> ip addr 2023-06-23T18:45:43.695 INFO:teuthology.orchestra.run.smithi158.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-23T18:45:43.696 INFO:teuthology.orchestra.run.smithi158.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-23T18:45:43.696 INFO:teuthology.orchestra.run.smithi158.stdout: inet 127.0.0.1/8 scope host lo 2023-06-23T18:45:43.696 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-06-23T18:45:43.696 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 ::1/128 scope host 2023-06-23T18:45:43.696 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-06-23T18:45:43.696 INFO:teuthology.orchestra.run.smithi158.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-23T18:45:43.696 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d4 brd ff:ff:ff:ff:ff:ff 2023-06-23T18:45:43.697 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f0 2023-06-23T18:45:43.697 INFO:teuthology.orchestra.run.smithi158.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-23T18:45:43.697 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:da:6b:d5 brd ff:ff:ff:ff:ff:ff 2023-06-23T18:45:43.697 INFO:teuthology.orchestra.run.smithi158.stdout: altname enp7s0f1 2023-06-23T18:45:43.697 INFO:teuthology.orchestra.run.smithi158.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-23T18:45:43.697 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6e brd ff:ff:ff:ff:ff:ff 2023-06-23T18:45:43.697 INFO:teuthology.orchestra.run.smithi158.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-23T18:45:43.698 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 0c:c4:7a:88:72:6f brd ff:ff:ff:ff:ff:ff 2023-06-23T18:45:43.698 INFO:teuthology.orchestra.run.smithi158.stdout: inet 172.21.15.158/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-06-23T18:45:43.698 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft 42332sec preferred_lft 42332sec 2023-06-23T18:45:43.698 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::ec4:7aff:fe88:726f/64 scope link 2023-06-23T18:45:43.698 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-06-23T18:45:43.698 INFO:teuthology.orchestra.run.smithi158.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-23T18:45:43.698 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 12:57:83:29:85:f6 brd ff:ff:ff:ff:ff:ff 2023-06-23T18:45:43.698 INFO:teuthology.orchestra.run.smithi158.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-23T18:45:43.699 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-06-23T18:45:43.699 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::1860:d9ff:fec7:bb94/64 scope link 2023-06-23T18:45:43.699 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-06-23T18:45:43.699 INFO:teuthology.orchestra.run.smithi158.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-23T18:45:43.699 INFO:teuthology.orchestra.run.smithi158.stdout: link/ether 12:57:83:29:85:f6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-23T18:45:43.699 INFO:teuthology.orchestra.run.smithi158.stdout: inet6 fe80::1057:83ff:fe29:85f6/64 scope link 2023-06-23T18:45:43.699 INFO:teuthology.orchestra.run.smithi158.stdout: valid_lft forever preferred_lft forever 2023-06-23T18:45:43.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:43.701 DEBUG:teuthology.orchestra.run.smithi158:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-23T18:45:43.770 INFO:teuthology.orchestra.run.smithi158.stdout:1 2023-06-23T18:45:43.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:43.773 DEBUG:teuthology.orchestra.run.smithi158:> route 2023-06-23T18:45:43.821 INFO:teuthology.orchestra.run.smithi158.stdout:Kernel IP routing table 2023-06-23T18:45:43.822 INFO:teuthology.orchestra.run.smithi158.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-23T18:45:43.822 INFO:teuthology.orchestra.run.smithi158.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-23T18:45:43.822 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-23T18:45:43.822 INFO:teuthology.orchestra.run.smithi158.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-23T18:45:43.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:43.823 DEBUG:teuthology.orchestra.run.smithi158:> (cd / && exec bash -c ' 2023-06-23T18:45:43.824 DEBUG:teuthology.orchestra.run.smithi158:> set -e 2023-06-23T18:45:43.824 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-23T18:45:43.824 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-23T18:45:43.825 DEBUG:teuthology.orchestra.run.smithi158:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-23T18:45:43.825 DEBUG:teuthology.orchestra.run.smithi158:> ') 2023-06-23T18:45:43.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:43.992 DEBUG:teuthology.orchestra.run.smithi158:> ip netns list 2023-06-23T18:45:44.037 INFO:teuthology.orchestra.run.smithi158.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-23T18:45:44.037 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-23T18:45:44.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:44.038 DEBUG:teuthology.orchestra.run.smithi158:> sudo ip link set brx.0 up 2023-06-23T18:45:44.146 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-23T18:45:44.146 DEBUG:teuthology.orchestra.run.smithi158:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-23T18:45:44.191 INFO:teuthology.orchestra.run.smithi158.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-23T18:45:44.191 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-23T18:45:44.192 DEBUG:teuthology.orchestra.run.smithi158:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-23T18:45:44.275 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-06-23T18:45:44.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:44.276 DEBUG:teuthology.orchestra.run.smithi158:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-23T18:45:44.419 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-23T18:45:44.420 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-23T18:45:44.449 INFO:teuthology.orchestra.run.smithi158.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-23T18:45:44.449 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-23T18:45:44.449 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: resolved to: "172.21.15.52:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-06-23T18:45:44.449 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: trying mount with new device syntax: 0@cd0d1792-8aa8-49a7-9e5c-ba51edbbb077.cephfs=/ 2023-06-23T18:45:44.449 INFO:teuthology.orchestra.run.smithi158.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.52:3300/172.21.15.89:3300/172.21.15.89:3301" will pass to kernel 2023-06-23T18:45:44.454 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-23T18:45:44.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:44.455 DEBUG:teuthology.orchestra.run.smithi158:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-23T18:45:44.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:44.524 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-23T18:45:44.629 INFO:teuthology.orchestra.run.smithi158.stdout:client4805 2023-06-23T18:45:44.629 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-06-23T18:45:44.629 DEBUG:teuthology.orchestra.run.smithi158:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T18:45:44.675 DEBUG:teuthology.orchestra.run.smithi158:> mktemp -d --suffix=xfstests-dev 2023-06-23T18:45:44.759 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.d43oagwOcAxfstests-dev 2023-06-23T18:45:44.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:44.760 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.d43oagwOcAxfstests-dev) 2023-06-23T18:45:44.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:44.870 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.d43oagwOcAxfstests-dev) 2023-06-23T18:45:44.922 INFO:teuthology.orchestra.run.smithi158.stderr:Cloning into '/tmp/tmp.d43oagwOcAxfstests-dev'... 2023-06-23T18:45:45.800 DEBUG:teuthology.orchestra.run.smithi158:> mktemp -d --suffix=xfsprogs-dev 2023-06-23T18:45:45.845 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.Ga11jYSuehxfsprogs-dev 2023-06-23T18:45:45.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:45.846 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.Ga11jYSuehxfsprogs-dev) 2023-06-23T18:45:45.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:45.956 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfsprogs-dev.git --depth 1 /tmp/tmp.Ga11jYSuehxfsprogs-dev) 2023-06-23T18:45:46.007 INFO:teuthology.orchestra.run.smithi158.stderr:Cloning into '/tmp/tmp.Ga11jYSuehxfsprogs-dev'... 2023-06-23T18:45:46.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:46.541 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-06-23T18:45:46.594 DEBUG:teuthology.orchestra.run.smithi158:> mktemp -d --suffix=test 2023-06-23T18:45:46.638 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.HeZTFPO0mrtest 2023-06-23T18:45:46.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T18:45:46.639 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-06-23T18:45:46.727 DEBUG:teuthology.orchestra.run.smithi158:> mktemp -d --suffix=scratch 2023-06-23T18:45:46.771 INFO:teuthology.orchestra.run.smithi158.stdout:/tmp/tmp.Y7KypOYmkCscratch 2023-06-23T18:45:46.771 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "8". 2023-06-23T18:45:46.772 DEBUG:teuthology.orchestra.run.smithi158:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite inih-devel userspace-rcu-devel libblkid-devel gettext libedit-devel libattr-devel device-mapper-devel libicu-devel xfsprogs-qa-devel 2023-06-23T18:45:47.818 INFO:teuthology.orchestra.run.smithi158.stdout:Last metadata expiration check: 0:03:56 ago on Fri 23 Jun 2023 06:41:51 PM UTC. 2023-06-23T18:45:49.026 INFO:teuthology.orchestra.run.smithi158.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-06-23T18:45:49.027 INFO:teuthology.orchestra.run.smithi158.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-06-23T18:45:49.028 INFO:teuthology.orchestra.run.smithi158.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-06-23T18:45:49.029 INFO:teuthology.orchestra.run.smithi158.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-06-23T18:45:49.030 INFO:teuthology.orchestra.run.smithi158.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-06-23T18:45:49.032 INFO:teuthology.orchestra.run.smithi158.stdout:Package e2fsprogs-1.45.6-5.el8.x86_64 is already installed. 2023-06-23T18:45:49.034 INFO:teuthology.orchestra.run.smithi158.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-06-23T18:45:49.035 INFO:teuthology.orchestra.run.smithi158.stdout:Package gcc-8.5.0-19.el8.x86_64 is already installed. 2023-06-23T18:45:49.037 INFO:teuthology.orchestra.run.smithi158.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-06-23T18:45:49.038 INFO:teuthology.orchestra.run.smithi158.stdout:Package lvm2-8:2.03.14-9.el8.x86_64 is already installed. 2023-06-23T18:45:49.039 INFO:teuthology.orchestra.run.smithi158.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-06-23T18:45:49.040 INFO:teuthology.orchestra.run.smithi158.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-06-23T18:45:49.041 INFO:teuthology.orchestra.run.smithi158.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-06-23T18:45:49.042 INFO:teuthology.orchestra.run.smithi158.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-06-23T18:45:49.043 INFO:teuthology.orchestra.run.smithi158.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-06-23T18:45:49.044 INFO:teuthology.orchestra.run.smithi158.stdout:Package xfsprogs-5.0.0-12.el8.x86_64 is already installed. 2023-06-23T18:45:49.045 INFO:teuthology.orchestra.run.smithi158.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-06-23T18:45:49.046 INFO:teuthology.orchestra.run.smithi158.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-06-23T18:45:49.047 INFO:teuthology.orchestra.run.smithi158.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-06-23T18:45:49.048 INFO:teuthology.orchestra.run.smithi158.stdout:Package libuuid-devel-2.32.1-42.el8.x86_64 is already installed. 2023-06-23T18:45:49.049 INFO:teuthology.orchestra.run.smithi158.stdout:Package xfsprogs-devel-5.0.0-12.el8.x86_64 is already installed. 2023-06-23T18:45:49.051 INFO:teuthology.orchestra.run.smithi158.stdout:Package sqlite-3.26.0-17.el8.x86_64 is already installed. 2023-06-23T18:45:49.054 INFO:teuthology.orchestra.run.smithi158.stdout:Package gettext-0.19.8.1-17.el8.x86_64 is already installed. 2023-06-23T18:45:49.061 INFO:teuthology.orchestra.run.smithi158.stdout:Package xfsprogs-5.0.0-12.el8.x86_64 is already installed. 2023-06-23T18:45:49.228 INFO:teuthology.orchestra.run.smithi158.stdout:Dependencies resolved. 2023-06-23T18:45:49.231 INFO:teuthology.orchestra.run.smithi158.stdout:======================================================================================== 2023-06-23T18:45:49.231 INFO:teuthology.orchestra.run.smithi158.stdout: Package Arch Version Repository Size 2023-06-23T18:45:49.232 INFO:teuthology.orchestra.run.smithi158.stdout:======================================================================================== 2023-06-23T18:45:49.232 INFO:teuthology.orchestra.run.smithi158.stdout:Installing: 2023-06-23T18:45:49.232 INFO:teuthology.orchestra.run.smithi158.stdout: device-mapper-devel x86_64 8:1.02.181-9.el8 powertools 284 k 2023-06-23T18:45:49.232 INFO:teuthology.orchestra.run.smithi158.stdout: dump x86_64 1:0.4-0.36.b46.el8 baseos 164 k 2023-06-23T18:45:49.233 INFO:teuthology.orchestra.run.smithi158.stdout: fio x86_64 3.19-4.el8 appstream 538 k 2023-06-23T18:45:49.233 INFO:teuthology.orchestra.run.smithi158.stdout: indent x86_64 2.2.13-2.el8 epel 187 k 2023-06-23T18:45:49.233 INFO:teuthology.orchestra.run.smithi158.stdout: inih-devel x86_64 56-1.el8 epel 13 k 2023-06-23T18:45:49.233 INFO:teuthology.orchestra.run.smithi158.stdout: libblkid-devel x86_64 2.32.1-42.el8 baseos 87 k 2023-06-23T18:45:49.233 INFO:teuthology.orchestra.run.smithi158.stdout: libedit-devel x86_64 3.1-23.20170329cvs.el8 powertools 44 k 2023-06-23T18:45:49.233 INFO:teuthology.orchestra.run.smithi158.stdout: libicu-devel x86_64 60.3-2.el8_1 baseos 922 k 2023-06-23T18:45:49.233 INFO:teuthology.orchestra.run.smithi158.stdout: python2 x86_64 2.7.18-12.module_el8+299+aa6e9afa appstream 110 k 2023-06-23T18:45:49.234 INFO:teuthology.orchestra.run.smithi158.stdout: userspace-rcu-devel x86_64 0.10.1-4.el8 powertools 84 k 2023-06-23T18:45:49.234 INFO:teuthology.orchestra.run.smithi158.stdout:Upgrading: 2023-06-23T18:45:49.234 INFO:teuthology.orchestra.run.smithi158.stdout: sqlite x86_64 3.26.0-18.el8 baseos 668 k 2023-06-23T18:45:49.234 INFO:teuthology.orchestra.run.smithi158.stdout: sqlite-libs x86_64 3.26.0-18.el8 baseos 581 k 2023-06-23T18:45:49.234 INFO:teuthology.orchestra.run.smithi158.stdout:Installing dependencies: 2023-06-23T18:45:49.234 INFO:teuthology.orchestra.run.smithi158.stdout: daxctl-libs x86_64 71.1-7.el8 baseos 42 k 2023-06-23T18:45:49.234 INFO:teuthology.orchestra.run.smithi158.stdout: inih x86_64 56-1.el8 epel 27 k 2023-06-23T18:45:49.235 INFO:teuthology.orchestra.run.smithi158.stdout: libpmemblk x86_64 1.6.1-1.el8 appstream 92 k 2023-06-23T18:45:49.235 INFO:teuthology.orchestra.run.smithi158.stdout: ndctl-libs x86_64 71.1-7.el8 baseos 80 k 2023-06-23T18:45:49.235 INFO:teuthology.orchestra.run.smithi158.stdout: python2-libs x86_64 2.7.18-12.module_el8+299+aa6e9afa appstream 6.5 M 2023-06-23T18:45:49.235 INFO:teuthology.orchestra.run.smithi158.stdout: python2-pip-wheel noarch 9.0.3-19.module_el8+299+aa6e9afa appstream 892 k 2023-06-23T18:45:49.235 INFO:teuthology.orchestra.run.smithi158.stdout: python2-setuptools-wheel noarch 39.0.1-13.module_el8+299+aa6e9afa appstream 287 k 2023-06-23T18:45:49.235 INFO:teuthology.orchestra.run.smithi158.stdout: python2-wheel-wheel noarch 1:0.31.1-3.module_el8+299+aa6e9afa appstream 44 k 2023-06-23T18:45:49.235 INFO:teuthology.orchestra.run.smithi158.stdout: rmt x86_64 2:1.5.3-13.el8 baseos 51 k 2023-06-23T18:45:49.236 INFO:teuthology.orchestra.run.smithi158.stdout: systemd-devel x86_64 239-75.el8 baseos 511 k 2023-06-23T18:45:49.236 INFO:teuthology.orchestra.run.smithi158.stdout:Installing weak dependencies: 2023-06-23T18:45:49.236 INFO:teuthology.orchestra.run.smithi158.stdout: python2-pip noarch 9.0.3-19.module_el8+299+aa6e9afa appstream 1.8 M 2023-06-23T18:45:49.236 INFO:teuthology.orchestra.run.smithi158.stdout: python2-setuptools noarch 39.0.1-13.module_el8+299+aa6e9afa appstream 702 k 2023-06-23T18:45:49.236 INFO:teuthology.orchestra.run.smithi158.stdout:Enabling module streams: 2023-06-23T18:45:49.236 INFO:teuthology.orchestra.run.smithi158.stdout: python27 2.7 2023-06-23T18:45:49.236 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:45:49.236 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction Summary 2023-06-23T18:45:49.237 INFO:teuthology.orchestra.run.smithi158.stdout:======================================================================================== 2023-06-23T18:45:49.237 INFO:teuthology.orchestra.run.smithi158.stdout:Install 22 Packages 2023-06-23T18:45:49.237 INFO:teuthology.orchestra.run.smithi158.stdout:Upgrade 2 Packages 2023-06-23T18:45:49.237 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:45:49.237 INFO:teuthology.orchestra.run.smithi158.stdout:Total download size: 15 M 2023-06-23T18:45:49.238 INFO:teuthology.orchestra.run.smithi158.stdout:Downloading Packages: 2023-06-23T18:45:49.700 INFO:teuthology.orchestra.run.smithi158.stdout:(1/24): python2-2.7.18-12.module_el8+299+aa6e9a 757 kB/s | 110 kB 00:00 2023-06-23T18:45:49.726 INFO:teuthology.orchestra.run.smithi158.stdout:(2/24): libpmemblk-1.6.1-1.el8.x86_64.rpm 536 kB/s | 92 kB 00:00 2023-06-23T18:45:49.768 INFO:teuthology.orchestra.run.smithi158.stdout:(3/24): fio-3.19-4.el8.x86_64.rpm 2.5 MB/s | 538 kB 00:00 2023-06-23T18:45:49.926 INFO:teuthology.orchestra.run.smithi158.stdout:(4/24): python2-pip-9.0.3-19.module_el8+299+aa6 9.1 MB/s | 1.8 MB 00:00 2023-06-23T18:45:49.968 INFO:teuthology.orchestra.run.smithi158.stdout:(5/24): python2-pip-wheel-9.0.3-19.module_el8+2 4.4 MB/s | 892 kB 00:00 2023-06-23T18:45:50.068 INFO:teuthology.orchestra.run.smithi158.stdout:(6/24): python2-setuptools-39.0.1-13.module_el8 4.8 MB/s | 702 kB 00:00 2023-06-23T18:45:50.152 INFO:teuthology.orchestra.run.smithi158.stdout:(7/24): python2-libs-2.7.18-12.module_el8+299+a 14 MB/s | 6.5 MB 00:00 2023-06-23T18:45:50.177 INFO:teuthology.orchestra.run.smithi158.stdout:(8/24): python2-setuptools-wheel-39.0.1-13.modu 1.3 MB/s | 287 kB 00:00 2023-06-23T18:45:50.203 INFO:teuthology.orchestra.run.smithi158.stdout:(9/24): python2-wheel-wheel-0.31.1-3.module_el8 333 kB/s | 44 kB 00:00 2023-06-23T18:45:50.395 INFO:teuthology.orchestra.run.smithi158.stdout:(10/24): daxctl-libs-71.1-7.el8.x86_64.rpm 195 kB/s | 42 kB 00:00 2023-06-23T18:45:50.420 INFO:teuthology.orchestra.run.smithi158.stdout:(11/24): libblkid-devel-2.32.1-42.el8.x86_64.rp 404 kB/s | 87 kB 00:00 2023-06-23T18:45:50.487 INFO:teuthology.orchestra.run.smithi158.stdout:(12/24): ndctl-libs-71.1-7.el8.x86_64.rpm 1.2 MB/s | 80 kB 00:00 2023-06-23T18:45:50.512 INFO:teuthology.orchestra.run.smithi158.stdout:(13/24): dump-0.4-0.36.b46.el8.x86_64.rpm 491 kB/s | 164 kB 00:00 2023-06-23T18:45:50.571 INFO:teuthology.orchestra.run.smithi158.stdout:(14/24): rmt-1.5.3-13.el8.x86_64.rpm 615 kB/s | 51 kB 00:00 2023-06-23T18:45:50.646 INFO:teuthology.orchestra.run.smithi158.stdout:(15/24): libicu-devel-60.3-2.el8_1.x86_64.rpm 3.6 MB/s | 922 kB 00:00 2023-06-23T18:45:50.838 INFO:teuthology.orchestra.run.smithi158.stdout:(16/24): libedit-devel-3.1-23.20170329cvs.el8.x 231 kB/s | 44 kB 00:00 2023-06-23T18:45:50.905 INFO:teuthology.orchestra.run.smithi158.stdout:(17/24): device-mapper-devel-1.02.181-9.el8.x86 852 kB/s | 284 kB 00:00 2023-06-23T18:45:50.963 INFO:teuthology.orchestra.run.smithi158.stdout:(18/24): userspace-rcu-devel-0.10.1-4.el8.x86_6 672 kB/s | 84 kB 00:00 2023-06-23T18:45:51.172 INFO:teuthology.orchestra.run.smithi158.stdout:(19/24): systemd-devel-239-75.el8.x86_64.rpm 776 kB/s | 511 kB 00:00 2023-06-23T18:45:51.348 INFO:teuthology.orchestra.run.smithi158.stdout:(20/24): inih-56-1.el8.x86_64.rpm 71 kB/s | 27 kB 00:00 2023-06-23T18:45:51.473 INFO:teuthology.orchestra.run.smithi158.stdout:(21/24): indent-2.2.13-2.el8.x86_64.rpm 329 kB/s | 187 kB 00:00 2023-06-23T18:45:51.507 INFO:teuthology.orchestra.run.smithi158.stdout:(22/24): sqlite-3.26.0-18.el8.x86_64.rpm 4.1 MB/s | 668 kB 00:00 2023-06-23T18:45:51.590 INFO:teuthology.orchestra.run.smithi158.stdout:(23/24): inih-devel-56-1.el8.x86_64.rpm 32 kB/s | 13 kB 00:00 2023-06-23T18:45:51.798 INFO:teuthology.orchestra.run.smithi158.stdout:(24/24): sqlite-libs-3.26.0-18.el8.x86_64.rpm 1.7 MB/s | 581 kB 00:00 2023-06-23T18:45:51.801 INFO:teuthology.orchestra.run.smithi158.stdout:-------------------------------------------------------------------------------- 2023-06-23T18:45:51.801 INFO:teuthology.orchestra.run.smithi158.stdout:Total 5.7 MB/s | 15 MB 00:02 2023-06-23T18:45:52.298 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction check 2023-06-23T18:45:52.353 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction check succeeded. 2023-06-23T18:45:52.354 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction test 2023-06-23T18:45:52.649 INFO:teuthology.orchestra.run.smithi158.stdout:Transaction test succeeded. 2023-06-23T18:45:52.653 INFO:teuthology.orchestra.run.smithi158.stdout:Running transaction 2023-06-23T18:45:53.655 INFO:teuthology.orchestra.run.smithi158.stdout: Preparing : 1/1 2023-06-23T18:45:53.856 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : sqlite-libs-3.26.0-18.el8.x86_64 1/26 2023-06-23T18:45:54.065 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : daxctl-libs-71.1-7.el8.x86_64 2/26 2023-06-23T18:45:54.146 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: daxctl-libs-71.1-7.el8.x86_64 2/26 2023-06-23T18:45:54.324 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : ndctl-libs-71.1-7.el8.x86_64 3/26 2023-06-23T18:45:54.406 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: ndctl-libs-71.1-7.el8.x86_64 3/26 2023-06-23T18:45:54.532 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 4/26 2023-06-23T18:45:54.618 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 4/26 2023-06-23T18:45:55.011 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : inih-56-1.el8.x86_64 5/26 2023-06-23T18:45:55.240 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : systemd-devel-239-75.el8.x86_64 6/26 2023-06-23T18:45:55.436 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 7/26 2023-06-23T18:45:55.579 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 8/26 2023-06-23T18:45:57.030 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 9/26 2023-06-23T18:45:57.766 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 10/26 2023-06-23T18:45:58.150 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 11/26 2023-06-23T18:45:58.161 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:45:58.163 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:45:58.166 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:45:58.423 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 12/26 2023-06-23T18:45:58.602 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 13/26 2023-06-23T18:45:58.647 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 13/26 2023-06-23T18:45:58.838 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 14/26 2023-06-23T18:45:59.018 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : device-mapper-devel-8:1.02.181-9.el8.x86_64 15/26 2023-06-23T18:45:59.263 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : inih-devel-56-1.el8.x86_64 16/26 2023-06-23T18:45:59.515 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : fio-3.19-4.el8.x86_64 17/26 2023-06-23T18:45:59.769 INFO:teuthology.orchestra.run.smithi158.stdout: Upgrading : sqlite-3.26.0-18.el8.x86_64 18/26 2023-06-23T18:46:00.048 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : indent-2.2.13-2.el8.x86_64 19/26 2023-06-23T18:46:00.270 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : userspace-rcu-devel-0.10.1-4.el8.x86_64 20/26 2023-06-23T18:46:00.728 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libedit-devel-3.1-23.20170329cvs.el8.x86_64 21/26 2023-06-23T18:46:01.002 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libicu-devel-60.3-2.el8_1.x86_64 22/26 2023-06-23T18:46:01.144 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : libblkid-devel-2.32.1-42.el8.x86_64 23/26 2023-06-23T18:46:01.298 INFO:teuthology.orchestra.run.smithi158.stdout: Installing : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 24/26 2023-06-23T18:46:01.448 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : sqlite-3.26.0-17.el8.x86_64 25/26 2023-06-23T18:46:01.614 INFO:teuthology.orchestra.run.smithi158.stdout: Cleanup : sqlite-libs-3.26.0-17.el8.x86_64 26/26 2023-06-23T18:46:02.134 INFO:teuthology.orchestra.run.smithi158.stdout: Running scriptlet: sqlite-libs-3.26.0-17.el8.x86_64 26/26 2023-06-23T18:46:02.135 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : fio-3.19-4.el8.x86_64 1/26 2023-06-23T18:46:02.135 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 2/26 2023-06-23T18:46:02.135 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 3/26 2023-06-23T18:46:02.135 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 4/26 2023-06-23T18:46:02.135 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 5/26 2023-06-23T18:46:02.136 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 6/26 2023-06-23T18:46:02.136 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 7/26 2023-06-23T18:46:02.136 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 8/26 2023-06-23T18:46:02.136 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 9/26 2023-06-23T18:46:02.136 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : daxctl-libs-71.1-7.el8.x86_64 10/26 2023-06-23T18:46:02.136 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 11/26 2023-06-23T18:46:02.136 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libblkid-devel-2.32.1-42.el8.x86_64 12/26 2023-06-23T18:46:02.136 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libicu-devel-60.3-2.el8_1.x86_64 13/26 2023-06-23T18:46:02.137 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : ndctl-libs-71.1-7.el8.x86_64 14/26 2023-06-23T18:46:02.137 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 15/26 2023-06-23T18:46:02.137 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : systemd-devel-239-75.el8.x86_64 16/26 2023-06-23T18:46:02.137 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : device-mapper-devel-8:1.02.181-9.el8.x86_64 17/26 2023-06-23T18:46:02.137 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : libedit-devel-3.1-23.20170329cvs.el8.x86_64 18/26 2023-06-23T18:46:02.137 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : userspace-rcu-devel-0.10.1-4.el8.x86_64 19/26 2023-06-23T18:46:02.137 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : indent-2.2.13-2.el8.x86_64 20/26 2023-06-23T18:46:02.137 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : inih-56-1.el8.x86_64 21/26 2023-06-23T18:46:02.138 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : inih-devel-56-1.el8.x86_64 22/26 2023-06-23T18:46:02.138 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : sqlite-3.26.0-18.el8.x86_64 23/26 2023-06-23T18:46:02.138 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : sqlite-3.26.0-17.el8.x86_64 24/26 2023-06-23T18:46:02.138 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : sqlite-libs-3.26.0-18.el8.x86_64 25/26 2023-06-23T18:46:03.068 INFO:teuthology.orchestra.run.smithi158.stdout: Verifying : sqlite-libs-3.26.0-17.el8.x86_64 26/26 2023-06-23T18:46:03.068 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:46:03.068 INFO:teuthology.orchestra.run.smithi158.stdout:Upgraded: 2023-06-23T18:46:03.068 INFO:teuthology.orchestra.run.smithi158.stdout: sqlite-3.26.0-18.el8.x86_64 sqlite-libs-3.26.0-18.el8.x86_64 2023-06-23T18:46:03.069 INFO:teuthology.orchestra.run.smithi158.stdout:Installed: 2023-06-23T18:46:03.069 INFO:teuthology.orchestra.run.smithi158.stdout: daxctl-libs-71.1-7.el8.x86_64 2023-06-23T18:46:03.069 INFO:teuthology.orchestra.run.smithi158.stdout: device-mapper-devel-8:1.02.181-9.el8.x86_64 2023-06-23T18:46:03.069 INFO:teuthology.orchestra.run.smithi158.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-06-23T18:46:03.069 INFO:teuthology.orchestra.run.smithi158.stdout: fio-3.19-4.el8.x86_64 2023-06-23T18:46:03.069 INFO:teuthology.orchestra.run.smithi158.stdout: indent-2.2.13-2.el8.x86_64 2023-06-23T18:46:03.069 INFO:teuthology.orchestra.run.smithi158.stdout: inih-56-1.el8.x86_64 2023-06-23T18:46:03.070 INFO:teuthology.orchestra.run.smithi158.stdout: inih-devel-56-1.el8.x86_64 2023-06-23T18:46:03.070 INFO:teuthology.orchestra.run.smithi158.stdout: libblkid-devel-2.32.1-42.el8.x86_64 2023-06-23T18:46:03.070 INFO:teuthology.orchestra.run.smithi158.stdout: libedit-devel-3.1-23.20170329cvs.el8.x86_64 2023-06-23T18:46:03.070 INFO:teuthology.orchestra.run.smithi158.stdout: libicu-devel-60.3-2.el8_1.x86_64 2023-06-23T18:46:03.070 INFO:teuthology.orchestra.run.smithi158.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-06-23T18:46:03.070 INFO:teuthology.orchestra.run.smithi158.stdout: ndctl-libs-71.1-7.el8.x86_64 2023-06-23T18:46:03.070 INFO:teuthology.orchestra.run.smithi158.stdout: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-06-23T18:46:03.070 INFO:teuthology.orchestra.run.smithi158.stdout: python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-06-23T18:46:03.071 INFO:teuthology.orchestra.run.smithi158.stdout: python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-06-23T18:46:03.071 INFO:teuthology.orchestra.run.smithi158.stdout: python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-06-23T18:46:03.071 INFO:teuthology.orchestra.run.smithi158.stdout: python2-setuptools-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-06-23T18:46:03.071 INFO:teuthology.orchestra.run.smithi158.stdout: python2-setuptools-wheel-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-06-23T18:46:03.071 INFO:teuthology.orchestra.run.smithi158.stdout: python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e9afa.noarch 2023-06-23T18:46:03.071 INFO:teuthology.orchestra.run.smithi158.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-06-23T18:46:03.071 INFO:teuthology.orchestra.run.smithi158.stdout: systemd-devel-239-75.el8.x86_64 2023-06-23T18:46:03.072 INFO:teuthology.orchestra.run.smithi158.stdout: userspace-rcu-devel-0.10.1-4.el8.x86_64 2023-06-23T18:46:03.072 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:46:03.072 INFO:teuthology.orchestra.run.smithi158.stdout:Complete! 2023-06-23T18:46:03.284 DEBUG:teuthology.orchestra.run.smithi158:> sudo useradd -m fsgqa 2023-06-23T18:46:03.357 INFO:teuthology.orchestra.run.smithi158.stderr:useradd: user 'fsgqa' already exists 2023-06-23T18:46:03.361 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-06-23T18:46:03.361 DEBUG:teuthology.orchestra.run.smithi158:> sudo groupadd fsgqa 2023-06-23T18:46:03.430 INFO:teuthology.orchestra.run.smithi158.stderr:groupadd: group 'fsgqa' already exists 2023-06-23T18:46:03.432 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-06-23T18:46:03.433 DEBUG:teuthology.orchestra.run.smithi158:> sudo useradd fsgqa2 2023-06-23T18:46:04.054 DEBUG:teuthology.orchestra.run.smithi158:> sudo useradd 123456-fsgqa 2023-06-23T18:46:04.626 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-06-23T18:46:04.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.761+0000 7fbcba1fb700 1 Processor -- start 2023-06-23T18:46:04.766 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.761+0000 7fbcba1fb700 1 -- start start 2023-06-23T18:46:04.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.762+0000 7fbcba1fb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb406a0d0 0x7fbcb40bc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:46:04.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.762+0000 7fbcba1fb700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbcb40b6930 0x7fbcb4147b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:46:04.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.762+0000 7fbcba1fb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb40b64a0 con 0x7fbcb40b7540 2023-06-23T18:46:04.768 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.762+0000 7fbcba1fb700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb40b7d90 con 0x7fbcb40b6930 2023-06-23T18:46:04.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.762+0000 7fbcba1fb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb40b55a0 con 0x7fbcb406a0d0 2023-06-23T18:46:04.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.762+0000 7fbcb3fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbcb40b6930 0x7fbcb4147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:46:04.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.762+0000 7fbcb3fff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fbcb40b6930 0x7fbcb4147b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59218/0 (socket says 172.21.15.52:59218) 2023-06-23T18:46:04.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.762+0000 7fbcb3fff700 1 -- 172.21.15.52:0/292418542 learned_addr learned my addr 172.21.15.52:0/292418542 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:46:04.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.762+0000 7fbcb37fe700 1 --2- 172.21.15.52:0/292418542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb406a0d0 0x7fbcb40bc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:46:04.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.762+0000 7fbcb3fff700 1 -- 172.21.15.52:0/292418542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb406a0d0 msgr2=0x7fbcb40bc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:46:04.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.762+0000 7fbcb3fff700 1 --2- 172.21.15.52:0/292418542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb406a0d0 0x7fbcb40bc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:46:04.769 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.762+0000 7fbcb3fff700 1 -- 172.21.15.52:0/292418542 >> v1:172.21.15.89:6789/0 conn(0x7fbcb40b7540 legacy=0x7fbcb414de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:46:04.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.762+0000 7fbcb3fff700 1 -- 172.21.15.52:0/292418542 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb40b5880 con 0x7fbcb40b6930 2023-06-23T18:46:04.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.762+0000 7fbcb37fe700 1 --2- 172.21.15.52:0/292418542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb406a0d0 0x7fbcb40bc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:46:04.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.762+0000 7fbcb3fff700 1 --2- 172.21.15.52:0/292418542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb40b6930 0x7fbcb4147b50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fbcac009e50 tx=0x7fbcac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b6d49ac1a51bae server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:46:04.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.763+0000 7fbcb27fc700 1 -- 172.21.15.52:0/292418542 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac00e070 con 0x7fbcb40b6930 2023-06-23T18:46:04.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.763+0000 7fbcb27fc700 1 -- 172.21.15.52:0/292418542 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcac00b9c0 con 0x7fbcb40b6930 2023-06-23T18:46:04.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.763+0000 7fbcb27fc700 1 -- 172.21.15.52:0/292418542 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac00bd70 con 0x7fbcb40b6930 2023-06-23T18:46:04.770 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.763+0000 7fbcba1fb700 1 -- 172.21.15.52:0/292418542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb40b6930 msgr2=0x7fbcb4147b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:46:04.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.763+0000 7fbcba1fb700 1 --2- 172.21.15.52:0/292418542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb40b6930 0x7fbcb4147b50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fbcac009e50 tx=0x7fbcac00b330 comp rx=0 tx=0).stop 2023-06-23T18:46:04.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.763+0000 7fbcba1fb700 1 -- 172.21.15.52:0/292418542 shutdown_connections 2023-06-23T18:46:04.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.763+0000 7fbcba1fb700 1 --2- 172.21.15.52:0/292418542 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb40b6930 0x7fbcb4147b50 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:46:04.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.763+0000 7fbcba1fb700 1 --2- 172.21.15.52:0/292418542 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb406a0d0 0x7fbcb40bc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:46:04.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.763+0000 7fbcba1fb700 1 -- 172.21.15.52:0/292418542 >> 172.21.15.52:0/292418542 conn(0x7fbcb406bb20 msgr2=0x7fbcb406bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:46:04.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.763+0000 7fbcba1fb700 1 -- 172.21.15.52:0/292418542 shutdown_connections 2023-06-23T18:46:04.771 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.763+0000 7fbcba1fb700 1 -- 172.21.15.52:0/292418542 wait complete. 2023-06-23T18:46:04.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.764+0000 7fbcba1fb700 1 Processor -- start 2023-06-23T18:46:04.773 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.765+0000 7fbcba1fb700 1 -- start start 2023-06-23T18:46:04.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.765+0000 7fbcba1fb700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb406a0d0 0x7fbcb40b9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:46:04.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.765+0000 7fbcba1fb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb40b6930 0x7fbcb414a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:46:04.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.765+0000 7fbcba1fb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb40b7540 0x7fbcb4148b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:46:04.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.765+0000 7fbcba1fb700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb414af30 con 0x7fbcb406a0d0 2023-06-23T18:46:04.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.765+0000 7fbcba1fb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb4149c10 con 0x7fbcb40b6930 2023-06-23T18:46:04.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.765+0000 7fbcba1fb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb413d5f0 con 0x7fbcb40b7540 2023-06-23T18:46:04.774 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.765+0000 7fbcb37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb406a0d0 0x7fbcb40b9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:46:04.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.765+0000 7fbcb37fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb406a0d0 0x7fbcb40b9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59230/0 (socket says 172.21.15.52:59230) 2023-06-23T18:46:04.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.765+0000 7fbcb37fe700 1 -- 172.21.15.52:0/3910229858 learned_addr learned my addr 172.21.15.52:0/3910229858 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:46:04.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.765+0000 7fbcb2ffd700 1 --2- 172.21.15.52:0/3910229858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb40b6930 0x7fbcb414a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:46:04.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.765+0000 7fbcb3fff700 1 --2- 172.21.15.52:0/3910229858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb40b7540 0x7fbcb4148b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:46:04.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.766+0000 7fbcb37fe700 1 -- 172.21.15.52:0/3910229858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb40b7540 msgr2=0x7fbcb4148b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:46:04.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.766+0000 7fbcb37fe700 1 --2- 172.21.15.52:0/3910229858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb40b7540 0x7fbcb4148b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:46:04.775 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.766+0000 7fbcb37fe700 1 -- 172.21.15.52:0/3910229858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb40b6930 msgr2=0x7fbcb414a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:46:04.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.766+0000 7fbcb37fe700 1 --2- 172.21.15.52:0/3910229858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb40b6930 0x7fbcb414a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:46:04.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.766+0000 7fbcb37fe700 1 -- 172.21.15.52:0/3910229858 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcac009b30 con 0x7fbcb406a0d0 2023-06-23T18:46:04.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.766+0000 7fbcb2ffd700 1 --2- 172.21.15.52:0/3910229858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb40b6930 0x7fbcb414a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:46:04.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.766+0000 7fbcb37fe700 1 --2- 172.21.15.52:0/3910229858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb406a0d0 0x7fbcb40b9250 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbca400e840 tx=0x7fbca400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:46:04.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.766+0000 7fbc9bfff700 1 -- 172.21.15.52:0/3910229858 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca4013610 con 0x7fbcb406a0d0 2023-06-23T18:46:04.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.766+0000 7fbc9bfff700 1 -- 172.21.15.52:0/3910229858 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca4013770 con 0x7fbcb406a0d0 2023-06-23T18:46:04.776 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.766+0000 7fbcba1fb700 1 -- 172.21.15.52:0/3910229858 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb40b5ce0 con 0x7fbcb406a0d0 2023-06-23T18:46:04.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.766+0000 7fbc9bfff700 1 -- 172.21.15.52:0/3910229858 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca4013b20 con 0x7fbcb406a0d0 2023-06-23T18:46:04.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.766+0000 7fbcba1fb700 1 -- 172.21.15.52:0/3910229858 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb41e03b0 con 0x7fbcb406a0d0 2023-06-23T18:46:04.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.767+0000 7fbcba1fb700 1 -- 172.21.15.52:0/3910229858 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb40a6800 con 0x7fbcb406a0d0 2023-06-23T18:46:04.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.768+0000 7fbc9bfff700 1 -- 172.21.15.52:0/3910229858 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbca4013c80 con 0x7fbcb406a0d0 2023-06-23T18:46:04.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.768+0000 7fbc9bfff700 1 --2- 172.21.15.52:0/3910229858 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fbca006ace0 0x7fbca006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:46:04.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.768+0000 7fbc9bfff700 1 -- 172.21.15.52:0/3910229858 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbca4088fa0 con 0x7fbcb406a0d0 2023-06-23T18:46:04.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.768+0000 7fbcb2ffd700 1 --2- 172.21.15.52:0/3910229858 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fbca006ace0 0x7fbca006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:46:04.777 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.769+0000 7fbcb2ffd700 1 --2- 172.21.15.52:0/3910229858 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fbca006ace0 0x7fbca006d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbcb41441b0 tx=0x7fbca8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:46:04.778 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:04.773+0000 7fbc9bfff700 1 -- 172.21.15.52:0/3910229858 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbca4057b70 con 0x7fbcb406a0d0 2023-06-23T18:46:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.053+0000 7fbcba1fb700 1 -- 172.21.15.52:0/3910229858 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fbcb404e1d0 con 0x7fbcb406a0d0 2023-06-23T18:46:05.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.053+0000 7fbc9bfff700 1 -- 172.21.15.52:0/3910229858 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1268 (secure 0 0 0) 0x7fbca4021510 con 0x7fbcb406a0d0 2023-06-23T18:46:05.058 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:46:05.059 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":1,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","modified":"2023-06-23T18:43:59.617637Z","created":"2023-06-23T18:43:59.617637Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3301","nonce":0},{"type":"v1","addr":"172.21.15.89:6790","nonce":0}]},"addr":"172.21.15.89:6790/0","public_addr":"172.21.15.89:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-06-23T18:46:05.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.055+0000 7fbcba1fb700 1 -- 172.21.15.52:0/3910229858 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fbca006ace0 msgr2=0x7fbca006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:46:05.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.055+0000 7fbcba1fb700 1 --2- 172.21.15.52:0/3910229858 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fbca006ace0 0x7fbca006d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbcb41441b0 tx=0x7fbca8009040 comp rx=0 tx=0).stop 2023-06-23T18:46:05.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.055+0000 7fbcba1fb700 1 -- 172.21.15.52:0/3910229858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb406a0d0 msgr2=0x7fbcb40b9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:46:05.060 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.055+0000 7fbcba1fb700 1 --2- 172.21.15.52:0/3910229858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb406a0d0 0x7fbcb40b9250 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbca400e840 tx=0x7fbca400eb50 comp rx=0 tx=0).stop 2023-06-23T18:46:05.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.055+0000 7fbcba1fb700 1 -- 172.21.15.52:0/3910229858 shutdown_connections 2023-06-23T18:46:05.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.055+0000 7fbcba1fb700 1 --2- 172.21.15.52:0/3910229858 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fbca006ace0 0x7fbca006d190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:46:05.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.055+0000 7fbcba1fb700 1 --2- 172.21.15.52:0/3910229858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbcb40b7540 0x7fbcb4148b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:46:05.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.055+0000 7fbcba1fb700 1 --2- 172.21.15.52:0/3910229858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbcb406a0d0 0x7fbcb40b9250 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:46:05.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.055+0000 7fbcba1fb700 1 --2- 172.21.15.52:0/3910229858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcb40b6930 0x7fbcb414a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:46:05.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.055+0000 7fbcba1fb700 1 -- 172.21.15.52:0/3910229858 >> 172.21.15.52:0/3910229858 conn(0x7fbcb406bb20 msgr2=0x7fbcb4146cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:46:05.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.055+0000 7fbcba1fb700 1 -- 172.21.15.52:0/3910229858 shutdown_connections 2023-06-23T18:46:05.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.055+0000 7fbcba1fb700 1 -- 172.21.15.52:0/3910229858 wait complete. 2023-06-23T18:46:05.062 INFO:teuthology.orchestra.run.smithi052.stderr:dumped monmap epoch 1 2023-06-23T18:46:05.072 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-06-23T18:46:05.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.194+0000 7fb107ece700 1 Processor -- start 2023-06-23T18:46:05.199 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.194+0000 7fb107ece700 1 -- start start 2023-06-23T18:46:05.202 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.195+0000 7fb107ece700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb100071c50 0x7fb100152c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:46:05.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.195+0000 7fb107ece700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1000b8fb0 con 0x7fb1000b7c70 2023-06-23T18:46:05.203 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.195+0000 7fb107ece700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1000b8b20 con 0x7fb10006c1f0 2023-06-23T18:46:05.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.195+0000 7fb107ece700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1000b9b20 con 0x7fb100071c50 2023-06-23T18:46:05.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.195+0000 7fb105469700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fb1000b7c70 0x7fb100071540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:50808/0 (socket says 172.21.15.52:50808) 2023-06-23T18:46:05.204 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.195+0000 7fb105469700 1 -- 172.21.15.52:0/2792683547 learned_addr learned my addr 172.21.15.52:0/2792683547 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:46:05.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.195+0000 7fb10646b700 1 --2- 172.21.15.52:0/2792683547 >> v2:172.21.15.89:3300/0 conn(0x7fb100071c50 0x7fb100152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:46:05.205 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb104c68700 1 -- 172.21.15.52:0/2792683547 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2500478643 0 0) 0x7fb1000b8fb0 con 0x7fb1000b7c70 2023-06-23T18:46:05.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb104c68700 1 -- 172.21.15.52:0/2792683547 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0ec0035b0 con 0x7fb1000b7c70 2023-06-23T18:46:05.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb104c68700 1 -- 172.21.15.52:0/2792683547 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 690334529 0 0) 0x7fb1000b8b20 con 0x7fb10006c1f0 2023-06-23T18:46:05.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb104c68700 1 -- 172.21.15.52:0/2792683547 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1000b8fb0 con 0x7fb10006c1f0 2023-06-23T18:46:05.206 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb104c68700 1 -- 172.21.15.52:0/2792683547 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2227560986 0 0) 0x7fb0ec0035b0 con 0x7fb1000b7c70 2023-06-23T18:46:05.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb104c68700 1 -- 172.21.15.52:0/2792683547 >> v2:172.21.15.89:3300/0 conn(0x7fb100071c50 msgr2=0x7fb100152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:46:05.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb104c68700 1 --2- 172.21.15.52:0/2792683547 >> v2:172.21.15.89:3300/0 conn(0x7fb100071c50 0x7fb100152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:46:05.207 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb104c68700 1 -- 172.21.15.52:0/2792683547 >> v1:172.21.15.89:6789/0 conn(0x7fb10006c1f0 legacy=0x7fb1001473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:46:05.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb104c68700 1 -- 172.21.15.52:0/2792683547 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1000b49b0 con 0x7fb1000b7c70 2023-06-23T18:46:05.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb104c68700 1 -- 172.21.15.52:0/2792683547 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7fb0f0001670 con 0x7fb1000b7c70 2023-06-23T18:46:05.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb104c68700 1 -- 172.21.15.52:0/2792683547 >> v1:172.21.15.52:6789/0 conn(0x7fb1000b7c70 legacy=0x7fb100071540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:46:05.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb104c68700 1 --2- 172.21.15.52:0/2792683547 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0ec003b90 0x7fb0ec003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:46:05.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb104c68700 1 --2- 172.21.15.52:0/2792683547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0ec004850 0x7fb0ec004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:46:05.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb104c68700 1 --2- 172.21.15.52:0/2792683547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0ec005200 0x7fb0ec00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:46:05.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb104c68700 1 -- 172.21.15.52:0/2792683547 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1000b9b20 con 0x7fb0ec004850 2023-06-23T18:46:05.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb104c68700 1 -- 172.21.15.52:0/2792683547 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec00c110 con 0x7fb0ec005200 2023-06-23T18:46:05.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb104c68700 1 -- 172.21.15.52:0/2792683547 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec00c2d0 con 0x7fb0ec003b90 2023-06-23T18:46:05.210 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb105469700 1 --2- 172.21.15.52:0/2792683547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0ec004850 0x7fb0ec004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:46:05.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb10646b700 1 --2- 172.21.15.52:0/2792683547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0ec005200 0x7fb0ec00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:46:05.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb105c6a700 1 --2- 172.21.15.52:0/2792683547 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0ec003b90 0x7fb0ec003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:46:05.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb105469700 1 -- 172.21.15.52:0/2792683547 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0ec003b90 msgr2=0x7fb0ec003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:46:05.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb105469700 1 --2- 172.21.15.52:0/2792683547 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0ec003b90 0x7fb0ec003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:46:05.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb105469700 1 -- 172.21.15.52:0/2792683547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0ec005200 msgr2=0x7fb0ec00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:46:05.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb105469700 1 --2- 172.21.15.52:0/2792683547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0ec005200 0x7fb0ec00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:46:05.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb10646b700 1 -- 172.21.15.52:0/2792683547 reap_dead start 2023-06-23T18:46:05.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb105469700 1 -- 172.21.15.52:0/2792683547 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ec0035b0 con 0x7fb0ec004850 2023-06-23T18:46:05.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.196+0000 7fb105469700 1 --2- 172.21.15.52:0/2792683547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0ec004850 0x7fb0ec004cc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0001eb0 tx=0x7fb0ec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea279bfb74488b85 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:46:05.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.197+0000 7fb104c68700 1 -- 172.21.15.52:0/2792683547 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f000cce0 con 0x7fb0ec004850 2023-06-23T18:46:05.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.197+0000 7fb104c68700 1 -- 172.21.15.52:0/2792683547 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f000ce60 con 0x7fb0ec004850 2023-06-23T18:46:05.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.197+0000 7fb104c68700 1 -- 172.21.15.52:0/2792683547 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f0005ba0 con 0x7fb0ec004850 2023-06-23T18:46:05.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.197+0000 7fb107ece700 1 -- 172.21.15.52:0/2792683547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0ec004850 msgr2=0x7fb0ec004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:46:05.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.197+0000 7fb107ece700 1 --2- 172.21.15.52:0/2792683547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0ec004850 0x7fb0ec004cc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0001eb0 tx=0x7fb0ec005880 comp rx=0 tx=0).stop 2023-06-23T18:46:05.214 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.197+0000 7fb107ece700 1 -- 172.21.15.52:0/2792683547 shutdown_connections 2023-06-23T18:46:05.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.197+0000 7fb107ece700 1 --2- 172.21.15.52:0/2792683547 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0ec004850 0x7fb0ec004cc0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:46:05.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.197+0000 7fb107ece700 1 -- 172.21.15.52:0/2792683547 >> 172.21.15.52:0/2792683547 conn(0x7fb1000bdf30 msgr2=0x7fb1000b9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:46:05.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.197+0000 7fb107ece700 1 -- 172.21.15.52:0/2792683547 shutdown_connections 2023-06-23T18:46:05.215 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.197+0000 7fb107ece700 1 -- 172.21.15.52:0/2792683547 wait complete. 2023-06-23T18:46:05.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.198+0000 7fb107ece700 1 Processor -- start 2023-06-23T18:46:05.220 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.198+0000 7fb107ece700 1 -- start start 2023-06-23T18:46:05.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.199+0000 7fb107ece700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0ec004850 0x7fb1001499c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:46:05.221 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.199+0000 7fb107ece700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb10014b490 0x7fb1001db260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:46:05.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.199+0000 7fb107ece700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1001db7a0 0x7fb1000b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:46:05.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.199+0000 7fb107ece700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb100149f00 con 0x7fb1001db7a0 2023-06-23T18:46:05.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.199+0000 7fb107ece700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10014ae00 con 0x7fb10014b490 2023-06-23T18:46:05.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.199+0000 7fb107ece700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb100140db0 con 0x7fb0ec004850 2023-06-23T18:46:05.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.199+0000 7fb10646b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1001db7a0 0x7fb1000b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:46:05.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.199+0000 7fb10646b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1001db7a0 0x7fb1000b3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:37062/0 (socket says 172.21.15.52:37062) 2023-06-23T18:46:05.222 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.199+0000 7fb10646b700 1 -- 172.21.15.52:0/2641443680 learned_addr learned my addr 172.21.15.52:0/2641443680 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:46:05.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.199+0000 7fb105469700 1 --2- 172.21.15.52:0/2641443680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb10014b490 0x7fb1001db260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:46:05.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.199+0000 7fb105c6a700 1 --2- 172.21.15.52:0/2641443680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0ec004850 0x7fb1001499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:46:05.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.199+0000 7fb10646b700 1 -- 172.21.15.52:0/2641443680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0ec004850 msgr2=0x7fb1001499c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:46:05.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.199+0000 7fb10646b700 1 --2- 172.21.15.52:0/2641443680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0ec004850 0x7fb1001499c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:46:05.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.199+0000 7fb10646b700 1 -- 172.21.15.52:0/2641443680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb10014b490 msgr2=0x7fb1001db260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:46:05.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.199+0000 7fb10646b700 1 --2- 172.21.15.52:0/2641443680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb10014b490 0x7fb1001db260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:46:05.223 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.199+0000 7fb10646b700 1 -- 172.21.15.52:0/2641443680 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb100149400 con 0x7fb1001db7a0 2023-06-23T18:46:05.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.199+0000 7fb105469700 1 --2- 172.21.15.52:0/2641443680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb10014b490 0x7fb1001db260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:46:05.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.199+0000 7fb105c6a700 1 --2- 172.21.15.52:0/2641443680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0ec004850 0x7fb1001499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T18:46:05.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.200+0000 7fb10646b700 1 --2- 172.21.15.52:0/2641443680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1001db7a0 0x7fb1000b3160 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb10014b970 tx=0x7fb0f8011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:46:05.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.200+0000 7fb0f67fc700 1 -- 172.21.15.52:0/2641443680 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f800e040 con 0x7fb1001db7a0 2023-06-23T18:46:05.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.200+0000 7fb0f67fc700 1 -- 172.21.15.52:0/2641443680 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f800f040 con 0x7fb1001db7a0 2023-06-23T18:46:05.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.200+0000 7fb107ece700 1 -- 172.21.15.52:0/2641443680 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb100141900 con 0x7fb1001db7a0 2023-06-23T18:46:05.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.200+0000 7fb0f67fc700 1 -- 172.21.15.52:0/2641443680 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f800fdb0 con 0x7fb1001db7a0 2023-06-23T18:46:05.224 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.200+0000 7fb107ece700 1 -- 172.21.15.52:0/2641443680 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb100142100 con 0x7fb1001db7a0 2023-06-23T18:46:05.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.201+0000 7fb107ece700 1 -- 172.21.15.52:0/2641443680 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10004e1d0 con 0x7fb1001db7a0 2023-06-23T18:46:05.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.201+0000 7fb0f67fc700 1 -- 172.21.15.52:0/2641443680 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb0f8015430 con 0x7fb1001db7a0 2023-06-23T18:46:05.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.202+0000 7fb0f67fc700 1 --2- 172.21.15.52:0/2641443680 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fb0e406ad10 0x7fb0e406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:46:05.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.202+0000 7fb0f67fc700 1 -- 172.21.15.52:0/2641443680 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb0f8089d50 con 0x7fb1001db7a0 2023-06-23T18:46:05.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.202+0000 7fb105c6a700 1 --2- 172.21.15.52:0/2641443680 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fb0e406ad10 0x7fb0e406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:46:05.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.202+0000 7fb105c6a700 1 --2- 172.21.15.52:0/2641443680 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fb0e406ad10 0x7fb0e406d1c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc007fd0 tx=0x7fb0fc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:46:05.225 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.206+0000 7fb0f67fc700 1 -- 172.21.15.52:0/2641443680 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb0f808d030 con 0x7fb1001db7a0 2023-06-23T18:46:05.488 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.484+0000 7fb107ece700 1 -- 172.21.15.52:0/2641443680 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7fb1000b46f0 con 0x7fb1001db7a0 2023-06-23T18:46:05.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.484+0000 7fb0f67fc700 1 -- 172.21.15.52:0/2641443680 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) v1 ==== 92+0+63 (secure 0 0 0) 0x7fb0f8058920 con 0x7fb1001db7a0 2023-06-23T18:46:05.490 INFO:teuthology.orchestra.run.smithi052.stdout:[client.admin] 2023-06-23T18:46:05.490 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDv55Vk7zkJNRAAYA/HBsuOH1+OlGB5HbXC3Q== 2023-06-23T18:46:05.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.486+0000 7fb107ece700 1 -- 172.21.15.52:0/2641443680 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fb0e406ad10 msgr2=0x7fb0e406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:46:05.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.486+0000 7fb107ece700 1 --2- 172.21.15.52:0/2641443680 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fb0e406ad10 0x7fb0e406d1c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc007fd0 tx=0x7fb0fc009040 comp rx=0 tx=0).stop 2023-06-23T18:46:05.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.486+0000 7fb107ece700 1 -- 172.21.15.52:0/2641443680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1001db7a0 msgr2=0x7fb1000b3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:46:05.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.486+0000 7fb107ece700 1 --2- 172.21.15.52:0/2641443680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1001db7a0 0x7fb1000b3160 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb10014b970 tx=0x7fb0f8011f80 comp rx=0 tx=0).stop 2023-06-23T18:46:05.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.486+0000 7fb107ece700 1 -- 172.21.15.52:0/2641443680 shutdown_connections 2023-06-23T18:46:05.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.486+0000 7fb107ece700 1 --2- 172.21.15.52:0/2641443680 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fb0e406ad10 0x7fb0e406d1c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:46:05.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.486+0000 7fb107ece700 1 --2- 172.21.15.52:0/2641443680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb1001db7a0 0x7fb1000b3160 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:46:05.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.486+0000 7fb107ece700 1 --2- 172.21.15.52:0/2641443680 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0ec004850 0x7fb1001499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:46:05.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.486+0000 7fb107ece700 1 --2- 172.21.15.52:0/2641443680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb10014b490 0x7fb1001db260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:46:05.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.486+0000 7fb107ece700 1 -- 172.21.15.52:0/2641443680 >> 172.21.15.52:0/2641443680 conn(0x7fb1000bdf30 msgr2=0x7fb1000b9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:46:05.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.487+0000 7fb107ece700 1 -- 172.21.15.52:0/2641443680 shutdown_connections 2023-06-23T18:46:05.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:46:05.487+0000 7fb107ece700 1 -- 172.21.15.52:0/2641443680 wait complete. 2023-06-23T18:46:05.503 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-06-23T18:46:05.504 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/tmp/tmp.d43oagwOcAxfstests-dev/local.config 2023-06-23T18:46:05.574 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.52:6789:/test export TEST_DIR=/tmp/tmp.HeZTFPO0mrtest export SCRATCH_DEV=172.21.15.52:6789:/scratch export SCRATCH_MNT=/tmp/tmp.Y7KypOYmkCscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQDv55Vk7zkJNRAAYA/HBsuOH1+OlGB5HbXC3Q==" 2023-06-23T18:46:05.575 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-06-23T18:46:05.575 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/tmp/tmp.d43oagwOcAxfstests-dev/ceph.exclude 2023-06-23T18:46:05.686 DEBUG:teuthology.orchestra.run.smithi158:> (cd /tmp/tmp.d43oagwOcAxfstests-dev && exec sudo make) 2023-06-23T18:46:05.816 INFO:teuthology.orchestra.run.smithi158.stdout:libtoolize -cfi 2023-06-23T18:46:06.357 INFO:teuthology.orchestra.run.smithi158.stdout:libtoolize: putting auxiliary files in '.'. 2023-06-23T18:46:06.358 INFO:teuthology.orchestra.run.smithi158.stdout:libtoolize: copying file './config.guess' 2023-06-23T18:46:06.368 INFO:teuthology.orchestra.run.smithi158.stdout:libtoolize: copying file './config.sub' 2023-06-23T18:46:06.379 INFO:teuthology.orchestra.run.smithi158.stdout:libtoolize: copying file './install-sh' 2023-06-23T18:46:06.390 INFO:teuthology.orchestra.run.smithi158.stdout:libtoolize: copying file './ltmain.sh' 2023-06-23T18:46:06.451 INFO:teuthology.orchestra.run.smithi158.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-06-23T18:46:06.452 INFO:teuthology.orchestra.run.smithi158.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-06-23T18:46:06.464 INFO:teuthology.orchestra.run.smithi158.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-06-23T18:46:06.476 INFO:teuthology.orchestra.run.smithi158.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-06-23T18:46:06.489 INFO:teuthology.orchestra.run.smithi158.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-06-23T18:46:06.503 INFO:teuthology.orchestra.run.smithi158.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-06-23T18:46:06.522 INFO:teuthology.orchestra.run.smithi158.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-06-23T18:46:06.525 INFO:teuthology.orchestra.run.smithi158.stdout:cp include/install-sh . 2023-06-23T18:46:06.528 INFO:teuthology.orchestra.run.smithi158.stdout:aclocal -I m4 2023-06-23T18:46:07.811 INFO:teuthology.orchestra.run.smithi158.stdout:autoheader 2023-06-23T18:46:08.205 INFO:teuthology.orchestra.run.smithi158.stdout:autoconf 2023-06-23T18:46:08.410 INFO:teuthology.orchestra.run.smithi158.stdout:./configure \ 2023-06-23T18:46:08.411 INFO:teuthology.orchestra.run.smithi158.stdout: --libexecdir=/usr/lib \ 2023-06-23T18:46:08.411 INFO:teuthology.orchestra.run.smithi158.stdout: --exec_prefix=/var/lib 2023-06-23T18:46:09.004 INFO:teuthology.orchestra.run.smithi158.stdout:checking build system type... x86_64-pc-linux-gnu 2023-06-23T18:46:09.005 INFO:teuthology.orchestra.run.smithi158.stdout:checking host system type... x86_64-pc-linux-gnu 2023-06-23T18:46:09.008 INFO:teuthology.orchestra.run.smithi158.stdout:checking how to print strings... printf 2023-06-23T18:46:09.009 INFO:teuthology.orchestra.run.smithi158.stdout:checking for gcc... gcc 2023-06-23T18:46:09.195 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether the C compiler works... yes 2023-06-23T18:46:09.195 INFO:teuthology.orchestra.run.smithi158.stdout:checking for C compiler default output file name... a.out 2023-06-23T18:46:09.245 INFO:teuthology.orchestra.run.smithi158.stdout:checking for suffix of executables... 2023-06-23T18:46:09.322 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether we are cross compiling... no 2023-06-23T18:46:09.359 INFO:teuthology.orchestra.run.smithi158.stdout:checking for suffix of object files... o 2023-06-23T18:46:09.393 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether we are using the GNU C compiler... yes 2023-06-23T18:46:09.428 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether gcc accepts -g... yes 2023-06-23T18:46:09.477 INFO:teuthology.orchestra.run.smithi158.stdout:checking for gcc option to accept ISO C89... none needed 2023-06-23T18:46:09.484 INFO:teuthology.orchestra.run.smithi158.stdout:checking for a sed that does not truncate output... /bin/sed 2023-06-23T18:46:09.489 INFO:teuthology.orchestra.run.smithi158.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-06-23T18:46:09.492 INFO:teuthology.orchestra.run.smithi158.stdout:checking for egrep... /bin/grep -E 2023-06-23T18:46:09.495 INFO:teuthology.orchestra.run.smithi158.stdout:checking for fgrep... /bin/grep -F 2023-06-23T18:46:09.503 INFO:teuthology.orchestra.run.smithi158.stdout:checking for ld used by gcc... /bin/ld 2023-06-23T18:46:09.507 INFO:teuthology.orchestra.run.smithi158.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-06-23T18:46:09.515 INFO:teuthology.orchestra.run.smithi158.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-06-23T18:46:09.555 INFO:teuthology.orchestra.run.smithi158.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-06-23T18:46:09.555 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether ln -s works... yes 2023-06-23T18:46:09.571 INFO:teuthology.orchestra.run.smithi158.stdout:checking the maximum length of command line arguments... 1572864 2023-06-23T18:46:09.577 INFO:teuthology.orchestra.run.smithi158.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-06-23T18:46:09.577 INFO:teuthology.orchestra.run.smithi158.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-06-23T18:46:09.577 INFO:teuthology.orchestra.run.smithi158.stdout:checking for /bin/ld option to reload object files... -r 2023-06-23T18:46:09.578 INFO:teuthology.orchestra.run.smithi158.stdout:checking for objdump... objdump 2023-06-23T18:46:09.578 INFO:teuthology.orchestra.run.smithi158.stdout:checking how to recognize dependent libraries... pass_all 2023-06-23T18:46:09.579 INFO:teuthology.orchestra.run.smithi158.stdout:checking for dlltool... no 2023-06-23T18:46:09.579 INFO:teuthology.orchestra.run.smithi158.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-06-23T18:46:09.579 INFO:teuthology.orchestra.run.smithi158.stdout:checking for ar... ar 2023-06-23T18:46:09.829 INFO:teuthology.orchestra.run.smithi158.stdout:checking for archiver @FILE support... @ 2023-06-23T18:46:09.829 INFO:teuthology.orchestra.run.smithi158.stdout:checking for strip... strip 2023-06-23T18:46:09.830 INFO:teuthology.orchestra.run.smithi158.stdout:checking for ranlib... ranlib 2023-06-23T18:46:09.830 INFO:teuthology.orchestra.run.smithi158.stdout:checking for gawk... gawk 2023-06-23T18:46:09.939 INFO:teuthology.orchestra.run.smithi158.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-06-23T18:46:09.942 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sysroot... no 2023-06-23T18:46:09.950 INFO:teuthology.orchestra.run.smithi158.stdout:checking for a working dd... /bin/dd 2023-06-23T18:46:09.956 INFO:teuthology.orchestra.run.smithi158.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-06-23T18:46:09.986 INFO:teuthology.orchestra.run.smithi158.stdout:checking for mt... no 2023-06-23T18:46:09.991 INFO:teuthology.orchestra.run.smithi158.stdout:checking if : is a manifest tool... no 2023-06-23T18:46:10.061 INFO:teuthology.orchestra.run.smithi158.stdout:checking how to run the C preprocessor... gcc -E 2023-06-23T18:46:10.301 INFO:teuthology.orchestra.run.smithi158.stdout:checking for ANSI C header files... yes 2023-06-23T18:46:10.344 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sys/types.h... yes 2023-06-23T18:46:10.399 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sys/stat.h... yes 2023-06-23T18:46:10.451 INFO:teuthology.orchestra.run.smithi158.stdout:checking for stdlib.h... yes 2023-06-23T18:46:10.504 INFO:teuthology.orchestra.run.smithi158.stdout:checking for string.h... yes 2023-06-23T18:46:10.557 INFO:teuthology.orchestra.run.smithi158.stdout:checking for memory.h... yes 2023-06-23T18:46:10.610 INFO:teuthology.orchestra.run.smithi158.stdout:checking for strings.h... yes 2023-06-23T18:46:10.665 INFO:teuthology.orchestra.run.smithi158.stdout:checking for inttypes.h... yes 2023-06-23T18:46:10.719 INFO:teuthology.orchestra.run.smithi158.stdout:checking for stdint.h... yes 2023-06-23T18:46:10.778 INFO:teuthology.orchestra.run.smithi158.stdout:checking for unistd.h... yes 2023-06-23T18:46:10.834 INFO:teuthology.orchestra.run.smithi158.stdout:checking for dlfcn.h... yes 2023-06-23T18:46:10.842 INFO:teuthology.orchestra.run.smithi158.stdout:checking for objdir... .libs 2023-06-23T18:46:10.976 INFO:teuthology.orchestra.run.smithi158.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-06-23T18:46:10.976 INFO:teuthology.orchestra.run.smithi158.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-06-23T18:46:11.015 INFO:teuthology.orchestra.run.smithi158.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-06-23T18:46:11.053 INFO:teuthology.orchestra.run.smithi158.stdout:checking if gcc static flag -static works... no 2023-06-23T18:46:11.107 INFO:teuthology.orchestra.run.smithi158.stdout:checking if gcc supports -c -o file.o... yes 2023-06-23T18:46:11.107 INFO:teuthology.orchestra.run.smithi158.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-06-23T18:46:11.122 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-06-23T18:46:11.171 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether -lc should be explicitly linked in... no 2023-06-23T18:46:11.266 INFO:teuthology.orchestra.run.smithi158.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-06-23T18:46:11.267 INFO:teuthology.orchestra.run.smithi158.stdout:checking how to hardcode library paths into programs... immediate 2023-06-23T18:46:11.276 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether stripping libraries is possible... yes 2023-06-23T18:46:11.277 INFO:teuthology.orchestra.run.smithi158.stdout:checking if libtool supports shared libraries... yes 2023-06-23T18:46:11.277 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether to build shared libraries... yes 2023-06-23T18:46:11.277 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether to build static libraries... yes 2023-06-23T18:46:11.288 INFO:teuthology.orchestra.run.smithi158.stdout:checking for gcc... (cached) gcc 2023-06-23T18:46:11.327 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-06-23T18:46:11.327 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether gcc accepts -g... (cached) yes 2023-06-23T18:46:11.327 INFO:teuthology.orchestra.run.smithi158.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-06-23T18:46:11.328 INFO:teuthology.orchestra.run.smithi158.stdout:checking for gmake... /usr/bin/gmake 2023-06-23T18:46:11.328 INFO:teuthology.orchestra.run.smithi158.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-06-23T18:46:11.329 INFO:teuthology.orchestra.run.smithi158.stdout:checking for tar... /bin/tar 2023-06-23T18:46:11.329 INFO:teuthology.orchestra.run.smithi158.stdout:checking for gzip... /bin/gzip 2023-06-23T18:46:11.345 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether gcc -MM is supported... yes 2023-06-23T18:46:11.345 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sort... /bin/sort 2023-06-23T18:46:11.345 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether ln -s works... yes 2023-06-23T18:46:11.346 INFO:teuthology.orchestra.run.smithi158.stdout:checking for rpm... /bin/rpm 2023-06-23T18:46:11.354 INFO:teuthology.orchestra.run.smithi158.stdout:checking for rpmbuild... no 2023-06-23T18:46:11.448 INFO:teuthology.orchestra.run.smithi158.stdout:checking assert.h usability... yes 2023-06-23T18:46:11.464 INFO:teuthology.orchestra.run.smithi158.stdout:checking assert.h presence... yes 2023-06-23T18:46:11.464 INFO:teuthology.orchestra.run.smithi158.stdout:checking for assert.h... yes 2023-06-23T18:46:11.520 INFO:teuthology.orchestra.run.smithi158.stdout:checking bstring.h usability... no 2023-06-23T18:46:11.544 INFO:teuthology.orchestra.run.smithi158.stdout:checking bstring.h presence... no 2023-06-23T18:46:11.545 INFO:teuthology.orchestra.run.smithi158.stdout:checking for bstring.h... no 2023-06-23T18:46:11.594 INFO:teuthology.orchestra.run.smithi158.stdout:checking libgen.h usability... yes 2023-06-23T18:46:11.610 INFO:teuthology.orchestra.run.smithi158.stdout:checking libgen.h presence... yes 2023-06-23T18:46:11.610 INFO:teuthology.orchestra.run.smithi158.stdout:checking for libgen.h... yes 2023-06-23T18:46:11.673 INFO:teuthology.orchestra.run.smithi158.stdout:checking dirent.h usability... yes 2023-06-23T18:46:11.690 INFO:teuthology.orchestra.run.smithi158.stdout:checking dirent.h presence... yes 2023-06-23T18:46:11.690 INFO:teuthology.orchestra.run.smithi158.stdout:checking for dirent.h... yes 2023-06-23T18:46:11.770 INFO:teuthology.orchestra.run.smithi158.stdout:checking errno.h usability... yes 2023-06-23T18:46:11.787 INFO:teuthology.orchestra.run.smithi158.stdout:checking errno.h presence... yes 2023-06-23T18:46:11.787 INFO:teuthology.orchestra.run.smithi158.stdout:checking for errno.h... yes 2023-06-23T18:46:11.848 INFO:teuthology.orchestra.run.smithi158.stdout:checking malloc.h usability... yes 2023-06-23T18:46:11.866 INFO:teuthology.orchestra.run.smithi158.stdout:checking malloc.h presence... yes 2023-06-23T18:46:11.866 INFO:teuthology.orchestra.run.smithi158.stdout:checking for malloc.h... yes 2023-06-23T18:46:11.923 INFO:teuthology.orchestra.run.smithi158.stdout:checking uuid.h usability... no 2023-06-23T18:46:11.947 INFO:teuthology.orchestra.run.smithi158.stdout:checking uuid.h presence... no 2023-06-23T18:46:11.947 INFO:teuthology.orchestra.run.smithi158.stdout:checking for uuid.h... no 2023-06-23T18:46:12.003 INFO:teuthology.orchestra.run.smithi158.stdout:checking uuid/uuid.h usability... yes 2023-06-23T18:46:12.022 INFO:teuthology.orchestra.run.smithi158.stdout:checking uuid/uuid.h presence... yes 2023-06-23T18:46:12.023 INFO:teuthology.orchestra.run.smithi158.stdout:checking for uuid/uuid.h... yes 2023-06-23T18:46:12.079 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/uuid.h usability... no 2023-06-23T18:46:12.103 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/uuid.h presence... no 2023-06-23T18:46:12.103 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sys/uuid.h... no 2023-06-23T18:46:12.154 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/file.h usability... yes 2023-06-23T18:46:12.171 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/file.h presence... yes 2023-06-23T18:46:12.171 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sys/file.h... yes 2023-06-23T18:46:12.230 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/fcntl.h usability... yes 2023-06-23T18:46:12.246 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/fcntl.h presence... yes 2023-06-23T18:46:12.246 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sys/fcntl.h... yes 2023-06-23T18:46:12.303 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/syssgi.h usability... no 2023-06-23T18:46:12.327 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/syssgi.h presence... no 2023-06-23T18:46:12.327 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sys/syssgi.h... no 2023-06-23T18:46:12.407 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/param.h usability... yes 2023-06-23T18:46:12.428 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/param.h presence... yes 2023-06-23T18:46:12.428 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sys/param.h... yes 2023-06-23T18:46:12.442 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sys/stat.h... (cached) yes 2023-06-23T18:46:12.509 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/statvfs.h usability... yes 2023-06-23T18:46:12.525 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/statvfs.h presence... yes 2023-06-23T18:46:12.525 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sys/statvfs.h... yes 2023-06-23T18:46:12.582 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/time.h usability... yes 2023-06-23T18:46:12.599 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/time.h presence... yes 2023-06-23T18:46:12.600 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sys/time.h... yes 2023-06-23T18:46:12.664 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/ioctl.h usability... yes 2023-06-23T18:46:12.681 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/ioctl.h presence... yes 2023-06-23T18:46:12.681 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sys/ioctl.h... yes 2023-06-23T18:46:12.742 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/wait.h usability... yes 2023-06-23T18:46:12.761 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/wait.h presence... yes 2023-06-23T18:46:12.761 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sys/wait.h... yes 2023-06-23T18:46:12.779 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sys/types.h... (cached) yes 2023-06-23T18:46:12.789 INFO:teuthology.orchestra.run.smithi158.stdout:checking for strings.h... (cached) yes 2023-06-23T18:46:12.846 INFO:teuthology.orchestra.run.smithi158.stdout:checking err.h usability... yes 2023-06-23T18:46:12.862 INFO:teuthology.orchestra.run.smithi158.stdout:checking err.h presence... yes 2023-06-23T18:46:12.862 INFO:teuthology.orchestra.run.smithi158.stdout:checking for err.h... yes 2023-06-23T18:46:12.920 INFO:teuthology.orchestra.run.smithi158.stdout:checking linux/falloc.h usability... yes 2023-06-23T18:46:12.937 INFO:teuthology.orchestra.run.smithi158.stdout:checking linux/falloc.h presence... yes 2023-06-23T18:46:12.937 INFO:teuthology.orchestra.run.smithi158.stdout:checking for linux/falloc.h... yes 2023-06-23T18:46:12.993 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-06-23T18:46:13.018 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-06-23T18:46:13.018 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sys/fs/xfs_fsops.h... no 2023-06-23T18:46:13.066 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/fs/xfs_itable.h usability... no 2023-06-23T18:46:13.090 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/fs/xfs_itable.h presence... no 2023-06-23T18:46:13.090 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sys/fs/xfs_itable.h... no 2023-06-23T18:46:13.139 INFO:teuthology.orchestra.run.smithi158.stdout:checking xfs/platform_defs.h usability... no 2023-06-23T18:46:13.163 INFO:teuthology.orchestra.run.smithi158.stdout:checking xfs/platform_defs.h presence... no 2023-06-23T18:46:13.163 INFO:teuthology.orchestra.run.smithi158.stdout:checking for xfs/platform_defs.h... no 2023-06-23T18:46:13.212 INFO:teuthology.orchestra.run.smithi158.stdout:checking btrfs/ioctl.h usability... no 2023-06-23T18:46:13.236 INFO:teuthology.orchestra.run.smithi158.stdout:checking btrfs/ioctl.h presence... no 2023-06-23T18:46:13.236 INFO:teuthology.orchestra.run.smithi158.stdout:checking for btrfs/ioctl.h... no 2023-06-23T18:46:13.285 INFO:teuthology.orchestra.run.smithi158.stdout:checking cifs/ioctl.h usability... no 2023-06-23T18:46:13.309 INFO:teuthology.orchestra.run.smithi158.stdout:checking cifs/ioctl.h presence... no 2023-06-23T18:46:13.309 INFO:teuthology.orchestra.run.smithi158.stdout:checking for cifs/ioctl.h... no 2023-06-23T18:46:13.360 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/mman.h usability... yes 2023-06-23T18:46:13.377 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/mman.h presence... yes 2023-06-23T18:46:13.377 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sys/mman.h... yes 2023-06-23T18:46:13.415 INFO:teuthology.orchestra.run.smithi158.stdout:checking for xfs/xfs_log_format.h... no 2023-06-23T18:46:13.482 INFO:teuthology.orchestra.run.smithi158.stdout:checking for uuid_compare... no 2023-06-23T18:46:13.539 INFO:teuthology.orchestra.run.smithi158.stdout:checking for uuid_compare in -luuid... yes 2023-06-23T18:46:13.622 INFO:teuthology.orchestra.run.smithi158.stdout:checking for xfs/xfs.h... yes 2023-06-23T18:46:13.655 INFO:teuthology.orchestra.run.smithi158.stdout:checking for xfs/libxfs.h... no 2023-06-23T18:46:13.693 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether xlog_assign_lsn is declared... no 2023-06-23T18:46:13.745 INFO:teuthology.orchestra.run.smithi158.stdout:checking for xfs/xqm.h... yes 2023-06-23T18:46:13.825 INFO:teuthology.orchestra.run.smithi158.stdout:checking xfsctl from xfs/xfs.h... ok 2023-06-23T18:46:13.870 INFO:teuthology.orchestra.run.smithi158.stdout:checking xfs/handle.h usability... yes 2023-06-23T18:46:13.885 INFO:teuthology.orchestra.run.smithi158.stdout:checking xfs/handle.h presence... yes 2023-06-23T18:46:13.885 INFO:teuthology.orchestra.run.smithi158.stdout:checking for xfs/handle.h... yes 2023-06-23T18:46:13.945 INFO:teuthology.orchestra.run.smithi158.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-06-23T18:46:13.997 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/acl.h usability... yes 2023-06-23T18:46:14.015 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/acl.h presence... yes 2023-06-23T18:46:14.016 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sys/acl.h... yes 2023-06-23T18:46:14.071 INFO:teuthology.orchestra.run.smithi158.stdout:checking acl/libacl.h usability... yes 2023-06-23T18:46:14.089 INFO:teuthology.orchestra.run.smithi158.stdout:checking acl/libacl.h presence... yes 2023-06-23T18:46:14.089 INFO:teuthology.orchestra.run.smithi158.stdout:checking for acl/libacl.h... yes 2023-06-23T18:46:14.150 INFO:teuthology.orchestra.run.smithi158.stdout:checking for acl_init in -lacl... yes 2023-06-23T18:46:14.195 INFO:teuthology.orchestra.run.smithi158.stdout:checking gdbm-ndbm.h usability... no 2023-06-23T18:46:14.219 INFO:teuthology.orchestra.run.smithi158.stdout:checking gdbm-ndbm.h presence... no 2023-06-23T18:46:14.220 INFO:teuthology.orchestra.run.smithi158.stdout:checking for gdbm-ndbm.h... no 2023-06-23T18:46:14.262 INFO:teuthology.orchestra.run.smithi158.stdout:checking gdbm/ndbm.h usability... no 2023-06-23T18:46:14.287 INFO:teuthology.orchestra.run.smithi158.stdout:checking gdbm/ndbm.h presence... no 2023-06-23T18:46:14.287 INFO:teuthology.orchestra.run.smithi158.stdout:checking for gdbm/ndbm.h... no 2023-06-23T18:46:14.329 INFO:teuthology.orchestra.run.smithi158.stdout:checking ndbm.h usability... no 2023-06-23T18:46:14.353 INFO:teuthology.orchestra.run.smithi158.stdout:checking ndbm.h presence... no 2023-06-23T18:46:14.353 INFO:teuthology.orchestra.run.smithi158.stdout:checking for ndbm.h... no 2023-06-23T18:46:14.400 INFO:teuthology.orchestra.run.smithi158.stdout:checking libaio.h usability... yes 2023-06-23T18:46:14.422 INFO:teuthology.orchestra.run.smithi158.stdout:checking libaio.h presence... yes 2023-06-23T18:46:14.422 INFO:teuthology.orchestra.run.smithi158.stdout:checking for libaio.h... yes 2023-06-23T18:46:14.466 INFO:teuthology.orchestra.run.smithi158.stdout:checking liburing.h usability... no 2023-06-23T18:46:14.490 INFO:teuthology.orchestra.run.smithi158.stdout:checking liburing.h presence... no 2023-06-23T18:46:14.491 INFO:teuthology.orchestra.run.smithi158.stdout:checking for liburing.h... no 2023-06-23T18:46:14.533 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/capability.h usability... no 2023-06-23T18:46:14.557 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/capability.h presence... no 2023-06-23T18:46:14.558 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sys/capability.h... no 2023-06-23T18:46:14.601 INFO:teuthology.orchestra.run.smithi158.stdout:checking linux/fiemap.h usability... yes 2023-06-23T18:46:14.618 INFO:teuthology.orchestra.run.smithi158.stdout:checking linux/fiemap.h presence... yes 2023-06-23T18:46:14.618 INFO:teuthology.orchestra.run.smithi158.stdout:checking for linux/fiemap.h... yes 2023-06-23T18:46:14.678 INFO:teuthology.orchestra.run.smithi158.stdout:checking for fallocate... yes 2023-06-23T18:46:14.739 INFO:teuthology.orchestra.run.smithi158.stdout:checking for open_by_handle_at... yes 2023-06-23T18:46:14.786 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/prctl.h usability... yes 2023-06-23T18:46:14.803 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/prctl.h presence... yes 2023-06-23T18:46:14.803 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sys/prctl.h... yes 2023-06-23T18:46:14.850 INFO:teuthology.orchestra.run.smithi158.stdout:checking linux/fs.h usability... yes 2023-06-23T18:46:14.868 INFO:teuthology.orchestra.run.smithi158.stdout:checking linux/fs.h presence... yes 2023-06-23T18:46:14.868 INFO:teuthology.orchestra.run.smithi158.stdout:checking for linux/fs.h... yes 2023-06-23T18:46:14.910 INFO:teuthology.orchestra.run.smithi158.stdout:checking btrfsutil.h usability... no 2023-06-23T18:46:14.934 INFO:teuthology.orchestra.run.smithi158.stdout:checking btrfsutil.h presence... no 2023-06-23T18:46:14.935 INFO:teuthology.orchestra.run.smithi158.stdout:checking for btrfsutil.h... no 2023-06-23T18:46:14.997 INFO:teuthology.orchestra.run.smithi158.stdout:checking for copy_file_range... yes 2023-06-23T18:46:15.061 INFO:teuthology.orchestra.run.smithi158.stdout:checking for SEEK_DATA... yes 2023-06-23T18:46:15.140 INFO:teuthology.orchestra.run.smithi158.stdout:checking for BMV_OF_SHARED... yes 2023-06-23T18:46:15.205 INFO:teuthology.orchestra.run.smithi158.stdout:checking for nftw... yes 2023-06-23T18:46:15.268 INFO:teuthology.orchestra.run.smithi158.stdout:checking for RLIMIT_NOFILE... yes 2023-06-23T18:46:15.306 INFO:teuthology.orchestra.run.smithi158.stdout:checking for FIEXCHANGE_RANGE... no 2023-06-23T18:46:15.366 INFO:teuthology.orchestra.run.smithi158.stdout:checking for renameat2... yes 2023-06-23T18:46:15.428 INFO:teuthology.orchestra.run.smithi158.stdout:checking for reallocarray... yes 2023-06-23T18:46:15.460 INFO:teuthology.orchestra.run.smithi158.stdout:checking for struct mount_attr... no 2023-06-23T18:46:15.535 INFO:teuthology.orchestra.run.smithi158.stdout:checking for struct btrfs_qgroup_limit... yes 2023-06-23T18:46:15.609 INFO:teuthology.orchestra.run.smithi158.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-06-23T18:46:15.682 INFO:teuthology.orchestra.run.smithi158.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-06-23T18:46:15.756 INFO:teuthology.orchestra.run.smithi158.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-06-23T18:46:15.828 INFO:teuthology.orchestra.run.smithi158.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-06-23T18:46:15.902 INFO:teuthology.orchestra.run.smithi158.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-06-23T18:46:15.974 INFO:teuthology.orchestra.run.smithi158.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-06-23T18:46:16.028 INFO:teuthology.orchestra.run.smithi158.stdout:checking linux/btrfs.h usability... yes 2023-06-23T18:46:16.045 INFO:teuthology.orchestra.run.smithi158.stdout:checking linux/btrfs.h presence... yes 2023-06-23T18:46:16.045 INFO:teuthology.orchestra.run.smithi158.stdout:checking for linux/btrfs.h... yes 2023-06-23T18:46:16.106 INFO:teuthology.orchestra.run.smithi158.stdout:checking linux/btrfs_tree.h usability... yes 2023-06-23T18:46:16.123 INFO:teuthology.orchestra.run.smithi158.stdout:checking linux/btrfs_tree.h presence... yes 2023-06-23T18:46:16.123 INFO:teuthology.orchestra.run.smithi158.stdout:checking for linux/btrfs_tree.h... yes 2023-06-23T18:46:16.196 INFO:teuthology.orchestra.run.smithi158.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-06-23T18:46:16.224 INFO:teuthology.orchestra.run.smithi158.stdout:configure: creating ./config.status 2023-06-23T18:46:17.122 INFO:teuthology.orchestra.run.smithi158.stdout:config.status: creating include/builddefs 2023-06-23T18:46:17.151 INFO:teuthology.orchestra.run.smithi158.stdout:config.status: creating include/config.h 2023-06-23T18:46:17.173 INFO:teuthology.orchestra.run.smithi158.stdout:config.status: executing libtool commands 2023-06-23T18:46:17.252 INFO:teuthology.orchestra.run.smithi158.stdout:Building include 2023-06-23T18:46:17.259 INFO:teuthology.orchestra.run.smithi158.stdout:Building lib 2023-06-23T18:46:17.266 INFO:teuthology.orchestra.run.smithi158.stdout: [LTDEP] 2023-06-23T18:46:17.465 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] dataascii.lo 2023-06-23T18:46:17.668 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] databin.lo 2023-06-23T18:46:17.903 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] datapid.lo 2023-06-23T18:46:18.092 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] file_lock.lo 2023-06-23T18:46:18.329 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] forker.lo 2023-06-23T18:46:18.548 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] pattern.lo 2023-06-23T18:46:18.751 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] open_flags.lo 2023-06-23T18:46:18.980 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] random_range.lo 2023-06-23T18:46:19.285 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] string_to_tokens.lo 2023-06-23T18:46:19.471 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] str_to_bytes.lo 2023-06-23T18:46:19.687 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] tlibio.lo 2023-06-23T18:46:20.007 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] write_log.lo 2023-06-23T18:46:20.332 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] random.lo 2023-06-23T18:46:20.601 INFO:teuthology.orchestra.run.smithi158.stdout: [LD] 2023-06-23T18:46:20.730 INFO:teuthology.orchestra.run.smithi158.stdout:Building ltp 2023-06-23T18:46:20.736 INFO:teuthology.orchestra.run.smithi158.stdout: [DEP] 2023-06-23T18:46:20.946 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] doio 2023-06-23T18:46:21.679 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] fsstress 2023-06-23T18:46:23.051 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] fsx 2023-06-23T18:46:23.984 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] growfiles 2023-06-23T18:46:24.579 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] iogen 2023-06-23T18:46:25.027 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] aio-stress 2023-06-23T18:46:25.537 INFO:teuthology.orchestra.run.smithi158.stdout:Building src 2023-06-23T18:46:25.547 INFO:teuthology.orchestra.run.smithi158.stdout: [DEP] 2023-06-23T18:46:27.998 INFO:teuthology.orchestra.run.smithi158.stdout: [DEP] 2023-06-23T18:46:28.049 INFO:teuthology.orchestra.run.smithi158.stdout: [DEP] 2023-06-23T18:46:28.065 INFO:teuthology.orchestra.run.smithi158.stdout: [DEP] 2023-06-23T18:46:28.307 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:46:28.310 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:46:28.313 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:46:28.410 INFO:teuthology.orchestra.run.smithi158.stdout: [DEP] 2023-06-23T18:46:28.450 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] dirstress 2023-06-23T18:46:28.789 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] fill 2023-06-23T18:46:29.040 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] fill2 2023-06-23T18:46:29.368 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] getpagesize 2023-06-23T18:46:29.601 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] holes 2023-06-23T18:46:29.895 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] lstat64 2023-06-23T18:46:30.176 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] nametest 2023-06-23T18:46:30.516 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] permname 2023-06-23T18:46:30.849 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] randholes 2023-06-23T18:46:31.201 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] runas 2023-06-23T18:46:31.480 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] truncfile 2023-06-23T18:46:31.759 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] usemem 2023-06-23T18:46:32.011 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] mmapcat 2023-06-23T18:46:32.259 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] append_reader 2023-06-23T18:46:32.509 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] append_writer 2023-06-23T18:46:32.759 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] dirperf 2023-06-23T18:46:33.079 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] metaperf 2023-06-23T18:46:33.432 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] devzero 2023-06-23T18:46:33.709 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] feature 2023-06-23T18:46:34.025 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] alloc 2023-06-23T18:46:34.335 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] fault 2023-06-23T18:46:34.603 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] fstest 2023-06-23T18:46:34.939 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_access_root 2023-06-23T18:46:35.194 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] godown 2023-06-23T18:46:35.465 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] resvtest 2023-06-23T18:46:35.750 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] writemod 2023-06-23T18:46:35.993 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] writev_on_pagefault 2023-06-23T18:46:36.251 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] makeextents 2023-06-23T18:46:36.530 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] itrash 2023-06-23T18:46:36.784 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] rename 2023-06-23T18:46:37.021 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] multi_open_unlink 2023-06-23T18:46:37.286 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] unwritten_sync 2023-06-23T18:46:37.569 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] genhashnames 2023-06-23T18:46:37.852 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_holes 2023-06-23T18:46:38.098 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_mmap_writev 2023-06-23T18:46:38.344 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_truncate_cmtime 2023-06-23T18:46:38.602 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] dirhash_collide 2023-06-23T18:46:38.883 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_rename_overwrite 2023-06-23T18:46:39.122 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] holetest 2023-06-23T18:46:39.439 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_truncate_self 2023-06-23T18:46:39.679 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] af_unix 2023-06-23T18:46:39.931 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_mmap_stale_pmd 2023-06-23T18:46:40.183 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_mmap_cow_race 2023-06-23T18:46:40.449 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_mmap_fallocate 2023-06-23T18:46:40.699 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] fsync-err 2023-06-23T18:46:40.982 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_mmap_write_ro 2023-06-23T18:46:41.233 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_ext4_dax_journal_corruption 2023-06-23T18:46:41.492 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_ext4_dax_inline_corruption 2023-06-23T18:46:41.751 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_ofd_locks 2023-06-23T18:46:42.050 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_mmap_collision 2023-06-23T18:46:42.346 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] mmap-write-concurrent 2023-06-23T18:46:42.615 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_get_file_time 2023-06-23T18:46:42.861 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_create_short_dirs 2023-06-23T18:46:43.126 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_create_long_dirs 2023-06-23T18:46:43.389 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_enospc 2023-06-23T18:46:43.675 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_mmap_writev_overlap 2023-06-23T18:46:43.943 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] checkpoint_journal 2023-06-23T18:46:44.198 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] mmap-rw-fault 2023-06-23T18:46:44.475 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] allocstale 2023-06-23T18:46:44.746 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_mmap_cow_memory_failure 2023-06-23T18:46:45.016 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] fake-dump-rootino 2023-06-23T18:46:45.266 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] dio-buf-fault 2023-06-23T18:46:45.520 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfsctl 2023-06-23T18:46:45.809 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] bstat 2023-06-23T18:46:46.114 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_mtab 2023-06-23T18:46:46.399 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] getdevicesize 2023-06-23T18:46:46.639 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] preallo_rw_pattern_reader 2023-06-23T18:46:46.902 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] preallo_rw_pattern_writer 2023-06-23T18:46:47.163 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] ftrunc 2023-06-23T18:46:47.411 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] trunc 2023-06-23T18:46:47.674 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] fs_perms 2023-06-23T18:46:47.939 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] testx 2023-06-23T18:46:48.169 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] looptest 2023-06-23T18:46:48.459 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] locktest 2023-06-23T18:46:48.859 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] unwritten_mmap 2023-06-23T18:46:49.123 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] bulkstat_unlink_test 2023-06-23T18:46:49.424 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] deduperace 2023-06-23T18:46:49.719 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] bulkstat_unlink_test_modified 2023-06-23T18:46:50.017 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_dir_offset 2023-06-23T18:46:50.266 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_futimens 2023-06-23T18:46:50.506 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_immutable 2023-06-23T18:46:51.198 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] stale_handle 2023-06-23T18:46:51.470 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] pwrite_mmap_blocked 2023-06-23T18:46:51.725 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_dir_offset2 2023-06-23T18:46:52.019 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] seek_sanity_test 2023-06-23T18:46:52.525 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] seek_copy_test 2023-06-23T18:46:52.801 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_readdir_1 2023-06-23T18:46:53.050 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_readdir_2 2023-06-23T18:46:53.303 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] fsync-tester 2023-06-23T18:46:53.649 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] nsexec 2023-06-23T18:46:53.923 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] cloner 2023-06-23T18:46:54.200 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] renameat2 2023-06-23T18:46:54.467 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_getcwd 2023-06-23T18:46:54.724 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] e4compact 2023-06-23T18:46:55.023 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] test-nextquota 2023-06-23T18:46:55.295 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] punch-alternating 2023-06-23T18:46:55.567 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] attr-list-by-handle-cursor-test 2023-06-23T18:46:55.836 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] listxattr 2023-06-23T18:46:56.083 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] dio-interleaved 2023-06-23T18:46:56.343 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_dir_type 2023-06-23T18:46:56.598 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] dio-invalidate-cache 2023-06-23T18:46:56.899 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] stat_test 2023-06-23T18:46:57.291 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_encrypted_d_revalidate 2023-06-23T18:46:57.558 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] attr_replace_test 2023-06-23T18:46:57.822 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] swapon 2023-06-23T18:46:58.087 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] mkswap 2023-06-23T18:46:58.338 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_attr_corruption 2023-06-23T18:46:58.411 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:46:58.414 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:46:58.416 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:46:58.593 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_open_tmpfiles 2023-06-23T18:46:58.874 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] fscrypt-crypt-util 2023-06-23T18:46:59.587 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] bulkstat_null_ocount 2023-06-23T18:46:59.848 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] splice-test 2023-06-23T18:47:00.130 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] chprojid_fail 2023-06-23T18:47:00.395 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] detached_mounts_propagation 2023-06-23T18:47:00.681 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] ext4_resize 2023-06-23T18:47:00.929 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_readdir_3 2023-06-23T18:47:01.224 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] splice2pipe 2023-06-23T18:47:01.486 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] uuid_ioctl 2023-06-23T18:47:01.743 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] fiemap-tester 2023-06-23T18:47:02.111 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_stripealign 2023-06-23T18:47:02.365 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] open_by_handle 2023-06-23T18:47:02.716 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] t_mmap_dio 2023-06-23T18:47:02.978 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfsfind 2023-06-23T18:47:03.275 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] fssum 2023-06-23T18:47:03.799 INFO:teuthology.orchestra.run.smithi158.stdout:Building log-writes 2023-06-23T18:47:03.810 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] replay-log 2023-06-23T18:47:04.224 INFO:teuthology.orchestra.run.smithi158.stdout:Building perf 2023-06-23T18:47:04.232 INFO:teuthology.orchestra.run.smithi158.stdout:Building aio-dio-regress 2023-06-23T18:47:04.243 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] aio-dio-append-write-fallocate-race 2023-06-23T18:47:04.520 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] aio-dio-fcntl-race 2023-06-23T18:47:04.788 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] aio-dio-subblock-eof-read 2023-06-23T18:47:05.036 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] aio-dio-append-write-read-race 2023-06-23T18:47:05.316 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] aio-dio-invalidate-readahead 2023-06-23T18:47:05.585 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] aio-dio-hole-filling-race 2023-06-23T18:47:05.839 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-06-23T18:47:06.078 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] aio-last-ref-held-by-io 2023-06-23T18:47:06.356 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] aio-dio-cycle-write 2023-06-23T18:47:06.644 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] aio-dio-extend-stat 2023-06-23T18:47:06.913 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-06-23T18:47:07.149 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] aio-dio-invalidate-failure 2023-06-23T18:47:07.412 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] aiodio_sparse2 2023-06-23T18:47:07.727 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] aiocp 2023-06-23T18:47:08.053 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] aio-dio-cow-race 2023-06-23T18:47:08.311 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] aio-dio-write-verify 2023-06-23T18:47:08.606 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] aio-dio-eof-race 2023-06-23T18:47:08.894 INFO:teuthology.orchestra.run.smithi158.stdout:Building vfs 2023-06-23T18:47:08.904 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] vfstest 2023-06-23T18:47:10.896 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] mount-idmapped 2023-06-23T18:47:11.377 INFO:teuthology.orchestra.run.smithi158.stdout:Building m4 2023-06-23T18:47:11.385 INFO:teuthology.orchestra.run.smithi158.stdout:Building common 2023-06-23T18:47:11.391 INFO:teuthology.orchestra.run.smithi158.stdout:Building tests 2023-06-23T18:47:11.402 INFO:teuthology.orchestra.run.smithi158.stdout:Building perf 2023-06-23T18:47:11.412 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/perf/group.list 2023-06-23T18:47:11.441 INFO:teuthology.orchestra.run.smithi158.stdout:Building ext4 2023-06-23T18:47:11.451 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/ext4/group.list 2023-06-23T18:47:11.545 INFO:teuthology.orchestra.run.smithi158.stdout:Building ocfs2 2023-06-23T18:47:11.554 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/ocfs2/group.list 2023-06-23T18:47:11.588 INFO:teuthology.orchestra.run.smithi158.stdout:Building overlay 2023-06-23T18:47:11.598 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/overlay/group.list 2023-06-23T18:47:11.694 INFO:teuthology.orchestra.run.smithi158.stdout:Building cifs 2023-06-23T18:47:11.704 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/cifs/group.list 2023-06-23T18:47:11.735 INFO:teuthology.orchestra.run.smithi158.stdout:Building generic 2023-06-23T18:47:11.747 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/generic/group.list 2023-06-23T18:47:11.991 INFO:teuthology.orchestra.run.smithi158.stdout:Building shared 2023-06-23T18:47:12.000 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/shared/group.list 2023-06-23T18:47:12.044 INFO:teuthology.orchestra.run.smithi158.stdout:Building nfs 2023-06-23T18:47:12.053 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/nfs/group.list 2023-06-23T18:47:12.090 INFO:teuthology.orchestra.run.smithi158.stdout:Building f2fs 2023-06-23T18:47:12.099 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/f2fs/group.list 2023-06-23T18:47:12.143 INFO:teuthology.orchestra.run.smithi158.stdout:Building udf 2023-06-23T18:47:12.152 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/udf/group.list 2023-06-23T18:47:12.181 INFO:teuthology.orchestra.run.smithi158.stdout:Building ceph 2023-06-23T18:47:12.191 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/ceph/group.list 2023-06-23T18:47:12.227 INFO:teuthology.orchestra.run.smithi158.stdout:Building xfs 2023-06-23T18:47:12.240 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/xfs/group.list 2023-06-23T18:47:12.485 INFO:teuthology.orchestra.run.smithi158.stdout:Building btrfs 2023-06-23T18:47:12.496 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/btrfs/group.list 2023-06-23T18:47:12.641 INFO:teuthology.orchestra.run.smithi158.stdout:Building tmpfs 2023-06-23T18:47:12.651 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/tmpfs/group.list 2023-06-23T18:47:12.685 INFO:teuthology.orchestra.run.smithi158.stdout:Building selftest 2023-06-23T18:47:12.695 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/selftest/group.list 2023-06-23T18:47:12.729 DEBUG:teuthology.orchestra.run.smithi158:> (cd /tmp/tmp.d43oagwOcAxfstests-dev && exec sudo make install) 2023-06-23T18:47:12.822 INFO:teuthology.orchestra.run.smithi158.stdout:Building include 2023-06-23T18:47:12.829 INFO:teuthology.orchestra.run.smithi158.stdout:Building lib 2023-06-23T18:47:12.837 INFO:teuthology.orchestra.run.smithi158.stdout:Building ltp 2023-06-23T18:47:12.845 INFO:teuthology.orchestra.run.smithi158.stdout:Building src 2023-06-23T18:47:12.905 INFO:teuthology.orchestra.run.smithi158.stdout:Building log-writes 2023-06-23T18:47:12.912 INFO:teuthology.orchestra.run.smithi158.stdout:Building perf 2023-06-23T18:47:12.919 INFO:teuthology.orchestra.run.smithi158.stdout:Building aio-dio-regress 2023-06-23T18:47:12.927 INFO:teuthology.orchestra.run.smithi158.stdout:Building vfs 2023-06-23T18:47:12.935 INFO:teuthology.orchestra.run.smithi158.stdout:Building m4 2023-06-23T18:47:12.942 INFO:teuthology.orchestra.run.smithi158.stdout:Building common 2023-06-23T18:47:12.949 INFO:teuthology.orchestra.run.smithi158.stdout:Building tests 2023-06-23T18:47:12.959 INFO:teuthology.orchestra.run.smithi158.stdout:Building perf 2023-06-23T18:47:12.969 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/perf/group.list 2023-06-23T18:47:12.998 INFO:teuthology.orchestra.run.smithi158.stdout:Building ext4 2023-06-23T18:47:13.008 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/ext4/group.list 2023-06-23T18:47:13.102 INFO:teuthology.orchestra.run.smithi158.stdout:Building ocfs2 2023-06-23T18:47:13.111 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/ocfs2/group.list 2023-06-23T18:47:13.145 INFO:teuthology.orchestra.run.smithi158.stdout:Building overlay 2023-06-23T18:47:13.155 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/overlay/group.list 2023-06-23T18:47:13.250 INFO:teuthology.orchestra.run.smithi158.stdout:Building cifs 2023-06-23T18:47:13.260 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/cifs/group.list 2023-06-23T18:47:13.291 INFO:teuthology.orchestra.run.smithi158.stdout:Building generic 2023-06-23T18:47:13.304 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/generic/group.list 2023-06-23T18:47:13.540 INFO:teuthology.orchestra.run.smithi158.stdout:Building shared 2023-06-23T18:47:13.550 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/shared/group.list 2023-06-23T18:47:13.594 INFO:teuthology.orchestra.run.smithi158.stdout:Building nfs 2023-06-23T18:47:13.603 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/nfs/group.list 2023-06-23T18:47:13.639 INFO:teuthology.orchestra.run.smithi158.stdout:Building f2fs 2023-06-23T18:47:13.649 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/f2fs/group.list 2023-06-23T18:47:13.693 INFO:teuthology.orchestra.run.smithi158.stdout:Building udf 2023-06-23T18:47:13.703 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/udf/group.list 2023-06-23T18:47:13.732 INFO:teuthology.orchestra.run.smithi158.stdout:Building ceph 2023-06-23T18:47:13.742 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/ceph/group.list 2023-06-23T18:47:13.778 INFO:teuthology.orchestra.run.smithi158.stdout:Building xfs 2023-06-23T18:47:13.789 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/xfs/group.list 2023-06-23T18:47:14.028 INFO:teuthology.orchestra.run.smithi158.stdout:Building btrfs 2023-06-23T18:47:14.039 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/btrfs/group.list 2023-06-23T18:47:14.181 INFO:teuthology.orchestra.run.smithi158.stdout:Building tmpfs 2023-06-23T18:47:14.191 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/tmpfs/group.list 2023-06-23T18:47:14.225 INFO:teuthology.orchestra.run.smithi158.stdout:Building selftest 2023-06-23T18:47:14.235 INFO:teuthology.orchestra.run.smithi158.stdout: [GROUP] /tmp/tmp.d43oagwOcAxfstests-dev/tests/selftest/group.list 2023-06-23T18:47:14.265 INFO:teuthology.orchestra.run.smithi158.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-06-23T18:47:14.268 INFO:teuthology.orchestra.run.smithi158.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-23T18:47:14.268 INFO:teuthology.orchestra.run.smithi158.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-06-23T18:47:14.271 INFO:teuthology.orchestra.run.smithi158.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-23T18:47:14.272 INFO:teuthology.orchestra.run.smithi158.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-06-23T18:47:14.275 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-06-23T18:47:14.298 INFO:teuthology.orchestra.run.smithi158.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-06-23T18:47:14.473 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-06-23T18:47:14.497 INFO:teuthology.orchestra.run.smithi158.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-06-23T18:47:14.527 INFO:teuthology.orchestra.run.smithi158.stdout:Building log-writes 2023-06-23T18:47:14.534 INFO:teuthology.orchestra.run.smithi158.stdout:Building perf 2023-06-23T18:47:14.541 INFO:teuthology.orchestra.run.smithi158.stdout:Building aio-dio-regress 2023-06-23T18:47:14.549 INFO:teuthology.orchestra.run.smithi158.stdout:Building vfs 2023-06-23T18:47:14.555 INFO:teuthology.orchestra.run.smithi158.stdout:/usr/bin/gmake -C log-writes install 2023-06-23T18:47:14.557 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-06-23T18:47:14.580 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-06-23T18:47:14.604 INFO:teuthology.orchestra.run.smithi158.stdout:/usr/bin/gmake -C perf install 2023-06-23T18:47:14.606 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-06-23T18:47:14.629 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-06-23T18:47:14.689 INFO:teuthology.orchestra.run.smithi158.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-06-23T18:47:14.692 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-06-23T18:47:14.715 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-hole-filling-race aio-dio-append-write-fallocate-race aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-write-verify aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-06-23T18:47:14.856 INFO:teuthology.orchestra.run.smithi158.stdout:/usr/bin/gmake -C vfs install 2023-06-23T18:47:14.858 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-06-23T18:47:14.881 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-06-23T18:47:14.914 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-06-23T18:47:14.937 INFO:teuthology.orchestra.run.smithi158.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-06-23T18:47:17.912 INFO:teuthology.orchestra.run.smithi158.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-06-23T18:47:18.132 INFO:teuthology.orchestra.run.smithi158.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-06-23T18:47:18.186 INFO:teuthology.orchestra.run.smithi158.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-06-23T18:47:18.188 INFO:teuthology.orchestra.run.smithi158.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-23T18:47:18.189 INFO:teuthology.orchestra.run.smithi158.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-06-23T18:47:18.191 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-06-23T18:47:18.214 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-06-23T18:47:18.566 INFO:teuthology.orchestra.run.smithi158.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-06-23T18:47:18.569 INFO:teuthology.orchestra.run.smithi158.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.d43oagwOcAxfstests-dev/tests/btrfs/ install 2023-06-23T18:47:18.573 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-06-23T18:47:18.596 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 290 291 299 /var/lib/xfstests/tests/btrfs 2023-06-23T18:47:20.715 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-06-23T18:47:20.737 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 014.out 036.out 016.out 175.out 193.out 240.out 069.out 282.out 015.out 280.out 140.out 258.out 008.out 004.out 199.out 233.out 194.out 234.out 248.out 109.out 033.out 252.out 270.out 040.out 176.out 202.out 137.out 125.out 078.out 152.out 103.out 264.out 243.out 192.out 148.out 075.out 077.out 178.out 284.out 052.out 256.out 207.out 228.out 028.out 183.out 094.out 046.out 273.out 251.out 209.out 089.out 206.out 215.out 115.out 197.out 250.out 266.out 051.out 246.out 219.out 119.out 244.out 128.out 232.out 021.out 275.out 221.out 087.out 121.out 112.out 012.out 195.out 107.out 162.out 083.out 147.out 242.out 187.out 220.out 020.out 102.out 002.out 171.out 261.out 135.out 156.out 092.out 255.out 072.out 068.out 143.out 048.out 062.out 073.out 084.out 129.out 241.out 029.out 229.out 254.out 111.out 011.out 155.out 134.out 170.out 260.out 034.out 161.out 043.out 247.out 216.out 116.out 157.out 274.out 110.out 101.out 238.out 276.out 114.out 138.out 095.out 038.out 145.out 160.out 091.out 081.out 071.out 061.out 085.out 265.out 200.out 100.out 025.out 286.out 269.out 039.out 196.out 098.out 090.out 080.out 070.out 060.out 208.out 009.out 167.out 217.out 120.out 191.out 133.out 117.out 017.out 211.out 158.out 182.out 066.out 146.out 212.out 188.out 065.out 204.out 104.out 041.out 177.out 279.out 281.out 225.out 235.out 253.out 257.out 124.out 035.out 172.out 278.out 063.out 058.out 262.out 169.out 042.out 153.out 097.out 283.out 236.out 186.out 053.out 164.out 154.out 239.out 189.out 139.out 267.out 141.out 214.out 005.out 223.out 086.out 132.out 179.out 144.out 032.out 277.out 205.out 136.out 180.out 096.out 198.out 108.out 190.out 173.out 050.out 105.out 106.out 291.out 185.out 037.out 088.out 285.out 123.out 056.out 201.out 019.out 001.out 287.out 142.out 237.out 151.out 231.out 024.out 163.out 044.out 131.out 213.out 113.out 013.out 031.out 027.out 057.out 272.out 268.out 184.out 259.out 210.out 067.out 227.out 010.out 263.out 127.out 230.out 166.out 130.out 023.out 099.out 082.out 030.out 203.out 003.out 055.out 076.out 245.out 122.out 074.out 222.out 159.out 249.out 022.out 174.out 006.out 045.out 290.out 299.out 224.out 181.out 271.out 149.out 064.out 218.out 118.out 018.out 047.out 168.out 007.out 093.out 079.out 054.out 059.out 150.out 049.out 226.out 126.out 165.out 026.out /var/lib/xfstests/tests/btrfs 2023-06-23T18:47:22.862 INFO:teuthology.orchestra.run.smithi158.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.d43oagwOcAxfstests-dev/tests/ceph/ install 2023-06-23T18:47:22.864 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-06-23T18:47:22.887 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-06-23T18:47:22.940 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-06-23T18:47:22.963 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-06-23T18:47:23.015 INFO:teuthology.orchestra.run.smithi158.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.d43oagwOcAxfstests-dev/tests/cifs/ install 2023-06-23T18:47:23.018 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-06-23T18:47:23.041 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-06-23T18:47:23.064 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-06-23T18:47:23.087 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-06-23T18:47:23.111 INFO:teuthology.orchestra.run.smithi158.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.d43oagwOcAxfstests-dev/tests/ext4/ install 2023-06-23T18:47:23.114 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-06-23T18:47:23.137 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-06-23T18:47:23.644 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-06-23T18:47:23.667 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 005.out 026.out 308.out 008.out 040.out 304.out 007.out 021.out 016.out 037.out 044.out 012.out 009.out 033.out 057.out 050.out 301.out 019.out 034.out 046.out 058.out 047.out 302.out 020.out 002.out 024.out 013.out 031.out 025.out 306.out 017.out 004.out 048.out 038.out 056.out 042.out 052.out 307.out 029.out 011.out 027.out 303.out 003.out 045.out 055.out 053.out 035.out 043.out 059.out 010.out 023.out 022.out 014.out 006.out 015.out 305.out 036.out 271.out 051.out 041.out 030.out 018.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-06-23T18:47:24.196 INFO:teuthology.orchestra.run.smithi158.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.d43oagwOcAxfstests-dev/tests/f2fs/ install 2023-06-23T18:47:24.199 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-06-23T18:47:24.222 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-06-23T18:47:24.252 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-06-23T18:47:24.275 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-06-23T18:47:24.306 INFO:teuthology.orchestra.run.smithi158.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.d43oagwOcAxfstests-dev/tests/generic/ install 2023-06-23T18:47:24.312 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-06-23T18:47:24.335 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 /var/lib/xfstests/tests/generic 2023-06-23T18:47:28.515 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:47:28.518 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:47:28.520 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:47:29.661 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-06-23T18:47:29.685 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 035.out.nfs 050.out.xfsquota 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 537.out 194.out 133.out 683.out 033.out 489.out 696.out 237.out 502.out 310.out 202.out 137.out 586.out 181.out 664.out 571.out 126.out 243.out 592.out 282.out 272.out 728.out 178.out 628.out 528.out 607.out 428.out 507.out 407.out 328.out 171.out 028.out 620.out 273.out 570.out 468.out 182.out 265.out 420.out 492.out 120.out 059.out 595.out 346.out 466.out 443.out 700.out 632.out 652.out 311.out 655.out 591.out 064.out 471.out 432.out 255.out 623.out 371.out 319.out 177.out 523.out 119.out 423.out 232.out 673.out 260.out 312.out 718.out 034.out 465.out 716.out 616.out 246.out 416.out 247.out 216.out 116.out 041.out 358.out 338.out 287.out 238.out 295.out 390.out 497.out 160.out 691.out 274.out 061.out 239.out 457.out 025.out 530.out 258.out 362.out 039.out 098.out 690.out 573.out 706.out 606.out 506.out 406.out 306.out 106.out 642.out 217.out 446.out 017.out 211.out 130.out 158.out 370.out 442.out 188.out 640.out 199.out 467.out 281.out 174.out 163.out 324.out 224.out 355.out 124.out 672.out 278.out 058.out 384.out 296.out 042.out 193.out 097.out 271.out 283.out 541.out 709.out 609.out 045.out 509.out 309.out 391.out 441.out 009.out 356.out 341.out 494.out 189.out 037.out 555.out 712.out 241.out 501.out 612.out 540.out 365.out 412.out 614.out 514.out 414.out 314.out 440.out 114.out 316.out 014.out 026.out 012.out 634.out 340.out 156.out 572.out 240.out 180.out 549.out 473.out 633.out 321.out 140.out 348.out 568.out 185.out 408.out 308.out 566.out 433.out 704.out 108.out 504.out 404.out 304.out 104.out 175.out 096.out 297.out 393.out 333.out 599.out 476.out 099.out 233.out 639.out 107.out 086.out 053.out 500.out 164.out 339.out 294.out 352.out 498.out 139.out 267.out 317.out 399.out 220.out 552.out 695.out 480.out 436.out 544.out 169.out 593.out 067.out 186.out 187.out 679.out 252.out 585.out 003.out 376.out 724.out 206.out 663.out 651.out 248.out 625.out 525.out 670.out 488.out 040.out 325.out 551.out 225.out 636.out 125.out 142.out 715.out 279.out 222.out 515.out 650.out 152.out 658.out 563.out 215.out 451.out 015.out 392.out 682.out 472.out 684.out 674.out 550.out 052.out 351.out 430.out 276.out 094.out 266.out 450.out 463.out 157.out 600.out 349.out 444.out 644.out 487.out 688.out 643.out 615.out 395.out 151.out 415.out 315.out 344.out 115.out 539.out 179.out 542.out 250.out 705.out 475.out 536.out 228.out 518.out 101.out 030.out 244.out 128.out 385.out 005.out 336.out 579.out 236.out 405.out 667.out 205.out 136.out 598.out 036.out 198.out 723.out 008.out 680.out 605.out 505.out 305.out 105.out 263.out 144.out 291.out 437.out 044.out 719.out 619.out 721.out 323.out 685.out 088.out 382.out 337.out 219.out 527.out 019.out 577.out 481.out 574.out 556.out 332.out 060.out 521.out 027.out 191.out 582.out 372.out 478.out 584.out 462.out 597.out 350.out 132.out 693.out 638.out 448.out 660.out 063.out 561.out 214.out 074.out 648.out 387.out 594.out 335.out 438.out 076.out 289.out 699.out 545.out 516.out 477.out 621.out 519.out 290.out 548.out 560.out 166.out 707.out 461.out 381.out 445.out 647.out 626.out 380.out 562.out 526.out 479.out 426.out 192.out 150.out 613.out 326.out 082.out 226.out 668.out 454.out 121.out 447.out 499.out 580.out 460.out 485.out 694.out 347.out 077.out 361.out 564.out 455.out 089.out 558.out 162.out 686.out 147.out 173.out 197.out 396.out 051.out 354.out 298.out 024.out 148.out 360.out 543.out 270.out 261.out 251.out 657.out 692.out 482.out 046.out 726.out 378.out 004.out 458.out 062.out 529.out 231.out 343.out 662.out 503.out 329.out 334.out 590.out 254.out 363.out 131.out 155.out 661.out 547.out 368.out 486.out 223.out 123.out 669.out 023.out 459.out 032.out 277.out 398.out 366.out 161.out 190.out 280.out 470.out 484.out 257.out 006.out 016.out 091.out 201.out 656.out 227.out 676.out 374.out 583.out 285.out 127.out 256.out 654.out 389.out 649.out 301.out 431.out 635.out 288.out 722.out 331.out 377.out 713.out 535.out 513.out 554.out 622.out 313.out 213.out 113.out 013.out 031.out 435.out 630.out 645.out 057.out 727.out 078.out 510.out 627.out 184.out 534.out 427.out 210.out 449.out 327.out 330.out 493.out 604.out 419.out 230.out 071.out 083.out 292.out 299.out 434.out 575.out 073.out 603.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 532.out 245.out 522.out 422.out 624.out 322.out 394.out 159.out 524.out 122.out 689.out 234.out 022.out 424.out 637.out 578.out 490.out 439.out 517.out 154.out 149.out 618.out 675.out 418.out 318.out 264.out 218.out 118.out 018.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 208.out 379.out 569.out 456.out 268.out 421.out 533.out 512.out 221.out 087.out 212.out 538.out 112.out 342.out 021.out 195.out 388.out 483.out 397.out 070.out 596.out 720.out 565.out 196.out 520.out 242.out 576.out 587.out 320.out 629.out 702.out 602.out 153.out 402.out 302.out 020.out 102.out 002.out 717.out 617.out 129.out 429.out 417.out 138.out 167.out 092.out 117.out 357.out 072.out 068.out 143.out 229.out 038.out 084.out 369.out 711.out 262.out 611.out 511.out 411.out 029.out 111.out 011.out 659.out 183.out 170.out 065.out 286.out 043.out 056.out 714.out 559.out 710.out 610.out 687.out 413.out 410.out 701.out 601.out 401.out 110.out 010.out 001.out 141.out 495.out 048.out 665.out 589.out 095.out 581.out 697.out 145.out 641.out 464.out 491.out 081.out 075.out 653.out 671.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 677.out 698.out 553.out 375.out 259.out 090.out 080.out 708.out 608.out 508.out 409.out 307.out 209.out 109.out 007.out 567.out 284.out 557.out 453.out 666.out 364.out 725.out 383.out 085.out 066.out 588.out 146.out 631.out 204.out 353.out 425.out 069.out 093.out 681.out 249.out 207.out 531.out 235.out 646.out 474.out 703.out 253.out 275.out 678.out 496.out 373.out 176.out 134.out 452.out /var/lib/xfstests/tests/generic 2023-06-23T18:47:35.060 INFO:teuthology.orchestra.run.smithi158.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.d43oagwOcAxfstests-dev/tests/nfs/ install 2023-06-23T18:47:35.063 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-06-23T18:47:35.086 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-06-23T18:47:35.109 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-06-23T18:47:35.132 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-06-23T18:47:35.156 INFO:teuthology.orchestra.run.smithi158.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.d43oagwOcAxfstests-dev/tests/ocfs2/ install 2023-06-23T18:47:35.158 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-06-23T18:47:35.181 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-06-23T18:47:35.204 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-06-23T18:47:35.227 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-06-23T18:47:35.251 INFO:teuthology.orchestra.run.smithi158.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.d43oagwOcAxfstests-dev/tests/overlay/ install 2023-06-23T18:47:35.254 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-06-23T18:47:35.277 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-06-23T18:47:35.990 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-06-23T18:47:36.012 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 110.out 067.out 018.out 024.out 010.out 065.out 020.out 102.out 002.out 113.out 013.out 031.out 045.out 117.out 046.out 075.out 072.out 068.out 063.out 014.out 062.out 038.out 042.out 052.out 029.out 027.out 043.out 112.out 023.out 073.out 078.out 030.out 058.out 003.out 004.out 055.out 053.out 109.out 035.out 116.out 016.out 059.out 101.out 001.out 009.out 047.out 076.out 022.out 074.out 006.out 044.out 115.out 015.out 064.out 114.out 026.out 071.out 111.out 061.out 011.out 041.out 048.out 100.out 019.out 107.out 007.out 028.out 069.out 054.out 049.out 032.out 039.out 077.out 105.out 025.out 056.out 057.out 108.out 070.out 060.out 008.out 040.out 106.out 005.out 021.out 017.out 012.out 037.out 103.out 033.out 066.out 050.out 036.out 051.out 034.out 104.out /var/lib/xfstests/tests/overlay 2023-06-23T18:47:36.727 INFO:teuthology.orchestra.run.smithi158.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.d43oagwOcAxfstests-dev/tests/perf/ install 2023-06-23T18:47:36.729 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-06-23T18:47:36.753 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-06-23T18:47:36.775 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-06-23T18:47:36.798 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-06-23T18:47:36.822 INFO:teuthology.orchestra.run.smithi158.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.d43oagwOcAxfstests-dev/tests/selftest/ install 2023-06-23T18:47:36.824 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-06-23T18:47:36.847 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-06-23T18:47:36.906 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-06-23T18:47:36.930 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-06-23T18:47:36.989 INFO:teuthology.orchestra.run.smithi158.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.d43oagwOcAxfstests-dev/tests/shared/ install 2023-06-23T18:47:36.992 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-06-23T18:47:37.015 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-06-23T18:47:37.053 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-06-23T18:47:37.076 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-06-23T18:47:37.114 INFO:teuthology.orchestra.run.smithi158.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.d43oagwOcAxfstests-dev/tests/tmpfs/ install 2023-06-23T18:47:37.117 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-06-23T18:47:37.140 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-06-23T18:47:37.163 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-06-23T18:47:37.186 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-06-23T18:47:37.210 INFO:teuthology.orchestra.run.smithi158.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.d43oagwOcAxfstests-dev/tests/udf/ install 2023-06-23T18:47:37.212 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-06-23T18:47:37.235 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-06-23T18:47:37.258 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-06-23T18:47:37.281 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-06-23T18:47:37.305 INFO:teuthology.orchestra.run.smithi158.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.d43oagwOcAxfstests-dev/tests/xfs/ install 2023-06-23T18:47:37.310 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-06-23T18:47:37.333 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-06-23T18:47:42.353 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-06-23T18:47:42.376 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 308.out 737.out 108.out 504.out 404.out 104.out 004.out 377.out 537.out 194.out 158.out 337.out 082.out 237.out 759.out 502.out 088.out 202.out 137.out 102.out 746.out 110.out 586.out 181.out 571.out 567.out 592.out 282.out 266.out 728.out 178.out 528.out 769.out 428.out 507.out 407.out 328.out 171.out 028.out 046.out 273.out 570.out 468.out 474.out 059.out 346.out 732.out 784.out 443.out 411.out 532.out 591.out 064.out 471.out 111.out 432.out 255.out 371.out 319.out 177.out 523.out 119.out 775.out 232.out 131.out 243.out 183.out 547.out 738.out 260.out 718.out 034.out 465.out 716.out 161.out 246.out 416.out 247.out 116.out 016.out 041.out 358.out 338.out 287.out 099.out 238.out 065.out 566.out 295.out 138.out 765.out 160.out 291.out 274.out 722.out 061.out 239.out 085.out 457.out 025.out 772.out 530.out 258.out 322.out 039.out 498.out 098.out 517.out 573.out 060.out 506.out 406.out 306.out 106.out 006.out 003.out 217.out 120.out 191.out 133.out 455.out 130.out 442.out 188.out 030.out 199.out 595.out 467.out 281.out 242.out 163.out 771.out 324.out 224.out 050.out 764.out 124.out 382.out 278.out 058.out 741.out 384.out 262.out 042.out 497.out 466.out 193.out 097.out 392.out 283.out 541.out 770.out 709.out 755.out 309.out 441.out 157.out 740.out 356.out 341.out 494.out 189.out 555.out 241.out 540.out 077.out 412.out 514.out 414.out 314.out 440.out 114.out 316.out 074.out 147.out 012.out 155.out 340.out 793.out 156.out 572.out 568.out 240.out 279.out 180.out 733.out 280.out 434.out 140.out 766.out 185.out 408.out 066.out 552.out 304.out 204.out 353.out 425.out 069.out 254.out 335.out 531.out 235.out 556.out 253.out 503.out 418.out 275.out 272.out 496.out 751.out 433.out 176.out 134.out 393.out 333.out 476.out 535.out 739.out 233.out 752.out 736.out 107.out 053.out 164.out 587.out 339.out 294.out 521.out 352.out 799.out 489.out 139.out 774.out 267.out 390.out 399.out 781.out 017.out 169.out 593.out 186.out 452.out 252.out 585.out 167.out 724.out 206.out 794.out 348.out 394.out 509.out 248.out 785.out 424.out 750.out 525.out 488.out 040.out 325.out 551.out 225.out 125.out 142.out 715.out 789.out 581.out 152.out 563.out 215.out 436.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 351.out 430.out 276.out 290.out 094.out 451.out 450.out 744.out 043.out 086.out 349.out 444.out 500.out 487.out 762.out 544.out 305.out 395.out 515.out 415.out 389.out 315.out 344.out 115.out 015.out 542.out 250.out 791.out 464.out 475.out 536.out 228.out 439.out 244.out 128.out 385.out 005.out 336.out 150.out 579.out 236.out 342.out 580.out 136.out 036.out 198.out 723.out 008.out 790.out 505.out 405.out 588.out 205.out 105.out 144.out 768.out 437.out 037.out 044.out 719.out 381.out 721.out 323.out 519.out 562.out 419.out 388.out 123.out 056.out 019.out 577.out 151.out 760.out 574.out 332.out 796.out 027.out 372.out 584.out 462.out 220.out 350.out 312.out 492.out 745.out 076.out 112.out 063.out 561.out 214.out 776.out 014.out 758.out 362.out 387.out 594.out 438.out 265.out 289.out 554.out 516.out 477.out 548.out 560.out 166.out 461.out 445.out 296.out 207.out 493.out 786.out 007.out 251.out 380.out 093.out 526.out 479.out 426.out 192.out 326.out 226.out 454.out 126.out 121.out 447.out 761.out 773.out 460.out 485.out 347.out 035.out 361.out 564.out 788.out 795.out 089.out 747.out 558.out 162.out 743.out 288.out 197.out 396.out 576.out 051.out 354.out 355.out 575.out 148.out 301.out 360.out 543.out 263.out 270.out 261.out 734.out 045.out 292.out 482.out 726.out 729.out 378.out 458.out 062.out 249.out 231.out 343.out 334.out 590.out 363.out 368.out 486.out 223.out 132.out 023.out 459.out 032.out 798.out 277.out 748.out 527.out 146.out 398.out 366.out 427.out 190.out 173.out 470.out 484.out 754.out 767.out 749.out 187.out 091.out 201.out 731.out 782.out 374.out 583.out 285.out 127.out 256.out 501.out 376.out 431.out 068.out 331.out 179.out 713.out 024.out 513.out 413.out 313.out 549.out 213.out 730.out 113.out 013.out 031.out 435.out 182.out 057.out 727.out 078.out 510.out 184.out 797.out 534.out 545.out 210.out 449.out 327.out 330.out 067.out 227.out 010.out 230.out 083.out 473.out 299.out 219.out 073.out 370.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 742.out 245.out 026.out 522.out 787.out 422.out 222.out 159.out 539.out 524.out 122.out 448.out 234.out 022.out 174.out 779.out 490.out 565.out 090.out 423.out 154.out 271.out 149.out 518.out 318.out 264.out 218.out 118.out 018.out 329.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 208.out 379.out 456.out 268.out 421.out 712.out 321.out 533.out 512.out 221.out 087.out 212.out 538.out 021.out 195.out 725.out 483.out 397.out 070.out 373.out 720.out 481.out 196.out 520.out 129.out 446.out 420.out 478.out 320.out 499.out 153.out 402.out 302.out 020.out 529.out 002.out 717.out 429.out 417.out 317.out 365.out 092.out 117.out 357.out 072.out 778.out 143.out 229.out 038.out 084.out 369.out 711.out 511.out 029.out 311.out 211.out 011.out 783.out 170.out 286.out 756.out 175.out 714.out 559.out 710.out 410.out 310.out 401.out 101.out 001.out 141.out 495.out 048.out 589.out 753.out 095.out 297.out 480.out 145.out 257.out 757.out 491.out 081.out 800.out 777.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 780.out 553.out 763.out 375.out 298.out 259.out 080.out 708.out 508.out 409.out 307.out 209.out 109.out 009.out 391.out 284.out 557.out 453.out 364.out 582.out 735.out 383.out /var/lib/xfstests/tests/xfs 2023-06-23T18:47:47.449 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-06-23T18:47:47.472 INFO:teuthology.orchestra.run.smithi158.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-06-23T18:47:47.495 INFO:teuthology.orchestra.run.smithi158.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-06-23T18:47:47.518 INFO:teuthology.orchestra.run.smithi158.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-06-23T18:47:47.545 DEBUG:teuthology.orchestra.run.smithi158:> (cd /tmp/tmp.Ga11jYSuehxfsprogs-dev && exec sudo make) 2023-06-23T18:47:47.624 INFO:teuthology.orchestra.run.smithi158.stdout:libtoolize -c -i -f 2023-06-23T18:47:47.906 INFO:teuthology.orchestra.run.smithi158.stdout:libtoolize: putting auxiliary files in AC_CONFIG_AUX_DIR, '.'. 2023-06-23T18:47:47.906 INFO:teuthology.orchestra.run.smithi158.stdout:libtoolize: copying file './config.guess' 2023-06-23T18:47:47.916 INFO:teuthology.orchestra.run.smithi158.stdout:libtoolize: copying file './config.sub' 2023-06-23T18:47:47.926 INFO:teuthology.orchestra.run.smithi158.stdout:libtoolize: copying file './install-sh' 2023-06-23T18:47:47.937 INFO:teuthology.orchestra.run.smithi158.stdout:libtoolize: copying file './ltmain.sh' 2023-06-23T18:47:47.997 INFO:teuthology.orchestra.run.smithi158.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-06-23T18:47:47.997 INFO:teuthology.orchestra.run.smithi158.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-06-23T18:47:48.009 INFO:teuthology.orchestra.run.smithi158.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-06-23T18:47:48.022 INFO:teuthology.orchestra.run.smithi158.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-06-23T18:47:48.035 INFO:teuthology.orchestra.run.smithi158.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-06-23T18:47:48.047 INFO:teuthology.orchestra.run.smithi158.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-06-23T18:47:48.064 INFO:teuthology.orchestra.run.smithi158.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-06-23T18:47:48.067 INFO:teuthology.orchestra.run.smithi158.stdout:cp include/install-sh . 2023-06-23T18:47:48.069 INFO:teuthology.orchestra.run.smithi158.stdout:aclocal -I m4 2023-06-23T18:47:49.321 INFO:teuthology.orchestra.run.smithi158.stdout:autoconf 2023-06-23T18:47:49.747 INFO:teuthology.orchestra.run.smithi158.stdout:./configure $LOCAL_CONFIGURE_OPTIONS 2023-06-23T18:47:49.884 INFO:teuthology.orchestra.run.smithi158.stdout:configure: loading site script /usr/share/config.site 2023-06-23T18:47:49.914 INFO:teuthology.orchestra.run.smithi158.stdout:checking for a BSD-compatible install... /bin/install -c 2023-06-23T18:47:50.010 INFO:teuthology.orchestra.run.smithi158.stdout:checking build system type... x86_64-pc-linux-gnu 2023-06-23T18:47:50.010 INFO:teuthology.orchestra.run.smithi158.stdout:checking host system type... x86_64-pc-linux-gnu 2023-06-23T18:47:50.014 INFO:teuthology.orchestra.run.smithi158.stdout:checking how to print strings... printf 2023-06-23T18:47:50.014 INFO:teuthology.orchestra.run.smithi158.stdout:checking for gcc... gcc 2023-06-23T18:47:50.107 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether the C compiler works... yes 2023-06-23T18:47:50.107 INFO:teuthology.orchestra.run.smithi158.stdout:checking for C compiler default output file name... a.out 2023-06-23T18:47:50.157 INFO:teuthology.orchestra.run.smithi158.stdout:checking for suffix of executables... 2023-06-23T18:47:50.214 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether we are cross compiling... no 2023-06-23T18:47:50.252 INFO:teuthology.orchestra.run.smithi158.stdout:checking for suffix of object files... o 2023-06-23T18:47:50.286 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether we are using the GNU C compiler... yes 2023-06-23T18:47:50.320 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether gcc accepts -g... yes 2023-06-23T18:47:50.366 INFO:teuthology.orchestra.run.smithi158.stdout:checking for gcc option to accept ISO C89... none needed 2023-06-23T18:47:50.374 INFO:teuthology.orchestra.run.smithi158.stdout:checking for a sed that does not truncate output... /bin/sed 2023-06-23T18:47:50.379 INFO:teuthology.orchestra.run.smithi158.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-06-23T18:47:50.383 INFO:teuthology.orchestra.run.smithi158.stdout:checking for egrep... /bin/grep -E 2023-06-23T18:47:50.385 INFO:teuthology.orchestra.run.smithi158.stdout:checking for fgrep... /bin/grep -F 2023-06-23T18:47:50.393 INFO:teuthology.orchestra.run.smithi158.stdout:checking for ld used by gcc... /bin/ld 2023-06-23T18:47:50.397 INFO:teuthology.orchestra.run.smithi158.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-06-23T18:47:50.401 INFO:teuthology.orchestra.run.smithi158.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-06-23T18:47:50.440 INFO:teuthology.orchestra.run.smithi158.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-06-23T18:47:50.441 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether ln -s works... yes 2023-06-23T18:47:50.448 INFO:teuthology.orchestra.run.smithi158.stdout:checking the maximum length of command line arguments... 1572864 2023-06-23T18:47:50.454 INFO:teuthology.orchestra.run.smithi158.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-06-23T18:47:50.454 INFO:teuthology.orchestra.run.smithi158.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-06-23T18:47:50.454 INFO:teuthology.orchestra.run.smithi158.stdout:checking for /bin/ld option to reload object files... -r 2023-06-23T18:47:50.455 INFO:teuthology.orchestra.run.smithi158.stdout:checking for objdump... objdump 2023-06-23T18:47:50.455 INFO:teuthology.orchestra.run.smithi158.stdout:checking how to recognize dependent libraries... pass_all 2023-06-23T18:47:50.456 INFO:teuthology.orchestra.run.smithi158.stdout:checking for dlltool... no 2023-06-23T18:47:50.456 INFO:teuthology.orchestra.run.smithi158.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-06-23T18:47:50.456 INFO:teuthology.orchestra.run.smithi158.stdout:checking for ar... ar 2023-06-23T18:47:50.503 INFO:teuthology.orchestra.run.smithi158.stdout:checking for archiver @FILE support... @ 2023-06-23T18:47:50.503 INFO:teuthology.orchestra.run.smithi158.stdout:checking for strip... strip 2023-06-23T18:47:50.504 INFO:teuthology.orchestra.run.smithi158.stdout:checking for ranlib... ranlib 2023-06-23T18:47:50.504 INFO:teuthology.orchestra.run.smithi158.stdout:checking for gawk... gawk 2023-06-23T18:47:50.613 INFO:teuthology.orchestra.run.smithi158.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-06-23T18:47:50.616 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sysroot... no 2023-06-23T18:47:50.625 INFO:teuthology.orchestra.run.smithi158.stdout:checking for a working dd... /bin/dd 2023-06-23T18:47:50.632 INFO:teuthology.orchestra.run.smithi158.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-06-23T18:47:50.660 INFO:teuthology.orchestra.run.smithi158.stdout:checking for mt... no 2023-06-23T18:47:50.666 INFO:teuthology.orchestra.run.smithi158.stdout:checking if : is a manifest tool... no 2023-06-23T18:47:50.708 INFO:teuthology.orchestra.run.smithi158.stdout:checking how to run the C preprocessor... gcc -E 2023-06-23T18:47:50.899 INFO:teuthology.orchestra.run.smithi158.stdout:checking for ANSI C header files... yes 2023-06-23T18:47:50.943 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sys/types.h... yes 2023-06-23T18:47:50.995 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sys/stat.h... yes 2023-06-23T18:47:51.047 INFO:teuthology.orchestra.run.smithi158.stdout:checking for stdlib.h... yes 2023-06-23T18:47:51.100 INFO:teuthology.orchestra.run.smithi158.stdout:checking for string.h... yes 2023-06-23T18:47:51.153 INFO:teuthology.orchestra.run.smithi158.stdout:checking for memory.h... yes 2023-06-23T18:47:51.206 INFO:teuthology.orchestra.run.smithi158.stdout:checking for strings.h... yes 2023-06-23T18:47:51.260 INFO:teuthology.orchestra.run.smithi158.stdout:checking for inttypes.h... yes 2023-06-23T18:47:51.314 INFO:teuthology.orchestra.run.smithi158.stdout:checking for stdint.h... yes 2023-06-23T18:47:51.371 INFO:teuthology.orchestra.run.smithi158.stdout:checking for unistd.h... yes 2023-06-23T18:47:51.422 INFO:teuthology.orchestra.run.smithi158.stdout:checking for dlfcn.h... yes 2023-06-23T18:47:51.430 INFO:teuthology.orchestra.run.smithi158.stdout:checking for objdir... .libs 2023-06-23T18:47:51.564 INFO:teuthology.orchestra.run.smithi158.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-06-23T18:47:51.565 INFO:teuthology.orchestra.run.smithi158.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-06-23T18:47:51.603 INFO:teuthology.orchestra.run.smithi158.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-06-23T18:47:51.640 INFO:teuthology.orchestra.run.smithi158.stdout:checking if gcc static flag -static works... no 2023-06-23T18:47:51.693 INFO:teuthology.orchestra.run.smithi158.stdout:checking if gcc supports -c -o file.o... yes 2023-06-23T18:47:51.694 INFO:teuthology.orchestra.run.smithi158.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-06-23T18:47:51.708 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-06-23T18:47:51.756 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether -lc should be explicitly linked in... no 2023-06-23T18:47:51.846 INFO:teuthology.orchestra.run.smithi158.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-06-23T18:47:51.847 INFO:teuthology.orchestra.run.smithi158.stdout:checking how to hardcode library paths into programs... immediate 2023-06-23T18:47:51.849 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether stripping libraries is possible... yes 2023-06-23T18:47:51.850 INFO:teuthology.orchestra.run.smithi158.stdout:checking if libtool supports shared libraries... yes 2023-06-23T18:47:51.850 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether to build shared libraries... yes 2023-06-23T18:47:51.850 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether to build static libraries... yes 2023-06-23T18:47:51.850 INFO:teuthology.orchestra.run.smithi158.stdout:checking for gcc... (cached) gcc 2023-06-23T18:47:51.888 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-06-23T18:47:51.888 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether gcc accepts -g... (cached) yes 2023-06-23T18:47:51.889 INFO:teuthology.orchestra.run.smithi158.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-06-23T18:47:51.902 INFO:teuthology.orchestra.run.smithi158.stdout:checking for gcc... (cached) gcc 2023-06-23T18:47:51.940 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-06-23T18:47:51.941 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether gcc accepts -g... (cached) yes 2023-06-23T18:47:51.941 INFO:teuthology.orchestra.run.smithi158.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-06-23T18:47:51.949 INFO:teuthology.orchestra.run.smithi158.stdout:checking for gcc... (cached) gcc 2023-06-23T18:47:51.987 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-06-23T18:47:51.987 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether gcc accepts -g... (cached) yes 2023-06-23T18:47:51.988 INFO:teuthology.orchestra.run.smithi158.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-06-23T18:47:51.988 INFO:teuthology.orchestra.run.smithi158.stdout:checking for gmake... /bin/gmake 2023-06-23T18:47:51.988 INFO:teuthology.orchestra.run.smithi158.stdout:checking for tar... /bin/tar 2023-06-23T18:47:51.989 INFO:teuthology.orchestra.run.smithi158.stdout:checking for gzip... /bin/gzip 2023-06-23T18:47:52.004 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether gcc -MM is supported... yes 2023-06-23T18:47:52.005 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sort... /bin/sort 2023-06-23T18:47:52.005 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether ln -s works... yes 2023-06-23T18:47:52.005 INFO:teuthology.orchestra.run.smithi158.stdout:checking for msgfmt... /bin/msgfmt 2023-06-23T18:47:52.006 INFO:teuthology.orchestra.run.smithi158.stdout:checking for msgmerge... /bin/msgmerge 2023-06-23T18:47:52.006 INFO:teuthology.orchestra.run.smithi158.stdout:checking for xgettext... /bin/xgettext 2023-06-23T18:47:52.006 INFO:teuthology.orchestra.run.smithi158.stdout:checking for rpm... /bin/rpm 2023-06-23T18:47:52.014 INFO:teuthology.orchestra.run.smithi158.stdout:checking for rpmbuild... no 2023-06-23T18:47:52.062 INFO:teuthology.orchestra.run.smithi158.stdout:checking ini.h usability... yes 2023-06-23T18:47:52.080 INFO:teuthology.orchestra.run.smithi158.stdout:checking ini.h presence... yes 2023-06-23T18:47:52.080 INFO:teuthology.orchestra.run.smithi158.stdout:checking for ini.h... yes 2023-06-23T18:47:52.139 INFO:teuthology.orchestra.run.smithi158.stdout:checking for ini_parse in -linih... yes 2023-06-23T18:47:52.190 INFO:teuthology.orchestra.run.smithi158.stdout:checking uuid.h usability... no 2023-06-23T18:47:52.214 INFO:teuthology.orchestra.run.smithi158.stdout:checking uuid.h presence... no 2023-06-23T18:47:52.214 INFO:teuthology.orchestra.run.smithi158.stdout:checking for uuid.h... no 2023-06-23T18:47:52.263 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/uuid.h usability... no 2023-06-23T18:47:52.288 INFO:teuthology.orchestra.run.smithi158.stdout:checking sys/uuid.h presence... no 2023-06-23T18:47:52.288 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sys/uuid.h... no 2023-06-23T18:47:52.338 INFO:teuthology.orchestra.run.smithi158.stdout:checking uuid/uuid.h usability... yes 2023-06-23T18:47:52.358 INFO:teuthology.orchestra.run.smithi158.stdout:checking uuid/uuid.h presence... yes 2023-06-23T18:47:52.358 INFO:teuthology.orchestra.run.smithi158.stdout:checking for uuid/uuid.h... yes 2023-06-23T18:47:52.433 INFO:teuthology.orchestra.run.smithi158.stdout:checking for uuid_compare... no 2023-06-23T18:47:52.490 INFO:teuthology.orchestra.run.smithi158.stdout:checking for uuid_compare in -luuid... yes 2023-06-23T18:47:52.539 INFO:teuthology.orchestra.run.smithi158.stdout:checking pthread.h usability... yes 2023-06-23T18:47:52.558 INFO:teuthology.orchestra.run.smithi158.stdout:checking pthread.h presence... yes 2023-06-23T18:47:52.559 INFO:teuthology.orchestra.run.smithi158.stdout:checking for pthread.h... yes 2023-06-23T18:47:52.619 INFO:teuthology.orchestra.run.smithi158.stdout:checking for pthread_mutex_init in -lpthread... yes 2023-06-23T18:47:52.672 INFO:teuthology.orchestra.run.smithi158.stdout:checking urcu.h usability... yes 2023-06-23T18:47:52.697 INFO:teuthology.orchestra.run.smithi158.stdout:checking urcu.h presence... yes 2023-06-23T18:47:52.697 INFO:teuthology.orchestra.run.smithi158.stdout:checking for urcu.h... yes 2023-06-23T18:47:52.748 INFO:teuthology.orchestra.run.smithi158.stdout:checking for liburcu... yes 2023-06-23T18:47:52.788 INFO:teuthology.orchestra.run.smithi158.stdout:checking for fadvise ... yes 2023-06-23T18:47:52.826 INFO:teuthology.orchestra.run.smithi158.stdout:checking for madvise ... yes 2023-06-23T18:47:52.865 INFO:teuthology.orchestra.run.smithi158.stdout:checking for mincore ... yes 2023-06-23T18:47:52.905 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sendfile ... yes 2023-06-23T18:47:52.946 INFO:teuthology.orchestra.run.smithi158.stdout:checking for getmntent ... yes 2023-06-23T18:47:53.007 INFO:teuthology.orchestra.run.smithi158.stdout:checking for fallocate... yes 2023-06-23T18:47:53.069 INFO:teuthology.orchestra.run.smithi158.stdout:checking for fiemap... yes 2023-06-23T18:47:53.131 INFO:teuthology.orchestra.run.smithi158.stdout:checking for pwritev2... yes 2023-06-23T18:47:53.194 INFO:teuthology.orchestra.run.smithi158.stdout:checking for preadv... yes 2023-06-23T18:47:53.257 INFO:teuthology.orchestra.run.smithi158.stdout:checking for copy_file_range... yes 2023-06-23T18:47:53.318 INFO:teuthology.orchestra.run.smithi158.stdout:checking for sync_file_range... yes 2023-06-23T18:47:53.380 INFO:teuthology.orchestra.run.smithi158.stdout:checking for syncfs... yes 2023-06-23T18:47:53.426 INFO:teuthology.orchestra.run.smithi158.stdout:checking mntent.h usability... yes 2023-06-23T18:47:53.442 INFO:teuthology.orchestra.run.smithi158.stdout:checking mntent.h presence... yes 2023-06-23T18:47:53.442 INFO:teuthology.orchestra.run.smithi158.stdout:checking for mntent.h... yes 2023-06-23T18:47:53.485 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether fls is declared... no 2023-06-23T18:47:53.544 INFO:teuthology.orchestra.run.smithi158.stdout:checking for readdir... yes 2023-06-23T18:47:53.594 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether fsetxattr is declared... yes 2023-06-23T18:47:53.642 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether mremap is declared... yes 2023-06-23T18:47:53.710 INFO:teuthology.orchestra.run.smithi158.stdout:checking for struct fsxattr... yes 2023-06-23T18:47:53.749 INFO:teuthology.orchestra.run.smithi158.stdout:checking for struct fsxattr.fsx_cowextsize... yes 2023-06-23T18:47:53.780 INFO:teuthology.orchestra.run.smithi158.stdout:checking for struct fscrypt_add_key_arg... no 2023-06-23T18:47:53.851 INFO:teuthology.orchestra.run.smithi158.stdout:checking for GETFSMAP... yes 2023-06-23T18:47:53.921 INFO:teuthology.orchestra.run.smithi158.stdout:checking for struct statfs... yes 2023-06-23T18:47:53.959 INFO:teuthology.orchestra.run.smithi158.stdout:checking for struct statfs.f_flags... yes 2023-06-23T18:47:53.996 INFO:teuthology.orchestra.run.smithi158.stdout:checking for MAP_SYNC... yes 2023-06-23T18:47:54.132 INFO:teuthology.orchestra.run.smithi158.stdout:checking for library containing dm_task_create... -ldevmapper 2023-06-23T18:47:54.172 INFO:teuthology.orchestra.run.smithi158.stdout:checking for mallinfo ... yes 2023-06-23T18:47:54.206 INFO:teuthology.orchestra.run.smithi158.stdout:checking for mallinfo2 ... no 2023-06-23T18:47:54.252 INFO:teuthology.orchestra.run.smithi158.stdout:checking attr/attributes.h usability... yes 2023-06-23T18:47:54.269 INFO:teuthology.orchestra.run.smithi158.stdout:checking attr/attributes.h presence... yes 2023-06-23T18:47:54.269 INFO:teuthology.orchestra.run.smithi158.stdout:checking for attr/attributes.h... yes 2023-06-23T18:47:54.310 INFO:teuthology.orchestra.run.smithi158.stdout:checking for struct attrlist_cursor... yes 2023-06-23T18:47:54.312 INFO:teuthology.orchestra.run.smithi158.stdout:checking for pkg-config... /bin/pkg-config 2023-06-23T18:47:54.324 INFO:teuthology.orchestra.run.smithi158.stdout:checking pkg-config is at least version 0.9.0... yes 2023-06-23T18:47:54.337 INFO:teuthology.orchestra.run.smithi158.stdout:checking for libicu... yes 2023-06-23T18:47:54.387 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether openat is declared... yes 2023-06-23T18:47:54.440 INFO:teuthology.orchestra.run.smithi158.stdout:checking whether fstatat is declared... yes 2023-06-23T18:47:54.492 INFO:teuthology.orchestra.run.smithi158.stdout:checking for struct sg_io_hdr ... yes 2023-06-23T18:47:54.533 INFO:teuthology.orchestra.run.smithi158.stdout:checking for struct hd_geometry ... yes 2023-06-23T18:47:54.565 INFO:teuthology.orchestra.run.smithi158.stdout:checking for systemd... yes 2023-06-23T18:47:54.567 INFO:teuthology.orchestra.run.smithi158.stdout:checking for systemd system unit dir... /usr/lib/systemd/system 2023-06-23T18:47:54.568 INFO:teuthology.orchestra.run.smithi158.stdout:checking for system crontab dir... /etc/cron.d 2023-06-23T18:47:54.704 INFO:teuthology.orchestra.run.smithi158.stdout:checking for library containing blkid_probe_all... -lblkid 2023-06-23T18:47:54.772 INFO:teuthology.orchestra.run.smithi158.stdout:checking for blkid_probe_get_topology... yes 2023-06-23T18:47:54.863 INFO:teuthology.orchestra.run.smithi158.stdout:checking size of long... 8 2023-06-23T18:47:54.954 INFO:teuthology.orchestra.run.smithi158.stdout:checking size of char *... 8 2023-06-23T18:47:54.985 INFO:teuthology.orchestra.run.smithi158.stdout:checking for umode_t... no 2023-06-23T18:47:55.066 INFO:teuthology.orchestra.run.smithi158.stdout:checking for atomic64_t support in liburcu... yes 2023-06-23T18:47:55.098 INFO:teuthology.orchestra.run.smithi158.stdout:configure: creating ./config.status 2023-06-23T18:47:56.013 INFO:teuthology.orchestra.run.smithi158.stdout:config.status: creating include/builddefs 2023-06-23T18:47:56.041 INFO:teuthology.orchestra.run.smithi158.stdout:config.status: creating include/platform_defs.h 2023-06-23T18:47:56.063 INFO:teuthology.orchestra.run.smithi158.stdout:config.status: executing libtool commands 2023-06-23T18:47:56.150 INFO:teuthology.orchestra.run.smithi158.stdout: [HEADERS] include 2023-06-23T18:47:56.165 INFO:teuthology.orchestra.run.smithi158.stdout: [HEADERS] libxfs 2023-06-23T18:47:56.193 INFO:teuthology.orchestra.run.smithi158.stdout:Building include 2023-06-23T18:47:56.203 INFO:teuthology.orchestra.run.smithi158.stdout: [LN] disk 2023-06-23T18:47:56.207 INFO:teuthology.orchestra.run.smithi158.stdout:Building libfrog 2023-06-23T18:47:56.213 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] gen_crc32table 2023-06-23T18:47:56.284 INFO:teuthology.orchestra.run.smithi158.stdout: [GENERATE] crc32table.h 2023-06-23T18:47:57.016 INFO:teuthology.orchestra.run.smithi158.stdout: [TEST] CRC32 2023-06-23T18:47:57.192 INFO:teuthology.orchestra.run.smithi158.stdout:CRC_LE_BITS = 64 2023-06-23T18:47:57.193 INFO:teuthology.orchestra.run.smithi158.stdout:crc32c: tests passed, 225944 bytes in 57 usec 2023-06-23T18:47:57.196 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] avl64.lo 2023-06-23T18:47:57.789 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] bitmap.lo 2023-06-23T18:47:58.249 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] bulkstat.lo 2023-06-23T18:47:58.626 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:47:58.629 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:47:58.631 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:47:58.775 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] convert.lo 2023-06-23T18:47:59.249 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] crc32.lo 2023-06-23T18:47:59.610 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] fsgeom.lo 2023-06-23T18:48:00.064 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] list_sort.lo 2023-06-23T18:48:00.410 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] linux.lo 2023-06-23T18:48:00.868 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] logging.lo 2023-06-23T18:48:01.161 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] paths.lo 2023-06-23T18:48:01.717 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] projects.lo 2023-06-23T18:48:02.148 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] ptvar.lo 2023-06-23T18:48:02.533 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] radix-tree.lo 2023-06-23T18:48:03.179 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] randbytes.lo 2023-06-23T18:48:03.529 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] scrub.lo 2023-06-23T18:48:03.873 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] util.lo 2023-06-23T18:48:04.229 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] workqueue.lo 2023-06-23T18:48:04.642 INFO:teuthology.orchestra.run.smithi158.stdout: [LD] libfrog.la 2023-06-23T18:48:04.781 INFO:teuthology.orchestra.run.smithi158.stdout:Building libxfs 2023-06-23T18:48:06.486 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] cache.lo 2023-06-23T18:48:07.139 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] defer_item.lo 2023-06-23T18:48:07.679 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] init.lo 2023-06-23T18:48:08.502 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] kmem.lo 2023-06-23T18:48:08.925 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] logitem.lo 2023-06-23T18:48:09.356 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] rdwr.lo 2023-06-23T18:48:10.301 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] topology.lo 2023-06-23T18:48:10.808 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] trans.lo 2023-06-23T18:48:11.425 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] util.lo 2023-06-23T18:48:12.054 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_ag.lo 2023-06-23T18:48:12.954 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_ag_resv.lo 2023-06-23T18:48:13.450 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_alloc.lo 2023-06-23T18:48:14.960 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_alloc_btree.lo 2023-06-23T18:48:15.566 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_attr.lo 2023-06-23T18:48:16.308 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_attr_leaf.lo 2023-06-23T18:48:17.789 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_attr_remote.lo 2023-06-23T18:48:18.453 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_bit.lo 2023-06-23T18:48:18.876 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_bmap.lo 2023-06-23T18:48:21.645 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_bmap_btree.lo 2023-06-23T18:48:22.293 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_btree.lo 2023-06-23T18:48:24.452 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_btree_staging.lo 2023-06-23T18:48:25.037 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_da_btree.lo 2023-06-23T18:48:26.376 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_defer.lo 2023-06-23T18:48:27.014 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_dir2.lo 2023-06-23T18:48:27.639 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_dir2_block.lo 2023-06-23T18:48:28.600 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_dir2_data.lo 2023-06-23T18:48:28.732 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:48:28.734 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:48:28.737 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:48:29.518 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_dir2_leaf.lo 2023-06-23T18:48:30.547 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_dir2_node.lo 2023-06-23T18:48:31.701 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_dir2_sf.lo 2023-06-23T18:48:32.589 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_dquot_buf.lo 2023-06-23T18:48:33.107 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_ialloc.lo 2023-06-23T18:48:34.464 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_iext_tree.lo 2023-06-23T18:48:35.318 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_inode_buf.lo 2023-06-23T18:48:36.091 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_inode_fork.lo 2023-06-23T18:48:36.833 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_ialloc_btree.lo 2023-06-23T18:48:37.477 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_log_rlimit.lo 2023-06-23T18:48:37.925 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_refcount.lo 2023-06-23T18:48:38.829 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_refcount_btree.lo 2023-06-23T18:48:39.410 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_rmap.lo 2023-06-23T18:48:40.606 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_rmap_btree.lo 2023-06-23T18:48:41.247 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_rtbitmap.lo 2023-06-23T18:48:41.983 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_sb.lo 2023-06-23T18:48:42.895 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_symlink_remote.lo 2023-06-23T18:48:43.391 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_trans_inode.lo 2023-06-23T18:48:43.839 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_trans_resv.lo 2023-06-23T18:48:44.542 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_types.lo 2023-06-23T18:48:45.032 INFO:teuthology.orchestra.run.smithi158.stdout: [LD] libxfs.la 2023-06-23T18:48:45.287 INFO:teuthology.orchestra.run.smithi158.stdout:Building libxlog 2023-06-23T18:48:45.385 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_log_recover.lo 2023-06-23T18:48:46.296 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] util.lo 2023-06-23T18:48:46.797 INFO:teuthology.orchestra.run.smithi158.stdout: [LD] libxlog.la 2023-06-23T18:48:46.916 INFO:teuthology.orchestra.run.smithi158.stdout:Building libxcmd 2023-06-23T18:48:47.055 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] command.lo 2023-06-23T18:48:47.518 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] input.lo 2023-06-23T18:48:47.955 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] help.lo 2023-06-23T18:48:48.331 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] quit.lo 2023-06-23T18:48:48.685 INFO:teuthology.orchestra.run.smithi158.stdout: [LD] libxcmd.la 2023-06-23T18:48:48.804 INFO:teuthology.orchestra.run.smithi158.stdout:Building libhandle 2023-06-23T18:48:48.890 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] handle.lo 2023-06-23T18:48:49.370 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] jdm.lo 2023-06-23T18:48:49.779 INFO:teuthology.orchestra.run.smithi158.stdout: [LD] libhandle.la 2023-06-23T18:48:49.936 INFO:teuthology.orchestra.run.smithi158.stdout:Building copy 2023-06-23T18:48:49.995 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_copy.o 2023-06-23T18:48:50.427 INFO:teuthology.orchestra.run.smithi158.stdout: [LD] xfs_copy 2023-06-23T18:48:50.655 INFO:teuthology.orchestra.run.smithi158.stdout:Building db 2023-06-23T18:48:52.714 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] addr.o 2023-06-23T18:48:52.838 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] agf.o 2023-06-23T18:48:52.955 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] agfl.o 2023-06-23T18:48:53.073 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] agi.o 2023-06-23T18:48:53.189 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] attr.o 2023-06-23T18:48:53.407 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] attrshort.o 2023-06-23T18:48:53.544 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] bit.o 2023-06-23T18:48:53.682 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] block.o 2023-06-23T18:48:53.839 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] bmap.o 2023-06-23T18:48:54.051 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] btblock.o 2023-06-23T18:48:54.198 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] bmroot.o 2023-06-23T18:48:54.378 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] check.o 2023-06-23T18:48:56.084 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] command.o 2023-06-23T18:48:56.211 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] crc.o 2023-06-23T18:48:56.345 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] debug.o 2023-06-23T18:48:56.454 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] dir2.o 2023-06-23T18:48:56.760 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] dir2sf.o 2023-06-23T18:48:56.916 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] dquot.o 2023-06-23T18:48:57.046 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] echo.o 2023-06-23T18:48:57.155 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] faddr.o 2023-06-23T18:48:57.345 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] field.o 2023-06-23T18:48:57.474 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] flist.o 2023-06-23T18:48:57.672 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] fprint.o 2023-06-23T18:48:57.846 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] frag.o 2023-06-23T18:48:58.093 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] freesp.o 2023-06-23T18:48:58.300 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] hash.o 2023-06-23T18:48:58.409 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] help.o 2023-06-23T18:48:58.524 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] init.o 2023-06-23T18:48:58.664 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] inode.o 2023-06-23T18:48:58.843 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:48:58.846 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:48:58.849 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:48:58.962 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] input.o 2023-06-23T18:48:59.116 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] io.o 2023-06-23T18:48:59.332 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] logformat.o 2023-06-23T18:48:59.466 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] malloc.o 2023-06-23T18:48:59.580 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] metadump.o 2023-06-23T18:49:00.387 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] output.o 2023-06-23T18:49:00.510 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] print.o 2023-06-23T18:49:00.677 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] quit.o 2023-06-23T18:49:00.783 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] sb.o 2023-06-23T18:49:01.066 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] sig.o 2023-06-23T18:49:01.177 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] strvec.o 2023-06-23T18:49:01.300 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] text.o 2023-06-23T18:49:01.418 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] type.o 2023-06-23T18:49:01.556 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] write.o 2023-06-23T18:49:01.800 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] attrset.o 2023-06-23T18:49:01.942 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] symlink.o 2023-06-23T18:49:02.056 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] fsmap.o 2023-06-23T18:49:02.194 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] fuzz.o 2023-06-23T18:49:02.372 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] btdump.o 2023-06-23T18:49:02.561 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] btheight.o 2023-06-23T18:49:02.735 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] convert.o 2023-06-23T18:49:02.888 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] info.o 2023-06-23T18:49:03.021 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] namei.o 2023-06-23T18:49:03.236 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] timelimit.o 2023-06-23T18:49:03.362 INFO:teuthology.orchestra.run.smithi158.stdout: [LD] xfs_db 2023-06-23T18:49:03.663 INFO:teuthology.orchestra.run.smithi158.stdout:Building estimate 2023-06-23T18:49:03.722 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_estimate.o 2023-06-23T18:49:03.869 INFO:teuthology.orchestra.run.smithi158.stdout: [LD] xfs_estimate 2023-06-23T18:49:03.968 INFO:teuthology.orchestra.run.smithi158.stdout:Building fsck 2023-06-23T18:49:03.976 INFO:teuthology.orchestra.run.smithi158.stdout:Building fsr 2023-06-23T18:49:04.036 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_fsr.o 2023-06-23T18:49:04.451 INFO:teuthology.orchestra.run.smithi158.stdout: [LD] xfs_fsr 2023-06-23T18:49:04.597 INFO:teuthology.orchestra.run.smithi158.stdout:Building growfs 2023-06-23T18:49:04.656 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_growfs.o 2023-06-23T18:49:04.843 INFO:teuthology.orchestra.run.smithi158.stdout: [LD] xfs_growfs 2023-06-23T18:49:05.053 INFO:teuthology.orchestra.run.smithi158.stdout:Building io 2023-06-23T18:49:06.479 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] init.o 2023-06-23T18:49:06.594 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] attr.o 2023-06-23T18:49:06.738 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] bmap.o 2023-06-23T18:49:06.918 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] bulkstat.o 2023-06-23T18:49:07.074 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] crc32cselftest.o 2023-06-23T18:49:07.163 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] cowextsize.o 2023-06-23T18:49:07.273 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] encrypt.o 2023-06-23T18:49:07.479 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] file.o 2023-06-23T18:49:07.583 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] freeze.o 2023-06-23T18:49:07.673 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] fsuuid.o 2023-06-23T18:49:07.784 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] fsync.o 2023-06-23T18:49:07.867 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] getrusage.o 2023-06-23T18:49:07.962 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] imap.o 2023-06-23T18:49:08.052 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] inject.o 2023-06-23T18:49:08.153 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] label.o 2023-06-23T18:49:08.271 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] link.o 2023-06-23T18:49:08.354 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] mmap.o 2023-06-23T18:49:08.555 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] open.o 2023-06-23T18:49:08.824 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] parent.o 2023-06-23T18:49:08.978 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] pread.o 2023-06-23T18:49:09.153 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] prealloc.o 2023-06-23T18:49:09.291 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] pwrite.o 2023-06-23T18:49:09.445 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] reflink.o 2023-06-23T18:49:09.572 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] resblks.o 2023-06-23T18:49:09.659 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] scrub.o 2023-06-23T18:49:09.785 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] seek.o 2023-06-23T18:49:09.892 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] shutdown.o 2023-06-23T18:49:09.979 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] stat.o 2023-06-23T18:49:10.175 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] swapext.o 2023-06-23T18:49:10.264 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] sync.o 2023-06-23T18:49:10.346 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] truncate.o 2023-06-23T18:49:10.429 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] utimes.o 2023-06-23T18:49:10.515 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] fadvise.o 2023-06-23T18:49:10.606 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] madvise.o 2023-06-23T18:49:10.699 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] mincore.o 2023-06-23T18:49:10.796 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] sendfile.o 2023-06-23T18:49:10.901 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] fiemap.o 2023-06-23T18:49:11.051 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] copy_file_range.o 2023-06-23T18:49:11.154 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] sync_file_range.o 2023-06-23T18:49:11.246 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] readdir.o 2023-06-23T18:49:11.348 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] log_writes.o 2023-06-23T18:49:11.442 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] fsmap.o 2023-06-23T18:49:11.668 INFO:teuthology.orchestra.run.smithi158.stdout: [LD] xfs_io 2023-06-23T18:49:11.898 INFO:teuthology.orchestra.run.smithi158.stdout:Building logprint 2023-06-23T18:49:12.188 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] logprint.o 2023-06-23T18:49:12.330 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] log_copy.o 2023-06-23T18:49:12.446 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] log_dump.o 2023-06-23T18:49:12.572 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] log_misc.o 2023-06-23T18:49:13.053 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] log_print_all.o 2023-06-23T18:49:13.296 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] log_print_trans.o 2023-06-23T18:49:13.413 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] log_redo.o 2023-06-23T18:49:13.662 INFO:teuthology.orchestra.run.smithi158.stdout: [LD] xfs_logprint 2023-06-23T18:49:13.880 INFO:teuthology.orchestra.run.smithi158.stdout:Building mkfs 2023-06-23T18:49:13.979 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] proto.o 2023-06-23T18:49:14.239 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_mkfs.o 2023-06-23T18:49:14.929 INFO:teuthology.orchestra.run.smithi158.stdout: [LD] mkfs.xfs 2023-06-23T18:49:15.149 INFO:teuthology.orchestra.run.smithi158.stdout:Building quota 2023-06-23T18:49:15.545 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] init.o 2023-06-23T18:49:15.646 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] util.o 2023-06-23T18:49:15.799 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] edit.o 2023-06-23T18:49:15.996 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] free.o 2023-06-23T18:49:16.140 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] linux.o 2023-06-23T18:49:16.219 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] path.o 2023-06-23T18:49:16.331 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] project.o 2023-06-23T18:49:16.468 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] quot.o 2023-06-23T18:49:16.622 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] quota.o 2023-06-23T18:49:16.786 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] report.o 2023-06-23T18:49:17.005 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] state.o 2023-06-23T18:49:17.179 INFO:teuthology.orchestra.run.smithi158.stdout: [LD] xfs_quota 2023-06-23T18:49:17.332 INFO:teuthology.orchestra.run.smithi158.stdout:Building mdrestore 2023-06-23T18:49:17.391 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_mdrestore.o 2023-06-23T18:49:17.553 INFO:teuthology.orchestra.run.smithi158.stdout: [LD] xfs_mdrestore 2023-06-23T18:49:17.742 INFO:teuthology.orchestra.run.smithi158.stdout:Building repair 2023-06-23T18:49:19.111 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] agheader.o 2023-06-23T18:49:19.326 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] agbtree.o 2023-06-23T18:49:19.559 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] attr_repair.o 2023-06-23T18:49:19.917 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] avl.o 2023-06-23T18:49:20.136 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] bulkload.o 2023-06-23T18:49:20.262 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] bmap.o 2023-06-23T18:49:20.418 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] btree.o 2023-06-23T18:49:20.735 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] da_util.o 2023-06-23T18:49:20.958 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] dino_chunks.o 2023-06-23T18:49:21.335 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] dinode.o 2023-06-23T18:49:22.070 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] dir2.o 2023-06-23T18:49:22.472 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] globals.o 2023-06-23T18:49:22.573 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] incore_bmc.o 2023-06-23T18:49:22.686 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] incore.o 2023-06-23T18:49:22.836 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] incore_ext.o 2023-06-23T18:49:23.056 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] incore_ino.o 2023-06-23T18:49:23.320 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] init.o 2023-06-23T18:49:23.459 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] phase1.o 2023-06-23T18:49:23.587 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] phase2.o 2023-06-23T18:49:23.779 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] phase3.o 2023-06-23T18:49:23.924 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] phase4.o 2023-06-23T18:49:24.115 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] phase5.o 2023-06-23T18:49:24.372 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] phase6.o 2023-06-23T18:49:25.226 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] phase7.o 2023-06-23T18:49:25.365 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] prefetch.o 2023-06-23T18:49:25.701 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] progress.o 2023-06-23T18:49:25.899 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] quotacheck.o 2023-06-23T18:49:26.104 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] rmap.o 2023-06-23T18:49:26.486 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] rt.o 2023-06-23T18:49:26.647 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] sb.o 2023-06-23T18:49:26.871 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] scan.o 2023-06-23T18:49:27.612 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] slab.o 2023-06-23T18:49:27.778 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] threads.o 2023-06-23T18:49:27.892 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] versions.o 2023-06-23T18:49:28.024 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_repair.o 2023-06-23T18:49:28.332 INFO:teuthology.orchestra.run.smithi158.stdout: [LD] xfs_repair 2023-06-23T18:49:28.630 INFO:teuthology.orchestra.run.smithi158.stdout:Building rtcp 2023-06-23T18:49:28.689 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_rtcp.o 2023-06-23T18:49:28.861 INFO:teuthology.orchestra.run.smithi158.stdout: [LD] xfs_rtcp 2023-06-23T18:49:28.953 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:49:28.956 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:49:28.958 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:49:28.981 INFO:teuthology.orchestra.run.smithi158.stdout:Building m4 2023-06-23T18:49:28.989 INFO:teuthology.orchestra.run.smithi158.stdout:Building man 2023-06-23T18:49:28.999 INFO:teuthology.orchestra.run.smithi158.stdout:Building man2 2023-06-23T18:49:29.011 INFO:teuthology.orchestra.run.smithi158.stdout:Building man3 2023-06-23T18:49:29.020 INFO:teuthology.orchestra.run.smithi158.stdout:Building man5 2023-06-23T18:49:29.030 INFO:teuthology.orchestra.run.smithi158.stdout:Building man8 2023-06-23T18:49:29.050 INFO:teuthology.orchestra.run.smithi158.stdout: [SED] mkfs.xfs.8 2023-06-23T18:49:29.058 INFO:teuthology.orchestra.run.smithi158.stdout:Building doc 2023-06-23T18:49:29.068 INFO:teuthology.orchestra.run.smithi158.stdout: [ZIP] CHANGES.gz 2023-06-23T18:49:29.081 INFO:teuthology.orchestra.run.smithi158.stdout:Building debian 2023-06-23T18:49:29.088 INFO:teuthology.orchestra.run.smithi158.stdout:Building spaceman 2023-06-23T18:49:29.382 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] info.o 2023-06-23T18:49:29.494 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] init.o 2023-06-23T18:49:29.618 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] file.o 2023-06-23T18:49:29.743 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] health.o 2023-06-23T18:49:29.907 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] prealloc.o 2023-06-23T18:49:30.028 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] trim.o 2023-06-23T18:49:30.156 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] freesp.o 2023-06-23T18:49:30.340 INFO:teuthology.orchestra.run.smithi158.stdout: [LD] xfs_spaceman 2023-06-23T18:49:30.489 INFO:teuthology.orchestra.run.smithi158.stdout:Building scrub 2023-06-23T18:49:31.235 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] common.o 2023-06-23T18:49:31.374 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] counter.o 2023-06-23T18:49:31.448 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] descr.o 2023-06-23T18:49:31.537 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] disk.o 2023-06-23T18:49:31.661 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] filemap.o 2023-06-23T18:49:31.756 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] fscounters.o 2023-06-23T18:49:31.859 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] inodes.o 2023-06-23T18:49:32.010 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] phase1.o 2023-06-23T18:49:32.120 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] phase2.o 2023-06-23T18:49:32.227 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] phase3.o 2023-06-23T18:49:32.348 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] phase4.o 2023-06-23T18:49:32.450 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] phase5.o 2023-06-23T18:49:32.592 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] phase6.o 2023-06-23T18:49:32.774 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] phase7.o 2023-06-23T18:49:32.896 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] progress.o 2023-06-23T18:49:33.006 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] read_verify.o 2023-06-23T18:49:33.133 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] repair.o 2023-06-23T18:49:33.257 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] scrub.o 2023-06-23T18:49:33.463 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] spacemap.o 2023-06-23T18:49:33.582 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] vfs.o 2023-06-23T18:49:33.707 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] xfs_scrub.o 2023-06-23T18:49:33.898 INFO:teuthology.orchestra.run.smithi158.stdout: [CC] unicrash.o 2023-06-23T18:49:34.079 INFO:teuthology.orchestra.run.smithi158.stdout: [LD] xfs_scrub 2023-06-23T18:49:34.415 INFO:teuthology.orchestra.run.smithi158.stdout: [SED] xfs_scrub_all 2023-06-23T18:49:34.424 INFO:teuthology.orchestra.run.smithi158.stdout: [SED] xfs_scrub@.service 2023-06-23T18:49:34.431 INFO:teuthology.orchestra.run.smithi158.stdout: [SED] xfs_scrub_all.service 2023-06-23T18:49:34.438 INFO:teuthology.orchestra.run.smithi158.stdout: [SED] xfs_scrub_fail@.service 2023-06-23T18:49:34.446 INFO:teuthology.orchestra.run.smithi158.stdout: [SED] xfs_scrub_all.cron 2023-06-23T18:49:34.453 INFO:teuthology.orchestra.run.smithi158.stdout:Building po 2023-06-23T18:49:34.481 INFO:teuthology.orchestra.run.smithi158.stdout: [GETTXT] xfsprogs.pot 2023-06-23T18:49:34.711 INFO:teuthology.orchestra.run.smithi158.stdout: [MSGFMT] pl.mo 2023-06-23T18:49:34.763 INFO:teuthology.orchestra.run.smithi158.stderr:3104 translated messages. 2023-06-23T18:49:34.767 INFO:teuthology.orchestra.run.smithi158.stdout: [MSGFMT] de.mo 2023-06-23T18:49:34.802 INFO:teuthology.orchestra.run.smithi158.stderr:2345 translated messages. 2023-06-23T18:49:34.803 INFO:teuthology.orchestra.run.smithi158.stdout:gmake[2]: Nothing to be done for 'include'. 2023-06-23T18:49:34.807 DEBUG:teuthology.orchestra.run.smithi158:> (cd /tmp/tmp.Ga11jYSuehxfsprogs-dev && exec sudo make install) 2023-06-23T18:49:34.929 INFO:teuthology.orchestra.run.smithi158.stdout:Installing libfrog-install 2023-06-23T18:49:35.381 INFO:teuthology.orchestra.run.smithi158.stdout:Installing libxfs-install 2023-06-23T18:49:37.076 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-06-23T18:49:37.100 INFO:teuthology.orchestra.run.smithi158.stdout:Installing libxlog-install 2023-06-23T18:49:37.194 INFO:teuthology.orchestra.run.smithi158.stdout:Installing libxcmd-install 2023-06-23T18:49:37.329 INFO:teuthology.orchestra.run.smithi158.stdout:Installing libhandle-install 2023-06-23T18:49:37.406 INFO:teuthology.orchestra.run.smithi158.stdout:cd ../libhandle/.libs; ../../install-sh -o root -g root -m 755 -d /lib64; ../../install-sh -o root -g root -m 755 -T so_dot_version libhandle.lai /lib64; ../../install-sh -o root -g root -T so_dot_current libhandle.lai /lib64 2023-06-23T18:49:37.501 INFO:teuthology.orchestra.run.smithi158.stdout:Installing copy-install 2023-06-23T18:49:37.554 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-06-23T18:49:37.576 INFO:teuthology.orchestra.run.smithi158.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_copy /usr/sbin 2023-06-23T18:49:37.643 INFO:teuthology.orchestra.run.smithi158.stdout:Installing db-install 2023-06-23T18:49:39.703 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-06-23T18:49:39.726 INFO:teuthology.orchestra.run.smithi158.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_db /usr/sbin 2023-06-23T18:49:39.797 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 xfs_admin.sh /usr/sbin/xfs_admin 2023-06-23T18:49:39.820 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 xfs_ncheck.sh /usr/sbin/xfs_ncheck 2023-06-23T18:49:39.843 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 xfs_metadump.sh /usr/sbin/xfs_metadump 2023-06-23T18:49:39.868 INFO:teuthology.orchestra.run.smithi158.stdout:Installing estimate-install 2023-06-23T18:49:39.920 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-06-23T18:49:39.943 INFO:teuthology.orchestra.run.smithi158.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_estimate /usr/sbin 2023-06-23T18:49:40.001 INFO:teuthology.orchestra.run.smithi158.stdout:Installing fsck-install 2023-06-23T18:49:40.004 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-06-23T18:49:40.027 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 xfs_fsck.sh /sbin/fsck.xfs 2023-06-23T18:49:40.066 INFO:teuthology.orchestra.run.smithi158.stdout:Installing fsr-install 2023-06-23T18:49:40.119 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-06-23T18:49:40.142 INFO:teuthology.orchestra.run.smithi158.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_fsr /usr/sbin 2023-06-23T18:49:40.200 INFO:teuthology.orchestra.run.smithi158.stdout:Installing growfs-install 2023-06-23T18:49:40.252 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-06-23T18:49:40.274 INFO:teuthology.orchestra.run.smithi158.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_growfs /usr/sbin 2023-06-23T18:49:40.341 INFO:teuthology.orchestra.run.smithi158.stdout:Installing io-install 2023-06-23T18:49:41.759 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-06-23T18:49:41.782 INFO:teuthology.orchestra.run.smithi158.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_io /usr/sbin 2023-06-23T18:49:41.839 INFO:teuthology.orchestra.run.smithi158.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_bmap.sh /usr/sbin/xfs_bmap 2023-06-23T18:49:41.895 INFO:teuthology.orchestra.run.smithi158.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_freeze.sh /usr/sbin/xfs_freeze 2023-06-23T18:49:41.950 INFO:teuthology.orchestra.run.smithi158.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mkfile.sh /usr/sbin/xfs_mkfile 2023-06-23T18:49:42.008 INFO:teuthology.orchestra.run.smithi158.stdout:Installing logprint-install 2023-06-23T18:49:42.291 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-06-23T18:49:42.314 INFO:teuthology.orchestra.run.smithi158.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_logprint /usr/sbin 2023-06-23T18:49:42.382 INFO:teuthology.orchestra.run.smithi158.stdout:Installing mkfs-install 2023-06-23T18:49:42.475 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-06-23T18:49:42.497 INFO:teuthology.orchestra.run.smithi158.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 mkfs.xfs /sbin 2023-06-23T18:49:42.563 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 -d /usr/share/xfsprogs/mkfs 2023-06-23T18:49:42.586 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 644 dax_x86_64.conf lts_4.19.conf lts_5.4.conf lts_5.10.conf lts_5.15.conf lts_6.1.conf /usr/share/xfsprogs/mkfs 2023-06-23T18:49:42.647 INFO:teuthology.orchestra.run.smithi158.stdout:Installing quota-install 2023-06-23T18:49:43.020 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-06-23T18:49:43.043 INFO:teuthology.orchestra.run.smithi158.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_quota /usr/sbin 2023-06-23T18:49:43.101 INFO:teuthology.orchestra.run.smithi158.stdout:Installing mdrestore-install 2023-06-23T18:49:43.153 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-06-23T18:49:43.176 INFO:teuthology.orchestra.run.smithi158.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mdrestore /usr/sbin 2023-06-23T18:49:43.243 INFO:teuthology.orchestra.run.smithi158.stdout:Installing repair-install 2023-06-23T18:49:44.617 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-06-23T18:49:44.640 INFO:teuthology.orchestra.run.smithi158.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_repair /sbin 2023-06-23T18:49:44.712 INFO:teuthology.orchestra.run.smithi158.stdout:Installing rtcp-install 2023-06-23T18:49:44.763 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-06-23T18:49:44.786 INFO:teuthology.orchestra.run.smithi158.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_rtcp /usr/sbin 2023-06-23T18:49:44.843 INFO:teuthology.orchestra.run.smithi158.stdout:Installing m4-install 2023-06-23T18:49:44.846 INFO:teuthology.orchestra.run.smithi158.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-23T18:49:44.848 INFO:teuthology.orchestra.run.smithi158.stdout:Installing man-install 2023-06-23T18:49:44.856 INFO:teuthology.orchestra.run.smithi158.stdout:gmake[2]: Nothing to be done for 'install'. 2023-06-23T18:49:44.861 INFO:teuthology.orchestra.run.smithi158.stdout:gmake[2]: Nothing to be done for 'install'. 2023-06-23T18:49:44.868 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man5 2023-06-23T18:49:44.898 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 projects.5 /usr/share/man/man5/projects.5 2023-06-23T18:49:44.926 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 projid.5 /usr/share/man/man5/projid.5 2023-06-23T18:49:44.955 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 xfs.5 /usr/share/man/man5/xfs.5 2023-06-23T18:49:44.989 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man8 2023-06-23T18:49:45.018 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 fsck.xfs.8 /usr/share/man/man8/fsck.xfs.8 2023-06-23T18:49:45.047 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-06-23T18:49:45.075 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 xfs_admin.8 /usr/share/man/man8/xfs_admin.8 2023-06-23T18:49:45.104 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 xfs_bmap.8 /usr/share/man/man8/xfs_bmap.8 2023-06-23T18:49:45.132 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 xfs_copy.8 /usr/share/man/man8/xfs_copy.8 2023-06-23T18:49:45.161 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 xfs_db.8 /usr/share/man/man8/xfs_db.8 2023-06-23T18:49:45.190 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 xfs_estimate.8 /usr/share/man/man8/xfs_estimate.8 2023-06-23T18:49:45.218 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 xfs_freeze.8 /usr/share/man/man8/xfs_freeze.8 2023-06-23T18:49:45.247 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 xfs_fsr.8 /usr/share/man/man8/xfs_fsr.8 2023-06-23T18:49:45.275 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 xfs_growfs.8 /usr/share/man/man8/xfs_growfs.8 2023-06-23T18:49:45.304 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 xfs_info.8 /usr/share/man/man8/xfs_info.8 2023-06-23T18:49:45.332 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 xfs_io.8 /usr/share/man/man8/xfs_io.8 2023-06-23T18:49:45.361 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 xfs_logprint.8 /usr/share/man/man8/xfs_logprint.8 2023-06-23T18:49:45.390 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 xfs_mdrestore.8 /usr/share/man/man8/xfs_mdrestore.8 2023-06-23T18:49:45.418 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 xfs_metadump.8 /usr/share/man/man8/xfs_metadump.8 2023-06-23T18:49:45.446 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 xfs_mkfile.8 /usr/share/man/man8/xfs_mkfile.8 2023-06-23T18:49:45.475 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 xfs_ncheck.8 /usr/share/man/man8/xfs_ncheck.8 2023-06-23T18:49:45.504 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 xfs_quota.8 /usr/share/man/man8/xfs_quota.8 2023-06-23T18:49:45.532 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 xfs_repair.8 /usr/share/man/man8/xfs_repair.8 2023-06-23T18:49:45.561 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 xfs_rtcp.8 /usr/share/man/man8/xfs_rtcp.8 2023-06-23T18:49:45.589 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 xfs_scrub.8 /usr/share/man/man8/xfs_scrub.8 2023-06-23T18:49:45.618 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 xfs_scrub_all.8 /usr/share/man/man8/xfs_scrub_all.8 2023-06-23T18:49:45.646 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 xfs_spaceman.8 /usr/share/man/man8/xfs_spaceman.8 2023-06-23T18:49:45.675 INFO:teuthology.orchestra.run.smithi158.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-06-23T18:49:45.702 INFO:teuthology.orchestra.run.smithi158.stdout:Installing doc-install 2023-06-23T18:49:45.705 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-06-23T18:49:45.727 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 644 CHANGES.gz CREDITS /usr/share/doc/xfsprogs 2023-06-23T18:49:45.760 INFO:teuthology.orchestra.run.smithi158.stdout:Installing debian-install 2023-06-23T18:49:45.763 INFO:teuthology.orchestra.run.smithi158.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-23T18:49:45.765 INFO:teuthology.orchestra.run.smithi158.stdout:Installing spaceman-install 2023-06-23T18:49:46.052 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-06-23T18:49:46.075 INFO:teuthology.orchestra.run.smithi158.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_spaceman /usr/sbin 2023-06-23T18:49:46.132 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 xfs_info.sh /usr/sbin/xfs_info 2023-06-23T18:49:46.157 INFO:teuthology.orchestra.run.smithi158.stdout:Installing scrub-install 2023-06-23T18:49:46.894 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-06-23T18:49:46.917 INFO:teuthology.orchestra.run.smithi158.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_scrub /usr/sbin 2023-06-23T18:49:46.973 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 xfs_scrub_all /usr/sbin 2023-06-23T18:49:46.996 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/systemd/system 2023-06-23T18:49:47.019 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 644 xfs_scrub@.service xfs_scrub_all.service xfs_scrub_all.timer xfs_scrub_fail@.service /usr/lib/systemd/system 2023-06-23T18:49:47.064 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 -d /usr/lib64/xfsprogs 2023-06-23T18:49:47.087 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 xfs_scrub_fail /usr/lib64/xfsprogs 2023-06-23T18:49:47.110 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 -d /usr/lib64/xfsprogs 2023-06-23T18:49:47.133 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 644 xfs_scrub_all.cron /usr/lib64/xfsprogs 2023-06-23T18:49:47.158 INFO:teuthology.orchestra.run.smithi158.stdout:Installing po-install 2023-06-23T18:49:47.271 INFO:teuthology.orchestra.run.smithi158.stdout:Installing include-install 2023-06-23T18:49:47.274 INFO:teuthology.orchestra.run.smithi158.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-06-23T18:49:47.297 INFO:teuthology.orchestra.run.smithi158.stdout:./install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-06-23T18:49:47.320 INFO:teuthology.orchestra.run.smithi158.stdout:./install-sh -o root -g root -m 644 README /usr/share/doc/xfsprogs 2023-06-23T18:49:47.347 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-06-23T18:49:47.489 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.484+0000 7f6346abf700 1 Processor -- start 2023-06-23T18:49:47.490 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.484+0000 7f6346abf700 1 -- start start 2023-06-23T18:49:47.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.485+0000 7f6346abf700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f63400b7540 0x7f63400bc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.485+0000 7f6346abf700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63400b64a0 con 0x7f63400b6930 2023-06-23T18:49:47.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.485+0000 7f6346abf700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63400b7d90 con 0x7f634006a0d0 2023-06-23T18:49:47.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.485+0000 7f6346abf700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63400b55a0 con 0x7f63400b7540 2023-06-23T18:49:47.491 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.485+0000 7f633ffff700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f63400b7540 0x7f63400bc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.485+0000 7f634505c700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7f63400b6930 0x7f6340147b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:34940/0 (socket says 172.21.15.52:34940) 2023-06-23T18:49:47.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.485+0000 7f634505c700 1 -- 172.21.15.52:0/3573410347 learned_addr learned my addr 172.21.15.52:0/3573410347 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:49:47.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.485+0000 7f633ffff700 1 -- 172.21.15.52:0/3573410347 >> v1:172.21.15.89:6789/0 conn(0x7f634006a0d0 legacy=0x7f634014de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:47.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.485+0000 7f633ffff700 1 -- 172.21.15.52:0/3573410347 >> v1:172.21.15.52:6789/0 conn(0x7f63400b6930 legacy=0x7f6340147b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.485+0000 7f633ffff700 1 -- 172.21.15.52:0/3573410347 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63400b5880 con 0x7f63400b7540 2023-06-23T18:49:47.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.485+0000 7f633ffff700 1 --2- 172.21.15.52:0/3573410347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63400b7540 0x7f63400bc980 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f632c009840 tx=0x7f632c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3383a11bbf7e9e3c server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:47.492 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.486+0000 7f633f7fe700 1 -- 172.21.15.52:0/3573410347 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c004230 con 0x7f63400b7540 2023-06-23T18:49:47.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.486+0000 7f633f7fe700 1 -- 172.21.15.52:0/3573410347 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c004390 con 0x7f63400b7540 2023-06-23T18:49:47.493 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.486+0000 7f633f7fe700 1 -- 172.21.15.52:0/3573410347 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c0036a0 con 0x7f63400b7540 2023-06-23T18:49:47.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.486+0000 7f6346abf700 1 -- 172.21.15.52:0/3573410347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63400b7540 msgr2=0x7f63400bc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.486+0000 7f6346abf700 1 --2- 172.21.15.52:0/3573410347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63400b7540 0x7f63400bc980 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f632c009840 tx=0x7f632c009b50 comp rx=0 tx=0).stop 2023-06-23T18:49:47.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.486+0000 7f6346abf700 1 -- 172.21.15.52:0/3573410347 shutdown_connections 2023-06-23T18:49:47.495 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.486+0000 7f6346abf700 1 --2- 172.21.15.52:0/3573410347 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63400b7540 0x7f63400bc980 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.486+0000 7f6346abf700 1 -- 172.21.15.52:0/3573410347 >> 172.21.15.52:0/3573410347 conn(0x7f634006bb20 msgr2=0x7f634006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:47.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.486+0000 7f6346abf700 1 -- 172.21.15.52:0/3573410347 shutdown_connections 2023-06-23T18:49:47.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.486+0000 7f6346abf700 1 -- 172.21.15.52:0/3573410347 wait complete. 2023-06-23T18:49:47.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.487+0000 7f6346abf700 1 Processor -- start 2023-06-23T18:49:47.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.487+0000 7f6346abf700 1 -- start start 2023-06-23T18:49:47.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.488+0000 7f6346abf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f634006a0d0 0x7f63401e3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.496 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.488+0000 7f6346abf700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63400b6930 0x7f6340143200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.488+0000 7f6346abf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63400b7540 0x7f6340143740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.488+0000 7f6346abf700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63401e3e60 con 0x7f63400b6930 2023-06-23T18:49:47.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.488+0000 7f6346abf700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634013d410 con 0x7f63400b7540 2023-06-23T18:49:47.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.488+0000 7f6346abf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6340141e70 con 0x7f634006a0d0 2023-06-23T18:49:47.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.488+0000 7f633ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63400b6930 0x7f6340143200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.488+0000 7f633ffff700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63400b6930 0x7f6340143200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34208/0 (socket says 172.21.15.52:34208) 2023-06-23T18:49:47.497 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.488+0000 7f633ffff700 1 -- 172.21.15.52:0/528110582 learned_addr learned my addr 172.21.15.52:0/528110582 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:49:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.489+0000 7f634505c700 1 --2- 172.21.15.52:0/528110582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63400b7540 0x7f6340143740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.489+0000 7f634485b700 1 --2- 172.21.15.52:0/528110582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f634006a0d0 0x7f63401e3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.489+0000 7f633ffff700 1 -- 172.21.15.52:0/528110582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f634006a0d0 msgr2=0x7f63401e3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.489+0000 7f633ffff700 1 --2- 172.21.15.52:0/528110582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f634006a0d0 0x7f63401e3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.489+0000 7f633ffff700 1 -- 172.21.15.52:0/528110582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63400b7540 msgr2=0x7f6340143740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.489+0000 7f633ffff700 1 --2- 172.21.15.52:0/528110582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63400b7540 0x7f6340143740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.489+0000 7f633ffff700 1 -- 172.21.15.52:0/528110582 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c0094a0 con 0x7f63400b6930 2023-06-23T18:49:47.498 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.489+0000 7f634485b700 1 --2- 172.21.15.52:0/528110582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f634006a0d0 0x7f63401e3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T18:49:47.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.489+0000 7f633ffff700 1 --2- 172.21.15.52:0/528110582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63400b6930 0x7f6340143200 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f632c004000 tx=0x7f632c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:47.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.489+0000 7f633d7fa700 1 -- 172.21.15.52:0/528110582 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c011630 con 0x7f63400b6930 2023-06-23T18:49:47.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.489+0000 7f633d7fa700 1 -- 172.21.15.52:0/528110582 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c01e070 con 0x7f63400b6930 2023-06-23T18:49:47.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.489+0000 7f6346abf700 1 -- 172.21.15.52:0/528110582 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63400b5ce0 con 0x7f63400b6930 2023-06-23T18:49:47.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.489+0000 7f633d7fa700 1 -- 172.21.15.52:0/528110582 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c0119d0 con 0x7f63400b6930 2023-06-23T18:49:47.500 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.489+0000 7f6346abf700 1 -- 172.21.15.52:0/528110582 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63400a5cd0 con 0x7f63400b6930 2023-06-23T18:49:47.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.490+0000 7f6346abf700 1 -- 172.21.15.52:0/528110582 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63400a6800 con 0x7f63400b6930 2023-06-23T18:49:47.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.491+0000 7f633d7fa700 1 -- 172.21.15.52:0/528110582 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f632c011b30 con 0x7f63400b6930 2023-06-23T18:49:47.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.491+0000 7f633d7fa700 1 --2- 172.21.15.52:0/528110582 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f632406ace0 0x7f632406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.501 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.491+0000 7f633d7fa700 1 -- 172.21.15.52:0/528110582 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f632c08a770 con 0x7f63400b6930 2023-06-23T18:49:47.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.491+0000 7f634485b700 1 --2- 172.21.15.52:0/528110582 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f632406ace0 0x7f632406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.492+0000 7f634485b700 1 --2- 172.21.15.52:0/528110582 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f632406ace0 0x7f632406d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6334006fd0 tx=0x7f6334008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:47.502 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.496+0000 7f633d7fa700 1 -- 172.21.15.52:0/528110582 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f632c055890 con 0x7f63400b6930 2023-06-23T18:49:47.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.774+0000 7f6346abf700 1 -- 172.21.15.52:0/528110582 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f634004e1d0 con 0x7f63400b6930 2023-06-23T18:49:47.780 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.775+0000 7f633d7fa700 1 -- 172.21.15.52:0/528110582 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1268 (secure 0 0 0) 0x7f632c020510 con 0x7f63400b6930 2023-06-23T18:49:47.780 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T18:49:47.781 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":1,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","modified":"2023-06-23T18:43:59.617637Z","created":"2023-06-23T18:43:59.617637Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3301","nonce":0},{"type":"v1","addr":"172.21.15.89:6790","nonce":0}]},"addr":"172.21.15.89:6790/0","public_addr":"172.21.15.89:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-06-23T18:49:47.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.777+0000 7f6346abf700 1 -- 172.21.15.52:0/528110582 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f632406ace0 msgr2=0x7f632406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.777+0000 7f6346abf700 1 --2- 172.21.15.52:0/528110582 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f632406ace0 0x7f632406d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6334006fd0 tx=0x7f6334008040 comp rx=0 tx=0).stop 2023-06-23T18:49:47.782 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.777+0000 7f6346abf700 1 -- 172.21.15.52:0/528110582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63400b6930 msgr2=0x7f6340143200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.777+0000 7f6346abf700 1 --2- 172.21.15.52:0/528110582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63400b6930 0x7f6340143200 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f632c004000 tx=0x7f632c004750 comp rx=0 tx=0).stop 2023-06-23T18:49:47.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.777+0000 7f6346abf700 1 -- 172.21.15.52:0/528110582 shutdown_connections 2023-06-23T18:49:47.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.777+0000 7f6346abf700 1 --2- 172.21.15.52:0/528110582 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f632406ace0 0x7f632406d190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.777+0000 7f6346abf700 1 --2- 172.21.15.52:0/528110582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f63400b7540 0x7f6340143740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.777+0000 7f6346abf700 1 --2- 172.21.15.52:0/528110582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f634006a0d0 0x7f63401e3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.777+0000 7f6346abf700 1 --2- 172.21.15.52:0/528110582 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63400b6930 0x7f6340143200 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.783 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.777+0000 7f6346abf700 1 -- 172.21.15.52:0/528110582 >> 172.21.15.52:0/528110582 conn(0x7f634006bb20 msgr2=0x7f63400be5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:47.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.777+0000 7f6346abf700 1 -- 172.21.15.52:0/528110582 shutdown_connections 2023-06-23T18:49:47.784 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.777+0000 7f6346abf700 1 -- 172.21.15.52:0/528110582 wait complete. 2023-06-23T18:49:47.784 INFO:teuthology.orchestra.run.smithi052.stderr:dumped monmap epoch 1 2023-06-23T18:49:47.794 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-06-23T18:49:47.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.916+0000 7fcb22090700 1 Processor -- start 2023-06-23T18:49:47.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.916+0000 7fcb22090700 1 -- start start 2023-06-23T18:49:47.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.916+0000 7fcb22090700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcb1c06c1f0 0x7fcb1c0b8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.916+0000 7fcb22090700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb1c14da40 0x7fcb1c14aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.916+0000 7fcb22090700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb1c14b3e0 con 0x7fcb1c0b9310 2023-06-23T18:49:47.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.916+0000 7fcb22090700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb1c0b98a0 con 0x7fcb1c06c1f0 2023-06-23T18:49:47.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.916+0000 7fcb22090700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c14a6a0 con 0x7fcb1c14da40 2023-06-23T18:49:47.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.917+0000 7fcb1b7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcb1c06c1f0 0x7fcb1c0b8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.917+0000 7fcb1bfff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fcb1c0b9310 0x7fcb1c1443e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.52:54118/0 (socket says 172.21.15.52:54118) 2023-06-23T18:49:47.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.917+0000 7fcb1b7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcb1c06c1f0 0x7fcb1c0b8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.52:46652/0 (socket says 172.21.15.52:46652) 2023-06-23T18:49:47.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.917+0000 7fcb1bfff700 1 -- 172.21.15.52:0/528657926 learned_addr learned my addr 172.21.15.52:0/528657926 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T18:49:47.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.917+0000 7fcb1affd700 1 --2- 172.21.15.52:0/528657926 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb1c14da40 0x7fcb1c14aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.917+0000 7fcb1affd700 1 -- 172.21.15.52:0/528657926 >> v2:172.21.15.89:3300/0 conn(0x7fcb1c06c1f0 msgr2=0x7fcb1c0b8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T18:49:47.924 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.917+0000 7fcb1affd700 1 --2- 172.21.15.52:0/528657926 >> v2:172.21.15.89:3300/0 conn(0x7fcb1c06c1f0 0x7fcb1c0b8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.917+0000 7fcb1affd700 1 -- 172.21.15.52:0/528657926 >> v1:172.21.15.89:6789/0 conn(0x7fcb1c0b9310 legacy=0x7fcb1c1443e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.917+0000 7fcb1affd700 1 -- 172.21.15.52:0/528657926 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb1c14a980 con 0x7fcb1c14da40 2023-06-23T18:49:47.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.917+0000 7fcb1b7fe700 1 --2- 172.21.15.52:0/528657926 >> v2:172.21.15.89:3300/0 conn(0x7fcb1c06c1f0 0x7fcb1c0b8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T18:49:47.925 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.917+0000 7fcb1affd700 1 --2- 172.21.15.52:0/528657926 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb1c14da40 0x7fcb1c14aea0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009840 tx=0x7fcb10009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73533f2aef6501f8 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:47.926 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.919+0000 7fcb1a7fc700 1 -- 172.21.15.52:0/528657926 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb10011830 con 0x7fcb1c14da40 2023-06-23T18:49:47.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.919+0000 7fcb1a7fc700 1 -- 172.21.15.52:0/528657926 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb10011990 con 0x7fcb1c14da40 2023-06-23T18:49:47.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.919+0000 7fcb1a7fc700 1 -- 172.21.15.52:0/528657926 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb10011d20 con 0x7fcb1c14da40 2023-06-23T18:49:47.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.920+0000 7fcb22090700 1 -- 172.21.15.52:0/528657926 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb1c14da40 msgr2=0x7fcb1c14aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.920+0000 7fcb22090700 1 --2- 172.21.15.52:0/528657926 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb1c14da40 0x7fcb1c14aea0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009840 tx=0x7fcb10009b50 comp rx=0 tx=0).stop 2023-06-23T18:49:47.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.920+0000 7fcb22090700 1 -- 172.21.15.52:0/528657926 shutdown_connections 2023-06-23T18:49:47.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.920+0000 7fcb22090700 1 --2- 172.21.15.52:0/528657926 >> v2:172.21.15.89:3300/0 conn(0x7fcb1c06c1f0 0x7fcb1c0b8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.920+0000 7fcb22090700 1 --2- 172.21.15.52:0/528657926 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb1c14da40 0x7fcb1c14aea0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.920+0000 7fcb22090700 1 -- 172.21.15.52:0/528657926 >> 172.21.15.52:0/528657926 conn(0x7fcb1c0bdf30 msgr2=0x7fcb1c0b9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:47.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.920+0000 7fcb22090700 1 -- 172.21.15.52:0/528657926 shutdown_connections 2023-06-23T18:49:47.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.920+0000 7fcb22090700 1 -- 172.21.15.52:0/528657926 wait complete. 2023-06-23T18:49:47.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.921+0000 7fcb22090700 1 Processor -- start 2023-06-23T18:49:47.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.921+0000 7fcb22090700 1 -- start start 2023-06-23T18:49:47.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.922+0000 7fcb22090700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb1c06c1f0 0x7fcb1c141150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.922+0000 7fcb22090700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb1c0b9310 0x7fcb1c13d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.930 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.922+0000 7fcb22090700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb1c14da40 0x7fcb1c13eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.922+0000 7fcb22090700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c141690 con 0x7fcb1c0b9310 2023-06-23T18:49:47.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.922+0000 7fcb22090700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c14a370 con 0x7fcb1c14da40 2023-06-23T18:49:47.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.922+0000 7fcb22090700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1c13cbc0 con 0x7fcb1c06c1f0 2023-06-23T18:49:47.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.922+0000 7fcb1affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb1c0b9310 0x7fcb1c13d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.922+0000 7fcb1affd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb1c0b9310 0x7fcb1c13d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:34222/0 (socket says 172.21.15.52:34222) 2023-06-23T18:49:47.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.922+0000 7fcb1affd700 1 -- 172.21.15.52:0/3663049055 learned_addr learned my addr 172.21.15.52:0/3663049055 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T18:49:47.931 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.922+0000 7fcb1bfff700 1 --2- 172.21.15.52:0/3663049055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb1c14da40 0x7fcb1c13eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.922+0000 7fcb1b7fe700 1 --2- 172.21.15.52:0/3663049055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb1c06c1f0 0x7fcb1c141150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.922+0000 7fcb1affd700 1 -- 172.21.15.52:0/3663049055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb1c06c1f0 msgr2=0x7fcb1c141150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.922+0000 7fcb1affd700 1 --2- 172.21.15.52:0/3663049055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb1c06c1f0 0x7fcb1c141150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.922+0000 7fcb1affd700 1 -- 172.21.15.52:0/3663049055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb1c14da40 msgr2=0x7fcb1c13eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:47.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.922+0000 7fcb1affd700 1 --2- 172.21.15.52:0/3663049055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb1c14da40 0x7fcb1c13eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:47.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.922+0000 7fcb1affd700 1 -- 172.21.15.52:0/3663049055 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0c0094a0 con 0x7fcb1c0b9310 2023-06-23T18:49:47.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.922+0000 7fcb1affd700 1 --2- 172.21.15.52:0/3663049055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb1c0b9310 0x7fcb1c13d540 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009fd0 tx=0x7fcb10004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:47.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.922+0000 7fcb03fff700 1 -- 172.21.15.52:0/3663049055 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb100036a0 con 0x7fcb1c0b9310 2023-06-23T18:49:47.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.923+0000 7fcb03fff700 1 -- 172.21.15.52:0/3663049055 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1001e070 con 0x7fcb1c0b9310 2023-06-23T18:49:47.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.923+0000 7fcb22090700 1 -- 172.21.15.52:0/3663049055 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb100094a0 con 0x7fcb1c0b9310 2023-06-23T18:49:47.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.923+0000 7fcb03fff700 1 -- 172.21.15.52:0/3663049055 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb10003a40 con 0x7fcb1c0b9310 2023-06-23T18:49:47.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.923+0000 7fcb22090700 1 -- 172.21.15.52:0/3663049055 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb1c14a120 con 0x7fcb1c0b9310 2023-06-23T18:49:47.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.923+0000 7fcb22090700 1 -- 172.21.15.52:0/3663049055 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb1c13cd70 con 0x7fcb1c0b9310 2023-06-23T18:49:47.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.924+0000 7fcb03fff700 1 -- 172.21.15.52:0/3663049055 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcb10003ba0 con 0x7fcb1c0b9310 2023-06-23T18:49:47.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.924+0000 7fcb03fff700 1 --2- 172.21.15.52:0/3663049055 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcb0806ace0 0x7fcb0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T18:49:47.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.924+0000 7fcb03fff700 1 -- 172.21.15.52:0/3663049055 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fcb1008a370 con 0x7fcb1c0b9310 2023-06-23T18:49:47.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.925+0000 7fcb1b7fe700 1 --2- 172.21.15.52:0/3663049055 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcb0806ace0 0x7fcb0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T18:49:47.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.925+0000 7fcb1b7fe700 1 --2- 172.21.15.52:0/3663049055 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcb0806ace0 0x7fcb0806d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009d70 tx=0x7fcb0c009210 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T18:49:47.934 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:47.929+0000 7fcb03fff700 1 -- 172.21.15.52:0/3663049055 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcb1c13cd70 con 0x7fcb1c0b9310 2023-06-23T18:49:48.208 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:48.203+0000 7fcb22090700 1 -- 172.21.15.52:0/3663049055 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7fcb1c13cd70 con 0x7fcb1c0b9310 2023-06-23T18:49:48.209 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:48.203+0000 7fcb03fff700 1 -- 172.21.15.52:0/3663049055 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) v1 ==== 92+0+63 (secure 0 0 0) 0x7fcb1c13cd70 con 0x7fcb1c0b9310 2023-06-23T18:49:48.209 INFO:teuthology.orchestra.run.smithi052.stdout:[client.admin] 2023-06-23T18:49:48.209 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDv55Vk7zkJNRAAYA/HBsuOH1+OlGB5HbXC3Q== 2023-06-23T18:49:48.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:48.205+0000 7fcb22090700 1 -- 172.21.15.52:0/3663049055 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcb0806ace0 msgr2=0x7fcb0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:48.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:48.206+0000 7fcb22090700 1 --2- 172.21.15.52:0/3663049055 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcb0806ace0 0x7fcb0806d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009d70 tx=0x7fcb0c009210 comp rx=0 tx=0).stop 2023-06-23T18:49:48.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:48.206+0000 7fcb22090700 1 -- 172.21.15.52:0/3663049055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb1c0b9310 msgr2=0x7fcb1c13d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T18:49:48.211 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:48.206+0000 7fcb22090700 1 --2- 172.21.15.52:0/3663049055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb1c0b9310 0x7fcb1c13d540 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009fd0 tx=0x7fcb10004750 comp rx=0 tx=0).stop 2023-06-23T18:49:48.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:48.206+0000 7fcb22090700 1 -- 172.21.15.52:0/3663049055 shutdown_connections 2023-06-23T18:49:48.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:48.206+0000 7fcb22090700 1 --2- 172.21.15.52:0/3663049055 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fcb0806ace0 0x7fcb0806d190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:48.206+0000 7fcb22090700 1 --2- 172.21.15.52:0/3663049055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb1c14da40 0x7fcb1c13eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:48.206+0000 7fcb22090700 1 --2- 172.21.15.52:0/3663049055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb1c06c1f0 0x7fcb1c141150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:48.206+0000 7fcb22090700 1 --2- 172.21.15.52:0/3663049055 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcb1c0b9310 0x7fcb1c13d540 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T18:49:48.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:48.206+0000 7fcb22090700 1 -- 172.21.15.52:0/3663049055 >> 172.21.15.52:0/3663049055 conn(0x7fcb1c0bdf30 msgr2=0x7fcb1c070a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T18:49:48.212 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:48.206+0000 7fcb22090700 1 -- 172.21.15.52:0/3663049055 shutdown_connections 2023-06-23T18:49:48.213 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T18:49:48.206+0000 7fcb22090700 1 -- 172.21.15.52:0/3663049055 wait complete. 2023-06-23T18:49:48.223 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-06-23T18:49:48.223 DEBUG:teuthology.orchestra.run.smithi158:> sudo dd of=/tmp/tmp.d43oagwOcAxfstests-dev/local.config 2023-06-23T18:49:48.297 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.52:6789:/test export TEST_DIR=/tmp/tmp.HeZTFPO0mrtest export SCRATCH_DEV=172.21.15.52:6789:/scratch export SCRATCH_MNT=/tmp/tmp.Y7KypOYmkCscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQDv55Vk7zkJNRAAYA/HBsuOH1+OlGB5HbXC3Q==,test_dummy_encryption" 2023-06-23T18:49:48.297 INFO:teuthology.orchestra.run:Running command with timeout 10800 2023-06-23T18:49:48.298 DEBUG:teuthology.orchestra.run.smithi158:running tests for dummy_encryption from xfstests-dev> (cd /tmp/tmp.d43oagwOcAxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check -g quick -E ./ceph.exclude) 2023-06-23T18:49:50.153 INFO:teuthology.orchestra.run.smithi158.stdout:FSTYP -- ceph 2023-06-23T18:49:50.166 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM -- Linux/x86_64 smithi158 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-23T18:49:50.167 INFO:teuthology.orchestra.run.smithi158.stdout:MKFS_OPTIONS -- 172.21.15.52:6789:/scratch 2023-06-23T18:49:50.169 INFO:teuthology.orchestra.run.smithi158.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDv55Vk7zkJNRAAYA/HBsuOH1+OlGB5HbXC3Q==,test_dummy_encryption -o context=system_u:object_r:root_t:s0 172.21.15.52:6789:/scratch /tmp/tmp.Y7KypOYmkCscratch 2023-06-23T18:49:50.169 INFO:teuthology.orchestra.run.smithi158.stdout: 2023-06-23T18:49:50.379 INFO:teuthology.orchestra.run.smithi158.stdout:ceph/001 [expunged] 2023-06-23T18:49:50.745 INFO:teuthology.orchestra.run.smithi158.stdout:ceph/002 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-06-23T18:49:51.107 INFO:teuthology.orchestra.run.smithi158.stdout:ceph/003 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-06-23T18:49:51.551 INFO:teuthology.orchestra.run.smithi158.stdout:ceph/004 0s 2023-06-23T18:49:51.875 INFO:teuthology.orchestra.run.smithi158.stdout:ceph/005 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-06-23T18:49:59.067 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:49:59.069 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:49:59.072 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:49:59.663 INFO:teuthology.orchestra.run.smithi158.stdout:generic/001 8s 2023-06-23T18:50:00.335 INFO:teuthology.orchestra.run.smithi158.stdout:generic/002 1s 2023-06-23T18:50:00.355 INFO:teuthology.orchestra.run.smithi158.stdout:generic/003 [expunged] 2023-06-23T18:50:00.687 INFO:teuthology.orchestra.run.smithi158.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-06-23T18:50:01.836 INFO:teuthology.orchestra.run.smithi158.stdout:generic/005 1s 2023-06-23T18:50:26.519 INFO:teuthology.orchestra.run.smithi158.stdout:generic/006 25s 2023-06-23T18:50:29.604 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:50:29.606 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:50:29.609 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:50:59.988 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:50:59.991 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:50:59.993 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:51:17.987 INFO:teuthology.orchestra.run.smithi158.stdout:generic/007 51s 2023-06-23T18:51:20.062 INFO:teuthology.orchestra.run.smithi158.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-23T18:51:22.008 INFO:teuthology.orchestra.run.smithi158.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-23T18:51:30.154 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:51:30.157 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:51:30.159 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:51:57.772 INFO:teuthology.orchestra.run.smithi158.stdout:generic/011 35s 2023-06-23T18:52:00.293 INFO:teuthology.orchestra.run.smithi158.stdout:generic/012 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-06-23T18:52:00.466 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:52:00.469 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:52:00.471 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:52:30.564 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:52:30.566 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:52:30.568 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:53:00.820 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:53:00.822 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:53:00.824 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:53:01.070 INFO:tasks.ceph.mds.a.smithi052.stderr:2023-06-23T18:53:01.065+0000 7fd97e5e5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 128289) UID: 0 2023-06-23T18:53:01.070 INFO:tasks.ceph.mds.c.smithi052.stderr:2023-06-23T18:53:01.065+0000 7fc6353ac700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 128289) UID: 0 2023-06-23T18:55:55.353 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:55:55.383 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:55:55.385 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T18:55:58.906 INFO:tasks.ceph.mds.a.smithi052.stderr:2023-06-23T18:55:58.902+0000 7fd97e5e5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 128341) UID: 0 2023-06-23T18:55:58.906 INFO:tasks.ceph.mds.c.smithi052.stderr:2023-06-23T18:55:58.902+0000 7fc6353ac700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 128341) UID: 0 2023-06-23T18:57:40.400 INFO:teuthology.orchestra.run.smithi158.stdout:generic/013 340s 2023-06-23T18:59:55.647 INFO:teuthology.orchestra.run.smithi158.stdout:generic/014 135s 2023-06-23T18:59:55.971 INFO:teuthology.orchestra.run.smithi158.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-23T19:00:00.240 INFO:teuthology.orchestra.run.smithi158.stdout:generic/016 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-06-23T19:00:00.721 INFO:teuthology.orchestra.run.smithi158.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-06-23T19:00:05.761 INFO:teuthology.orchestra.run.smithi158.stdout:generic/020 5s 2023-06-23T19:00:08.969 INFO:teuthology.orchestra.run.smithi158.stdout:generic/021 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-06-23T19:00:09.552 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:00:09.555 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:00:09.557 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:00:09.646 INFO:tasks.ceph.mds.a.smithi052.stderr:2023-06-23T19:00:09.643+0000 7fd97e5e5700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 128411) UID: 0 2023-06-23T19:00:09.647 INFO:tasks.ceph.mds.c.smithi052.stderr:2023-06-23T19:00:09.643+0000 7fc6353ac700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 128411) UID: 0 2023-06-23T19:00:13.810 INFO:teuthology.orchestra.run.smithi158.stdout:generic/022 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-06-23T19:01:04.244 INFO:teuthology.orchestra.run.smithi158.stdout:generic/023 51s 2023-06-23T19:01:04.585 INFO:teuthology.orchestra.run.smithi158.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-06-23T19:01:04.931 INFO:teuthology.orchestra.run.smithi158.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-06-23T19:01:05.313 INFO:teuthology.orchestra.run.smithi158.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-06-23T19:01:10.666 INFO:teuthology.orchestra.run.smithi158.stdout:generic/028 5s 2023-06-23T19:01:11.889 INFO:teuthology.orchestra.run.smithi158.stdout:generic/029 1s 2023-06-23T19:01:19.734 INFO:teuthology.orchestra.run.smithi158.stdout:generic/030 8s 2023-06-23T19:01:23.704 INFO:teuthology.orchestra.run.smithi158.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-06-23T19:01:24.041 INFO:teuthology.orchestra.run.smithi158.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T19:01:31.353 INFO:teuthology.orchestra.run.smithi158.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-23T19:01:31.701 INFO:teuthology.orchestra.run.smithi158.stdout:generic/034 [not run] require 172.21.15.52:6789:/scratch to be valid block disk 2023-06-23T19:01:32.110 INFO:teuthology.orchestra.run.smithi158.stdout:generic/035 1s 2023-06-23T19:01:39.245 INFO:teuthology.orchestra.run.smithi158.stdout:generic/037 7s 2023-06-23T19:01:39.665 INFO:teuthology.orchestra.run.smithi158.stdout:generic/039 [not run] require 172.21.15.52:6789:/scratch to be valid block disk 2023-06-23T19:01:40.025 INFO:teuthology.orchestra.run.smithi158.stdout:generic/040 [not run] require 172.21.15.52:6789:/scratch to be valid block disk 2023-06-23T19:01:40.380 INFO:teuthology.orchestra.run.smithi158.stdout:generic/041 [not run] require 172.21.15.52:6789:/scratch to be valid block disk 2023-06-23T19:01:40.865 INFO:teuthology.orchestra.run.smithi158.stdout:generic/042 [not run] ceph does not support shutdown 2023-06-23T19:01:41.367 INFO:teuthology.orchestra.run.smithi158.stdout:generic/050 [not run] ceph does not support shutdown 2023-06-23T19:01:41.869 INFO:teuthology.orchestra.run.smithi158.stdout:generic/052 [not run] ceph does not support shutdown 2023-06-23T19:01:42.885 INFO:teuthology.orchestra.run.smithi158.stdout:generic/053 1s 2023-06-23T19:01:43.311 INFO:teuthology.orchestra.run.smithi158.stdout:generic/056 [not run] require 172.21.15.52:6789:/scratch to be valid block disk 2023-06-23T19:01:43.667 INFO:teuthology.orchestra.run.smithi158.stdout:generic/057 [not run] require 172.21.15.52:6789:/scratch to be valid block disk 2023-06-23T19:01:47.591 INFO:teuthology.orchestra.run.smithi158.stdout:generic/058 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-06-23T19:01:47.942 INFO:teuthology.orchestra.run.smithi158.stdout:generic/059 [not run] require 172.21.15.52:6789:/scratch to be valid block disk 2023-06-23T19:01:54.117 INFO:teuthology.orchestra.run.smithi158.stdout:generic/060 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-06-23T19:01:58.240 INFO:teuthology.orchestra.run.smithi158.stdout:generic/061 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-06-23T19:02:00.586 INFO:teuthology.orchestra.run.smithi158.stdout:generic/062 2s 2023-06-23T19:02:05.654 INFO:teuthology.orchestra.run.smithi158.stdout:generic/063 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-06-23T19:02:06.020 INFO:teuthology.orchestra.run.smithi158.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-23T19:02:06.381 INFO:teuthology.orchestra.run.smithi158.stdout:generic/065 [not run] require 172.21.15.52:6789:/scratch to be valid block disk 2023-06-23T19:02:06.729 INFO:teuthology.orchestra.run.smithi158.stdout:generic/066 [not run] require 172.21.15.52:6789:/scratch to be valid block disk 2023-06-23T19:02:07.126 INFO:teuthology.orchestra.run.smithi158.stdout:generic/067 [not run] require 172.21.15.52:6789:/scratch to be valid block disk 2023-06-23T19:02:29.560 INFO:teuthology.orchestra.run.smithi158.stdout:generic/069 22s 2023-06-23T19:02:41.819 INFO:teuthology.orchestra.run.smithi158.stdout:generic/070 12s 2023-06-23T19:02:42.152 INFO:teuthology.orchestra.run.smithi158.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-23T19:02:42.498 INFO:teuthology.orchestra.run.smithi158.stdout:generic/073 [not run] require 172.21.15.52:6789:/scratch to be valid block disk 2023-06-23T19:02:42.523 INFO:teuthology.orchestra.run.smithi158.stdout:generic/075 [expunged] 2023-06-23T19:02:42.839 INFO:teuthology.orchestra.run.smithi158.stdout:generic/076 [not run] require 172.21.15.52:6789:/scratch to be local device 2023-06-23T19:02:43.216 INFO:teuthology.orchestra.run.smithi158.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-06-23T19:02:43.547 INFO:teuthology.orchestra.run.smithi158.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-06-23T19:02:45.940 INFO:teuthology.orchestra.run.smithi158.stdout:generic/080 2s 2023-06-23T19:02:46.225 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:02:46.229 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:02:46.232 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:02:46.335 INFO:teuthology.orchestra.run.smithi158.stdout:generic/081 [not run] require 172.21.15.52:6789:/scratch to be valid block disk 2023-06-23T19:02:46.673 INFO:teuthology.orchestra.run.smithi158.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-23T19:02:51.962 INFO:tasks.ceph.mds.c.smithi052.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4479-g8627af3e/rpm/el8/BUILD/ceph-18.0.0-4479-g8627af3e/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7fc62db9d700 time 2023-06-23T19:02:51.959381+0000 2023-06-23T19:02:51.962 INFO:tasks.ceph.mds.c.smithi052.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4479-g8627af3e/rpm/el8/BUILD/ceph-18.0.0-4479-g8627af3e/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-06-23T19:02:51.979 INFO:tasks.ceph.mds.c.smithi052.stderr: ceph version 18.0.0-4479-g8627af3e (8627af3e0adcb765a3c249fcc209cba9f4873e1b) reef (dev) 2023-06-23T19:02:51.979 INFO:tasks.ceph.mds.c.smithi052.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc63f476dbf] 2023-06-23T19:02:51.979 INFO:tasks.ceph.mds.c.smithi052.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a9f85) [0x7fc63f476f85] 2023-06-23T19:02:51.979 INFO:tasks.ceph.mds.c.smithi052.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x564bce3d5492] 2023-06-23T19:02:51.980 INFO:tasks.ceph.mds.c.smithi052.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x564bce3bd3ac] 2023-06-23T19:02:51.980 INFO:tasks.ceph.mds.c.smithi052.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x564bce3c61e7] 2023-06-23T19:02:51.980 INFO:tasks.ceph.mds.c.smithi052.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x564bce3caa5f] 2023-06-23T19:02:51.980 INFO:tasks.ceph.mds.c.smithi052.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x564bce21cc37] 2023-06-23T19:02:51.980 INFO:tasks.ceph.mds.c.smithi052.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x564bce21dae0] 2023-06-23T19:02:51.980 INFO:tasks.ceph.mds.c.smithi052.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x564bce21f9e5] 2023-06-23T19:02:51.980 INFO:tasks.ceph.mds.c.smithi052.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x564bce2a5a15] 2023-06-23T19:02:51.981 INFO:tasks.ceph.mds.c.smithi052.stderr: 11: (MDSContext::complete(int)+0x5f) [0x564bce5041df] 2023-06-23T19:02:51.981 INFO:tasks.ceph.mds.c.smithi052.stderr: 12: (MDSIOContextBase::complete(int)+0x524) [0x564bce504964] 2023-06-23T19:02:51.981 INFO:tasks.ceph.mds.c.smithi052.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x564bce504d1b] 2023-06-23T19:02:51.981 INFO:tasks.ceph.mds.c.smithi052.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7fc63f51a80d] 2023-06-23T19:02:51.981 INFO:tasks.ceph.mds.c.smithi052.stderr: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc63e21d1ca] 2023-06-23T19:02:51.981 INFO:tasks.ceph.mds.c.smithi052.stderr: 16: clone() 2023-06-23T19:02:51.982 INFO:tasks.ceph.mds.c.smithi052.stderr:*** Caught signal (Aborted) ** 2023-06-23T19:02:51.982 INFO:tasks.ceph.mds.c.smithi052.stderr: in thread 7fc62db9d700 thread_name:MR_Finisher 2023-06-23T19:02:51.982 INFO:tasks.ceph.mds.c.smithi052.stderr:2023-06-23T19:02:51.975+0000 7fc62db9d700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4479-g8627af3e/rpm/el8/BUILD/ceph-18.0.0-4479-g8627af3e/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7fc62db9d700 time 2023-06-23T19:02:51.959381+0000 2023-06-23T19:02:51.982 INFO:tasks.ceph.mds.c.smithi052.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4479-g8627af3e/rpm/el8/BUILD/ceph-18.0.0-4479-g8627af3e/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-06-23T19:02:51.982 INFO:tasks.ceph.mds.c.smithi052.stderr: 2023-06-23T19:02:51.983 INFO:tasks.ceph.mds.c.smithi052.stderr: ceph version 18.0.0-4479-g8627af3e (8627af3e0adcb765a3c249fcc209cba9f4873e1b) reef (dev) 2023-06-23T19:02:51.983 INFO:tasks.ceph.mds.c.smithi052.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc63f476dbf] 2023-06-23T19:02:51.983 INFO:tasks.ceph.mds.c.smithi052.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a9f85) [0x7fc63f476f85] 2023-06-23T19:02:51.983 INFO:tasks.ceph.mds.c.smithi052.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x564bce3d5492] 2023-06-23T19:02:51.983 INFO:tasks.ceph.mds.c.smithi052.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x564bce3bd3ac] 2023-06-23T19:02:51.983 INFO:tasks.ceph.mds.c.smithi052.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x564bce3c61e7] 2023-06-23T19:02:51.984 INFO:tasks.ceph.mds.c.smithi052.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x564bce3caa5f] 2023-06-23T19:02:51.984 INFO:tasks.ceph.mds.c.smithi052.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x564bce21cc37] 2023-06-23T19:02:51.984 INFO:tasks.ceph.mds.c.smithi052.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x564bce21dae0] 2023-06-23T19:02:51.984 INFO:tasks.ceph.mds.c.smithi052.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x564bce21f9e5] 2023-06-23T19:02:51.984 INFO:tasks.ceph.mds.c.smithi052.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x564bce2a5a15] 2023-06-23T19:02:51.984 INFO:tasks.ceph.mds.c.smithi052.stderr: 11: (MDSContext::complete(int)+0x5f) [0x564bce5041df] 2023-06-23T19:02:51.984 INFO:tasks.ceph.mds.c.smithi052.stderr: 12: (MDSIOContextBase::complete(int)+0x524) [0x564bce504964] 2023-06-23T19:02:51.985 INFO:tasks.ceph.mds.c.smithi052.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x564bce504d1b] 2023-06-23T19:02:51.985 INFO:tasks.ceph.mds.c.smithi052.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7fc63f51a80d] 2023-06-23T19:02:51.985 INFO:tasks.ceph.mds.c.smithi052.stderr: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc63e21d1ca] 2023-06-23T19:02:51.985 INFO:tasks.ceph.mds.c.smithi052.stderr: 16: clone() 2023-06-23T19:02:51.985 INFO:tasks.ceph.mds.c.smithi052.stderr: 2023-06-23T19:02:51.986 INFO:tasks.ceph.mds.c.smithi052.stderr: ceph version 18.0.0-4479-g8627af3e (8627af3e0adcb765a3c249fcc209cba9f4873e1b) reef (dev) 2023-06-23T19:02:51.986 INFO:tasks.ceph.mds.c.smithi052.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fc63e227cf0] 2023-06-23T19:02:51.986 INFO:tasks.ceph.mds.c.smithi052.stderr: 2: gsignal() 2023-06-23T19:02:51.986 INFO:tasks.ceph.mds.c.smithi052.stderr: 3: abort() 2023-06-23T19:02:51.986 INFO:tasks.ceph.mds.c.smithi052.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc63f476e19] 2023-06-23T19:02:51.986 INFO:tasks.ceph.mds.c.smithi052.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a9f85) [0x7fc63f476f85] 2023-06-23T19:02:51.987 INFO:tasks.ceph.mds.c.smithi052.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x564bce3d5492] 2023-06-23T19:02:51.987 INFO:tasks.ceph.mds.c.smithi052.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x564bce3bd3ac] 2023-06-23T19:02:51.987 INFO:tasks.ceph.mds.c.smithi052.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x564bce3c61e7] 2023-06-23T19:02:51.987 INFO:tasks.ceph.mds.c.smithi052.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x564bce3caa5f] 2023-06-23T19:02:51.988 INFO:tasks.ceph.mds.c.smithi052.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x564bce21cc37] 2023-06-23T19:02:51.988 INFO:tasks.ceph.mds.c.smithi052.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x564bce21dae0] 2023-06-23T19:02:51.988 INFO:tasks.ceph.mds.c.smithi052.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x564bce21f9e5] 2023-06-23T19:02:51.988 INFO:tasks.ceph.mds.c.smithi052.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x564bce2a5a15] 2023-06-23T19:02:51.988 INFO:tasks.ceph.mds.c.smithi052.stderr: 14: (MDSContext::complete(int)+0x5f) [0x564bce5041df] 2023-06-23T19:02:51.989 INFO:tasks.ceph.mds.c.smithi052.stderr: 15: (MDSIOContextBase::complete(int)+0x524) [0x564bce504964] 2023-06-23T19:02:51.989 INFO:tasks.ceph.mds.c.smithi052.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x564bce504d1b] 2023-06-23T19:02:51.989 INFO:tasks.ceph.mds.c.smithi052.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7fc63f51a80d] 2023-06-23T19:02:51.990 INFO:tasks.ceph.mds.c.smithi052.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fc63e21d1ca] 2023-06-23T19:02:51.990 INFO:tasks.ceph.mds.c.smithi052.stderr: 19: clone() 2023-06-23T19:02:51.990 INFO:tasks.ceph.mds.c.smithi052.stderr:2023-06-23T19:02:51.977+0000 7fc62db9d700 -1 *** Caught signal (Aborted) ** 2023-06-23T19:02:51.990 INFO:tasks.ceph.mds.c.smithi052.stderr: in thread 7fc62db9d700 thread_name:MR_Finisher 2023-06-23T19:02:51.991 INFO:tasks.ceph.mds.c.smithi052.stderr: 2023-06-23T19:02:51.991 INFO:tasks.ceph.mds.c.smithi052.stderr: ceph version 18.0.0-4479-g8627af3e (8627af3e0adcb765a3c249fcc209cba9f4873e1b) reef (dev) 2023-06-23T19:02:51.991 INFO:tasks.ceph.mds.c.smithi052.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fc63e227cf0] 2023-06-23T19:02:51.991 INFO:tasks.ceph.mds.c.smithi052.stderr: 2: gsignal() 2023-06-23T19:02:51.991 INFO:tasks.ceph.mds.c.smithi052.stderr: 3: abort() 2023-06-23T19:02:51.991 INFO:tasks.ceph.mds.c.smithi052.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc63f476e19] 2023-06-23T19:02:51.991 INFO:tasks.ceph.mds.c.smithi052.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a9f85) [0x7fc63f476f85] 2023-06-23T19:02:51.992 INFO:tasks.ceph.mds.c.smithi052.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x564bce3d5492] 2023-06-23T19:02:51.992 INFO:tasks.ceph.mds.c.smithi052.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x564bce3bd3ac] 2023-06-23T19:02:51.992 INFO:tasks.ceph.mds.c.smithi052.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x564bce3c61e7] 2023-06-23T19:02:51.992 INFO:tasks.ceph.mds.c.smithi052.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x564bce3caa5f] 2023-06-23T19:02:51.993 INFO:tasks.ceph.mds.c.smithi052.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x564bce21cc37] 2023-06-23T19:02:51.993 INFO:tasks.ceph.mds.c.smithi052.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x564bce21dae0] 2023-06-23T19:02:51.993 INFO:tasks.ceph.mds.c.smithi052.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x564bce21f9e5] 2023-06-23T19:02:51.993 INFO:tasks.ceph.mds.c.smithi052.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x564bce2a5a15] 2023-06-23T19:02:51.993 INFO:tasks.ceph.mds.c.smithi052.stderr: 14: (MDSContext::complete(int)+0x5f) [0x564bce5041df] 2023-06-23T19:02:51.993 INFO:tasks.ceph.mds.c.smithi052.stderr: 15: (MDSIOContextBase::complete(int)+0x524) [0x564bce504964] 2023-06-23T19:02:51.993 INFO:tasks.ceph.mds.c.smithi052.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x564bce504d1b] 2023-06-23T19:02:51.994 INFO:tasks.ceph.mds.c.smithi052.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7fc63f51a80d] 2023-06-23T19:02:51.994 INFO:tasks.ceph.mds.c.smithi052.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fc63e21d1ca] 2023-06-23T19:02:51.994 INFO:tasks.ceph.mds.c.smithi052.stderr: 19: clone() 2023-06-23T19:02:51.994 INFO:tasks.ceph.mds.c.smithi052.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-23T19:02:51.994 INFO:tasks.ceph.mds.c.smithi052.stderr: 2023-06-23T19:02:51.996 INFO:tasks.ceph.mds.c.smithi052.stderr: -1> 2023-06-23T19:02:51.975+0000 7fc62db9d700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4479-g8627af3e/rpm/el8/BUILD/ceph-18.0.0-4479-g8627af3e/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7fc62db9d700 time 2023-06-23T19:02:51.959381+0000 2023-06-23T19:02:51.996 INFO:tasks.ceph.mds.c.smithi052.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4479-g8627af3e/rpm/el8/BUILD/ceph-18.0.0-4479-g8627af3e/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-06-23T19:02:51.996 INFO:tasks.ceph.mds.c.smithi052.stderr: 2023-06-23T19:02:51.996 INFO:tasks.ceph.mds.c.smithi052.stderr: ceph version 18.0.0-4479-g8627af3e (8627af3e0adcb765a3c249fcc209cba9f4873e1b) reef (dev) 2023-06-23T19:02:51.996 INFO:tasks.ceph.mds.c.smithi052.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc63f476dbf] 2023-06-23T19:02:51.997 INFO:tasks.ceph.mds.c.smithi052.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a9f85) [0x7fc63f476f85] 2023-06-23T19:02:51.997 INFO:tasks.ceph.mds.c.smithi052.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x564bce3d5492] 2023-06-23T19:02:51.997 INFO:tasks.ceph.mds.c.smithi052.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x564bce3bd3ac] 2023-06-23T19:02:51.997 INFO:tasks.ceph.mds.c.smithi052.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x564bce3c61e7] 2023-06-23T19:02:51.997 INFO:tasks.ceph.mds.c.smithi052.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x564bce3caa5f] 2023-06-23T19:02:51.997 INFO:tasks.ceph.mds.c.smithi052.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x564bce21cc37] 2023-06-23T19:02:51.997 INFO:tasks.ceph.mds.c.smithi052.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x564bce21dae0] 2023-06-23T19:02:51.998 INFO:tasks.ceph.mds.c.smithi052.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x564bce21f9e5] 2023-06-23T19:02:51.998 INFO:tasks.ceph.mds.c.smithi052.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x564bce2a5a15] 2023-06-23T19:02:51.998 INFO:tasks.ceph.mds.c.smithi052.stderr: 11: (MDSContext::complete(int)+0x5f) [0x564bce5041df] 2023-06-23T19:02:51.998 INFO:tasks.ceph.mds.c.smithi052.stderr: 12: (MDSIOContextBase::complete(int)+0x524) [0x564bce504964] 2023-06-23T19:02:51.998 INFO:tasks.ceph.mds.c.smithi052.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x564bce504d1b] 2023-06-23T19:02:51.998 INFO:tasks.ceph.mds.c.smithi052.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7fc63f51a80d] 2023-06-23T19:02:51.998 INFO:tasks.ceph.mds.c.smithi052.stderr: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc63e21d1ca] 2023-06-23T19:02:51.998 INFO:tasks.ceph.mds.c.smithi052.stderr: 16: clone() 2023-06-23T19:02:51.999 INFO:tasks.ceph.mds.c.smithi052.stderr: 2023-06-23T19:02:51.999 INFO:tasks.ceph.mds.c.smithi052.stderr: 0> 2023-06-23T19:02:51.977+0000 7fc62db9d700 -1 *** Caught signal (Aborted) ** 2023-06-23T19:02:51.999 INFO:tasks.ceph.mds.c.smithi052.stderr: in thread 7fc62db9d700 thread_name:MR_Finisher 2023-06-23T19:02:51.999 INFO:tasks.ceph.mds.c.smithi052.stderr: 2023-06-23T19:02:51.999 INFO:tasks.ceph.mds.c.smithi052.stderr: ceph version 18.0.0-4479-g8627af3e (8627af3e0adcb765a3c249fcc209cba9f4873e1b) reef (dev) 2023-06-23T19:02:51.999 INFO:tasks.ceph.mds.c.smithi052.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fc63e227cf0] 2023-06-23T19:02:51.999 INFO:tasks.ceph.mds.c.smithi052.stderr: 2: gsignal() 2023-06-23T19:02:51.999 INFO:tasks.ceph.mds.c.smithi052.stderr: 3: abort() 2023-06-23T19:02:52.000 INFO:tasks.ceph.mds.c.smithi052.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc63f476e19] 2023-06-23T19:02:52.000 INFO:tasks.ceph.mds.c.smithi052.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a9f85) [0x7fc63f476f85] 2023-06-23T19:02:52.000 INFO:tasks.ceph.mds.c.smithi052.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x564bce3d5492] 2023-06-23T19:02:52.000 INFO:tasks.ceph.mds.c.smithi052.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x564bce3bd3ac] 2023-06-23T19:02:52.000 INFO:tasks.ceph.mds.c.smithi052.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x564bce3c61e7] 2023-06-23T19:02:52.000 INFO:tasks.ceph.mds.c.smithi052.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x564bce3caa5f] 2023-06-23T19:02:52.001 INFO:tasks.ceph.mds.c.smithi052.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x564bce21cc37] 2023-06-23T19:02:52.001 INFO:tasks.ceph.mds.c.smithi052.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x564bce21dae0] 2023-06-23T19:02:52.001 INFO:tasks.ceph.mds.c.smithi052.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x564bce21f9e5] 2023-06-23T19:02:52.001 INFO:tasks.ceph.mds.c.smithi052.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x564bce2a5a15] 2023-06-23T19:02:52.001 INFO:tasks.ceph.mds.c.smithi052.stderr: 14: (MDSContext::complete(int)+0x5f) [0x564bce5041df] 2023-06-23T19:02:52.001 INFO:tasks.ceph.mds.c.smithi052.stderr: 15: (MDSIOContextBase::complete(int)+0x524) [0x564bce504964] 2023-06-23T19:02:52.001 INFO:tasks.ceph.mds.c.smithi052.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x564bce504d1b] 2023-06-23T19:02:52.002 INFO:tasks.ceph.mds.c.smithi052.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7fc63f51a80d] 2023-06-23T19:02:52.002 INFO:tasks.ceph.mds.c.smithi052.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fc63e21d1ca] 2023-06-23T19:02:52.002 INFO:tasks.ceph.mds.c.smithi052.stderr: 19: clone() 2023-06-23T19:02:52.002 INFO:tasks.ceph.mds.c.smithi052.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-23T19:02:52.002 INFO:tasks.ceph.mds.c.smithi052.stderr: 2023-06-23T19:02:52.007 INFO:tasks.ceph.mds.c.smithi052.stderr: -1> 2023-06-23T19:02:51.975+0000 7fc62db9d700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4479-g8627af3e/rpm/el8/BUILD/ceph-18.0.0-4479-g8627af3e/src/mds/SimpleLock.h: In function 'void SimpleLock::put_xlock()' thread 7fc62db9d700 time 2023-06-23T19:02:51.959381+0000 2023-06-23T19:02:52.007 INFO:tasks.ceph.mds.c.smithi052.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/18.0.0-4479-g8627af3e/rpm/el8/BUILD/ceph-18.0.0-4479-g8627af3e/src/mds/SimpleLock.h: 417: FAILED ceph_assert(state == LOCK_XLOCK || state == LOCK_XLOCKDONE || state == LOCK_XLOCKSNAP || state == LOCK_LOCK_XLOCK || state == LOCK_LOCK || is_locallock()) 2023-06-23T19:02:52.008 INFO:tasks.ceph.mds.c.smithi052.stderr: 2023-06-23T19:02:52.008 INFO:tasks.ceph.mds.c.smithi052.stderr: ceph version 18.0.0-4479-g8627af3e (8627af3e0adcb765a3c249fcc209cba9f4873e1b) reef (dev) 2023-06-23T19:02:52.008 INFO:tasks.ceph.mds.c.smithi052.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x135) [0x7fc63f476dbf] 2023-06-23T19:02:52.009 INFO:tasks.ceph.mds.c.smithi052.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x2a9f85) [0x7fc63f476f85] 2023-06-23T19:02:52.009 INFO:tasks.ceph.mds.c.smithi052.stderr: 3: (SimpleLock::put_xlock()+0x332) [0x564bce3d5492] 2023-06-23T19:02:52.009 INFO:tasks.ceph.mds.c.smithi052.stderr: 4: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x564bce3bd3ac] 2023-06-23T19:02:52.009 INFO:tasks.ceph.mds.c.smithi052.stderr: 5: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x564bce3c61e7] 2023-06-23T19:02:52.010 INFO:tasks.ceph.mds.c.smithi052.stderr: 6: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x564bce3caa5f] 2023-06-23T19:02:52.010 INFO:tasks.ceph.mds.c.smithi052.stderr: 7: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x564bce21cc37] 2023-06-23T19:02:52.011 INFO:tasks.ceph.mds.c.smithi052.stderr: 8: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x564bce21dae0] 2023-06-23T19:02:52.011 INFO:tasks.ceph.mds.c.smithi052.stderr: 9: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x564bce21f9e5] 2023-06-23T19:02:52.011 INFO:tasks.ceph.mds.c.smithi052.stderr: 10: (C_MDS_link_local_finish::finish(int)+0x35) [0x564bce2a5a15] 2023-06-23T19:02:52.012 INFO:tasks.ceph.mds.c.smithi052.stderr: 11: (MDSContext::complete(int)+0x5f) [0x564bce5041df] 2023-06-23T19:02:52.012 INFO:tasks.ceph.mds.c.smithi052.stderr: 12: (MDSIOContextBase::complete(int)+0x524) [0x564bce504964] 2023-06-23T19:02:52.012 INFO:tasks.ceph.mds.c.smithi052.stderr: 13: (MDSLogContextBase::complete(int)+0x5b) [0x564bce504d1b] 2023-06-23T19:02:52.013 INFO:tasks.ceph.mds.c.smithi052.stderr: 14: (Finisher::finisher_thread_entry()+0x18d) [0x7fc63f51a80d] 2023-06-23T19:02:52.013 INFO:tasks.ceph.mds.c.smithi052.stderr: 15: /lib64/libpthread.so.0(+0x81ca) [0x7fc63e21d1ca] 2023-06-23T19:02:52.014 INFO:tasks.ceph.mds.c.smithi052.stderr: 16: clone() 2023-06-23T19:02:52.015 INFO:tasks.ceph.mds.c.smithi052.stderr: 2023-06-23T19:02:52.015 INFO:tasks.ceph.mds.c.smithi052.stderr: 0> 2023-06-23T19:02:51.977+0000 7fc62db9d700 -1 *** Caught signal (Aborted) ** 2023-06-23T19:02:52.015 INFO:tasks.ceph.mds.c.smithi052.stderr: in thread 7fc62db9d700 thread_name:MR_Finisher 2023-06-23T19:02:52.015 INFO:tasks.ceph.mds.c.smithi052.stderr: 2023-06-23T19:02:52.015 INFO:tasks.ceph.mds.c.smithi052.stderr: ceph version 18.0.0-4479-g8627af3e (8627af3e0adcb765a3c249fcc209cba9f4873e1b) reef (dev) 2023-06-23T19:02:52.015 INFO:tasks.ceph.mds.c.smithi052.stderr: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fc63e227cf0] 2023-06-23T19:02:52.015 INFO:tasks.ceph.mds.c.smithi052.stderr: 2: gsignal() 2023-06-23T19:02:52.016 INFO:tasks.ceph.mds.c.smithi052.stderr: 3: abort() 2023-06-23T19:02:52.016 INFO:tasks.ceph.mds.c.smithi052.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7fc63f476e19] 2023-06-23T19:02:52.016 INFO:tasks.ceph.mds.c.smithi052.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x2a9f85) [0x7fc63f476f85] 2023-06-23T19:02:52.016 INFO:tasks.ceph.mds.c.smithi052.stderr: 6: (SimpleLock::put_xlock()+0x332) [0x564bce3d5492] 2023-06-23T19:02:52.016 INFO:tasks.ceph.mds.c.smithi052.stderr: 7: (Locker::xlock_finish(std::_Rb_tree_const_iterator const&, MutationImpl*, bool*)+0x8c) [0x564bce3bd3ac] 2023-06-23T19:02:52.016 INFO:tasks.ceph.mds.c.smithi052.stderr: 8: (Locker::_drop_locks(MutationImpl*, std::set, std::allocator >*, bool)+0x407) [0x564bce3c61e7] 2023-06-23T19:02:52.016 INFO:tasks.ceph.mds.c.smithi052.stderr: 9: (Locker::drop_non_rdlocks(MutationImpl*, std::set, std::allocator >*)+0x5f) [0x564bce3caa5f] 2023-06-23T19:02:52.017 INFO:tasks.ceph.mds.c.smithi052.stderr: 10: (Server::reply_client_request(boost::intrusive_ptr&, boost::intrusive_ptr const&)+0x497) [0x564bce21cc37] 2023-06-23T19:02:52.017 INFO:tasks.ceph.mds.c.smithi052.stderr: 11: (Server::respond_to_request(boost::intrusive_ptr&, int)+0x350) [0x564bce21dae0] 2023-06-23T19:02:52.017 INFO:tasks.ceph.mds.c.smithi052.stderr: 12: (Server::_link_local_finish(boost::intrusive_ptr&, CDentry*, CInode*, unsigned long, unsigned long, bool)+0xf5) [0x564bce21f9e5] 2023-06-23T19:02:52.017 INFO:tasks.ceph.mds.c.smithi052.stderr: 13: (C_MDS_link_local_finish::finish(int)+0x35) [0x564bce2a5a15] 2023-06-23T19:02:52.017 INFO:tasks.ceph.mds.c.smithi052.stderr: 14: (MDSContext::complete(int)+0x5f) [0x564bce5041df] 2023-06-23T19:02:52.017 INFO:tasks.ceph.mds.c.smithi052.stderr: 15: (MDSIOContextBase::complete(int)+0x524) [0x564bce504964] 2023-06-23T19:02:52.018 INFO:tasks.ceph.mds.c.smithi052.stderr: 16: (MDSLogContextBase::complete(int)+0x5b) [0x564bce504d1b] 2023-06-23T19:02:52.018 INFO:tasks.ceph.mds.c.smithi052.stderr: 17: (Finisher::finisher_thread_entry()+0x18d) [0x7fc63f51a80d] 2023-06-23T19:02:52.018 INFO:tasks.ceph.mds.c.smithi052.stderr: 18: /lib64/libpthread.so.0(+0x81ca) [0x7fc63e21d1ca] 2023-06-23T19:02:52.018 INFO:tasks.ceph.mds.c.smithi052.stderr: 19: clone() 2023-06-23T19:02:52.018 INFO:tasks.ceph.mds.c.smithi052.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-23T19:02:52.018 INFO:tasks.ceph.mds.c.smithi052.stderr: 2023-06-23T19:02:53.485 INFO:tasks.ceph.mds.c.smithi052.stderr:daemon-helper: command crashed with signal 6 2023-06-23T19:02:54.593 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-06-23T19:03:01.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~7s 2023-06-23T19:03:07.622 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~13s 2023-06-23T19:03:14.134 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~20s 2023-06-23T19:03:16.335 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:03:16.338 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:03:16.341 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:03:19.912 INFO:tasks.ceph.mds.a.smithi052.stderr:2023-06-23T19:03:19.907+0000 7fd97a5dd700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-23T19:03:20.647 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~26s 2023-06-23T19:03:24.217 INFO:teuthology.orchestra.run.smithi158.stdout:generic/084 38s 2023-06-23T19:03:24.626 INFO:teuthology.orchestra.run.smithi158.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T19:03:25.073 INFO:teuthology.orchestra.run.smithi158.stdout:generic/087 1s 2023-06-23T19:03:25.438 INFO:teuthology.orchestra.run.smithi158.stdout:generic/088 0s 2023-06-23T19:03:25.792 INFO:teuthology.orchestra.run.smithi158.stdout:generic/090 [not run] require 172.21.15.52:6789:/scratch to be valid block disk 2023-06-23T19:03:27.159 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~33s 2023-06-23T19:03:33.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~39s 2023-06-23T19:03:40.185 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~46s 2023-06-23T19:03:46.590 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:03:46.593 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:03:46.596 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:03:46.695 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~52s 2023-06-23T19:03:53.210 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~59s 2023-06-23T19:03:59.723 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~65s 2023-06-23T19:04:06.237 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~72s 2023-06-23T19:04:12.750 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~78s 2023-06-23T19:04:16.770 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:04:16.773 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:04:16.777 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:04:19.262 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~85s 2023-06-23T19:04:24.922 INFO:teuthology.orchestra.run.smithi158.stdout:generic/091 59s 2023-06-23T19:04:25.262 INFO:teuthology.orchestra.run.smithi158.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T19:04:25.633 INFO:teuthology.orchestra.run.smithi158.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-23T19:04:25.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~91s 2023-06-23T19:04:29.246 INFO:teuthology.orchestra.run.smithi158.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-23T19:04:29.909 INFO:teuthology.orchestra.run.smithi158.stdout:generic/097 0s 2023-06-23T19:04:30.959 INFO:teuthology.orchestra.run.smithi158.stdout:generic/098 1s 2023-06-23T19:04:32.247 INFO:teuthology.orchestra.run.smithi158.stdout:generic/099 2s 2023-06-23T19:04:32.290 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~98s 2023-06-23T19:04:32.594 INFO:teuthology.orchestra.run.smithi158.stdout:generic/101 [not run] require 172.21.15.52:6789:/scratch to be valid block disk 2023-06-23T19:04:32.939 INFO:teuthology.orchestra.run.smithi158.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-23T19:04:33.306 INFO:teuthology.orchestra.run.smithi158.stdout:generic/104 [not run] require 172.21.15.52:6789:/scratch to be valid block disk 2023-06-23T19:04:34.160 INFO:teuthology.orchestra.run.smithi158.stdout:generic/105 1s 2023-06-23T19:04:34.581 INFO:teuthology.orchestra.run.smithi158.stdout:generic/106 [not run] require 172.21.15.52:6789:/scratch to be valid block disk 2023-06-23T19:04:34.949 INFO:teuthology.orchestra.run.smithi158.stdout:generic/107 [not run] require 172.21.15.52:6789:/scratch to be valid block disk 2023-06-23T19:04:35.405 INFO:teuthology.orchestra.run.smithi158.stdout:generic/108 [not run] require 172.21.15.52:6789:/scratch to be valid block disk 2023-06-23T19:04:35.777 INFO:teuthology.orchestra.run.smithi158.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T19:04:36.143 INFO:teuthology.orchestra.run.smithi158.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T19:04:38.805 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~104s 2023-06-23T19:04:45.318 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~111s 2023-06-23T19:04:47.124 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:04:47.127 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:04:47.129 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:04:51.833 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~117s 2023-06-23T19:04:58.345 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~124s 2023-06-23T19:04:59.357 INFO:teuthology.orchestra.run.smithi158.stdout:generic/112 23s 2023-06-23T19:05:04.858 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~130s 2023-06-23T19:05:11.372 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~137s 2023-06-23T19:05:17.240 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:05:17.243 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:05:17.249 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:05:17.885 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~143s 2023-06-23T19:05:24.398 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~150s 2023-06-23T19:05:30.910 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~156s 2023-06-23T19:05:37.426 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~163s 2023-06-23T19:05:43.940 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~169s 2023-06-23T19:05:47.536 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:05:47.554 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:05:47.583 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:05:50.453 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~176s 2023-06-23T19:05:56.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~182s 2023-06-23T19:06:03.480 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~189s 2023-06-23T19:06:09.995 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~195s 2023-06-23T19:06:16.514 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~202s 2023-06-23T19:06:18.155 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:06:18.174 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:06:18.181 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:06:23.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~208s 2023-06-23T19:06:29.539 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~215s 2023-06-23T19:06:36.054 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~221s 2023-06-23T19:06:42.568 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~228s 2023-06-23T19:06:48.599 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:06:48.602 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:06:48.605 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:06:49.083 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~234s 2023-06-23T19:06:52.665 INFO:teuthology.orchestra.run.smithi158.stdout:generic/113 113s 2023-06-23T19:06:53.048 INFO:teuthology.orchestra.run.smithi158.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-06-23T19:06:53.415 INFO:teuthology.orchestra.run.smithi158.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T19:06:53.780 INFO:teuthology.orchestra.run.smithi158.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T19:06:55.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~241s 2023-06-23T19:07:00.219 INFO:teuthology.orchestra.run.smithi158.stdout:generic/117 7s 2023-06-23T19:07:00.653 INFO:teuthology.orchestra.run.smithi158.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T19:07:01.018 INFO:teuthology.orchestra.run.smithi158.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-06-23T19:07:01.345 INFO:teuthology.orchestra.run.smithi158.stdout:generic/120 [not run] atime not maintained by ceph 2023-06-23T19:07:01.712 INFO:teuthology.orchestra.run.smithi158.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-23T19:07:02.085 INFO:teuthology.orchestra.run.smithi158.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-23T19:07:02.107 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~248s 2023-06-23T19:07:02.858 INFO:teuthology.orchestra.run.smithi158.stdout:generic/123 0s 2023-06-23T19:07:08.622 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~254s 2023-06-23T19:07:15.134 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~261s 2023-06-23T19:07:18.774 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:07:18.787 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:07:18.837 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:07:21.647 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~267s 2023-06-23T19:07:28.163 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~274s 2023-06-23T19:07:34.677 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~280s 2023-06-23T19:07:41.192 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~287s 2023-06-23T19:07:42.752 INFO:teuthology.orchestra.run.smithi158.stdout:generic/124 40s 2023-06-23T19:07:43.344 INFO:teuthology.orchestra.run.smithi158.stdout:generic/126 1s 2023-06-23T19:07:44.631 INFO:teuthology.orchestra.run.smithi158.stdout:generic/128 1s 2023-06-23T19:07:47.706 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~293s 2023-06-23T19:07:49.115 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:07:49.117 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:07:49.120 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:07:54.220 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~300s 2023-06-23T19:08:00.734 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~306s 2023-06-23T19:08:00.734 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-06-23T19:08:00.735 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-06-23T19:08:00.735 DEBUG:teuthology.orchestra.run.smithi158:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T19:08:00.788 DEBUG:teuthology.orchestra.run.smithi158:> set -ex 2023-06-23T19:08:00.788 DEBUG:teuthology.orchestra.run.smithi158:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-23T19:08:00.839 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T19:08:01.906 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.902+0000 7fc4be3e5700 1 Processor -- start 2023-06-23T19:08:01.910 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.905+0000 7fc4be3e5700 1 -- start start 2023-06-23T19:08:01.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.906+0000 7fc4be3e5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc4b806ffa0 0x7fc4b8071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:01.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.906+0000 7fc4be3e5700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7fc4b8143b30 0x7fc4b81467f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:01.911 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.906+0000 7fc4be3e5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b80b82d0 con 0x7fc4b8146350 2023-06-23T19:08:01.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.906+0000 7fc4be3e5700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b806f700 con 0x7fc4b8143b30 2023-06-23T19:08:01.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.906+0000 7fc4be3e5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b806ef40 con 0x7fc4b806ffa0 2023-06-23T19:08:01.912 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.906+0000 7fc4bd3e3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc4b806ffa0 0x7fc4b8071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:08:01.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.906+0000 7fc4bd3e3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc4b806ffa0 0x7fc4b8071b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.52:32934/0 (socket says 172.21.15.52:32934) 2023-06-23T19:08:01.913 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.906+0000 7fc4bd3e3700 1 -- 172.21.15.52:0/514576427 learned_addr learned my addr 172.21.15.52:0/514576427 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T19:08:01.914 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.907+0000 7fc4bdbe4700 1 --2- 172.21.15.52:0/514576427 >> v2:172.21.15.52:3300/0 conn(0x7fc4b8143b30 0x7fc4b81467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:08:01.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.908+0000 7fc4affff700 1 -- 172.21.15.52:0/514576427 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496894729 0 0) 0x7fc4b80b82d0 con 0x7fc4b8146350 2023-06-23T19:08:01.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.908+0000 7fc4affff700 1 -- 172.21.15.52:0/514576427 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4a40035b0 con 0x7fc4b8146350 2023-06-23T19:08:01.915 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.909+0000 7fc4bdbe4700 1 -- 172.21.15.52:0/514576427 >> v2:172.21.15.89:3300/0 conn(0x7fc4b806ffa0 msgr2=0x7fc4b8071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:08:01.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.909+0000 7fc4bdbe4700 1 --2- 172.21.15.52:0/514576427 >> v2:172.21.15.89:3300/0 conn(0x7fc4b806ffa0 0x7fc4b8071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:01.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.909+0000 7fc4bdbe4700 1 -- 172.21.15.52:0/514576427 >> v1:172.21.15.89:6789/0 conn(0x7fc4b8146350 legacy=0x7fc4b8143420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:01.916 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.909+0000 7fc4bdbe4700 1 -- 172.21.15.52:0/514576427 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b80b8520 con 0x7fc4b8143b30 2023-06-23T19:08:01.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.909+0000 7fc4bdbe4700 1 --2- 172.21.15.52:0/514576427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4b8143b30 0x7fc4b81467f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80b7a90 tx=0x7fc4b000d4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8013f1a53a99718 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:08:01.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.909+0000 7fc4affff700 1 -- 172.21.15.52:0/514576427 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0010070 con 0x7fc4b8143b30 2023-06-23T19:08:01.917 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.909+0000 7fc4affff700 1 -- 172.21.15.52:0/514576427 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b000dbc0 con 0x7fc4b8143b30 2023-06-23T19:08:01.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.910+0000 7fc4affff700 1 -- 172.21.15.52:0/514576427 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0007aa0 con 0x7fc4b8143b30 2023-06-23T19:08:01.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.910+0000 7fc4be3e5700 1 -- 172.21.15.52:0/514576427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4b8143b30 msgr2=0x7fc4b81467f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:01.918 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.910+0000 7fc4be3e5700 1 --2- 172.21.15.52:0/514576427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4b8143b30 0x7fc4b81467f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80b7a90 tx=0x7fc4b000d4c0 comp rx=0 tx=0).stop 2023-06-23T19:08:01.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.919+0000 7fc4be3e5700 1 -- 172.21.15.52:0/514576427 shutdown_connections 2023-06-23T19:08:01.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.919+0000 7fc4be3e5700 1 --2- 172.21.15.52:0/514576427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4b8143b30 0x7fc4b81467f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:01.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.919+0000 7fc4be3e5700 1 --2- 172.21.15.52:0/514576427 >> v2:172.21.15.89:3300/0 conn(0x7fc4b806ffa0 0x7fc4b8071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:01.923 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.919+0000 7fc4be3e5700 1 -- 172.21.15.52:0/514576427 >> 172.21.15.52:0/514576427 conn(0x7fc4b80b8a60 msgr2=0x7fc4b80b8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:08:01.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.936+0000 7fc4be3e5700 1 -- 172.21.15.52:0/514576427 shutdown_connections 2023-06-23T19:08:01.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.946+0000 7fc4be3e5700 1 -- 172.21.15.52:0/514576427 wait complete. 2023-06-23T19:08:01.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.948+0000 7fc4be3e5700 1 Processor -- start 2023-06-23T19:08:01.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.949+0000 7fc4be3e5700 1 -- start start 2023-06-23T19:08:01.953 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.950+0000 7fc4be3e5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4b806ffa0 0x7fc4b813adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:01.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.950+0000 7fc4be3e5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4b8143b30 0x7fc4b813b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:01.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.950+0000 7fc4be3e5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4b8146350 0x7fc4b81e7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:01.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.950+0000 7fc4be3e5700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b813baf0 con 0x7fc4b8143b30 2023-06-23T19:08:01.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.950+0000 7fc4be3e5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b81392c0 con 0x7fc4b8146350 2023-06-23T19:08:01.954 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.950+0000 7fc4be3e5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b813a290 con 0x7fc4b806ffa0 2023-06-23T19:08:01.956 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.953+0000 7fc4bd3e3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4b806ffa0 0x7fc4b813adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:08:01.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.953+0000 7fc4bd3e3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4b806ffa0 0x7fc4b813adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.52:43710/0 (socket says 172.21.15.52:43710) 2023-06-23T19:08:01.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.953+0000 7fc4bd3e3700 1 -- 172.21.15.52:0/2398430207 learned_addr learned my addr 172.21.15.52:0/2398430207 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T19:08:01.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.953+0000 7fc4bdbe4700 1 --2- 172.21.15.52:0/2398430207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4b8146350 0x7fc4b81e7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:08:01.957 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.954+0000 7fc4bdbe4700 1 -- 172.21.15.52:0/2398430207 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4b806ffa0 msgr2=0x7fc4b813adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:01.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.954+0000 7fc4bdbe4700 1 --2- 172.21.15.52:0/2398430207 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4b806ffa0 0x7fc4b813adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:01.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.954+0000 7fc4bdbe4700 1 -- 172.21.15.52:0/2398430207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4b8143b30 msgr2=0x7fc4b813b5b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-23T19:08:01.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.954+0000 7fc4bdbe4700 1 --2- 172.21.15.52:0/2398430207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4b8143b30 0x7fc4b813b5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:01.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.954+0000 7fc4bdbe4700 1 -- 172.21.15.52:0/2398430207 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b0007910 con 0x7fc4b8146350 2023-06-23T19:08:01.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.954+0000 7fc4bd3e3700 1 --2- 172.21.15.52:0/2398430207 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4b806ffa0 0x7fc4b813adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T19:08:01.958 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.954+0000 7fc4bdbe4700 1 --2- 172.21.15.52:0/2398430207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4b8146350 0x7fc4b81e7480 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0018000 tx=0x7fc4b0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:08:01.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.954+0000 7fc4adffb700 1 -- 172.21.15.52:0/2398430207 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0003e30 con 0x7fc4b8146350 2023-06-23T19:08:01.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.954+0000 7fc4adffb700 1 -- 172.21.15.52:0/2398430207 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b00072f0 con 0x7fc4b8146350 2023-06-23T19:08:01.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.954+0000 7fc4adffb700 1 -- 172.21.15.52:0/2398430207 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0004280 con 0x7fc4b8146350 2023-06-23T19:08:01.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.955+0000 7fc4be3e5700 1 -- 172.21.15.52:0/2398430207 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b81394d0 con 0x7fc4b8146350 2023-06-23T19:08:01.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.955+0000 7fc4be3e5700 1 -- 172.21.15.52:0/2398430207 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b8139a90 con 0x7fc4b8146350 2023-06-23T19:08:01.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.961+0000 7fc4be3e5700 1 -- 172.21.15.52:0/2398430207 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4980052e0 con 0x7fc4b8146350 2023-06-23T19:08:01.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.962+0000 7fc4adffb700 1 -- 172.21.15.52:0/2398430207 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc4b00043e0 con 0x7fc4b8146350 2023-06-23T19:08:01.970 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.963+0000 7fc4adffb700 1 --2- 172.21.15.52:0/2398430207 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc49c06adb0 0x7fc49c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:01.971 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.963+0000 7fc4adffb700 1 -- 172.21.15.52:0/2398430207 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fc4b008a4c0 con 0x7fc4b8146350 2023-06-23T19:08:01.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.975+0000 7fc4bd3e3700 1 --2- 172.21.15.52:0/2398430207 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc49c06adb0 0x7fc49c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:08:01.981 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.977+0000 7fc4adffb700 1 -- 172.21.15.52:0/2398430207 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc4b0055610 con 0x7fc4b8146350 2023-06-23T19:08:01.996 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:01.993+0000 7fc4bd3e3700 1 --2- 172.21.15.52:0/2398430207 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc49c06adb0 0x7fc49c06d260 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4009520 tx=0x7fc4b4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:08:02.551 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.547+0000 7fc4be3e5700 1 -- 172.21.15.52:0/2398430207 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc498005590 con 0x7fc4b8146350 2023-06-23T19:08:02.559 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.556+0000 7fc4adffb700 1 -- 172.21.15.52:0/2398430207 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+18423 (secure 0 0 0) 0x7fc4b0058c30 con 0x7fc4b8146350 2023-06-23T19:08:02.564 INFO:teuthology.orchestra.run.smithi052.stdout: 2023-06-23T19:08:02.565 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":35,"fsid":"cd0d1792-8aa8-49a7-9e5c-ba51edbbb077","created":"2023-06-23T18:44:31.918434+0000","modified":"2023-06-23T19:03:06.909046+0000","last_up_change":"2023-06-23T18:44:42.169624+0000","last_in_change":"2023-06-23T18:44:34.510501+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-23T18:44:43.346578+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-23T18:44:43.829719+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-06-23T18:45:34.943560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-06-23T18:45:36.307208+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c371fb28-1b15-4e43-8d5a-43e402920ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6809","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6812","nonce":1066999520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6815","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6818","nonce":1066999520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6829","nonce":1066999520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":1066999520},{"type":"v1","addr":"172.21.15.52:6823","nonce":1066999520}]},"public_addr":"172.21.15.52:6812/1066999520","cluster_addr":"172.21.15.52:6818/1066999520","heartbeat_back_addr":"172.21.15.52:6829/1066999520","heartbeat_front_addr":"172.21.15.52:6823/1066999520","state":["exists","up"]},{"osd":1,"uuid":"4a142f04-33eb-47ec-9cc5-b08b44d82658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6813","nonce":2360219751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6819","nonce":2360219751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6827","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6830","nonce":2360219751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":2360219751},{"type":"v1","addr":"172.21.15.52:6825","nonce":2360219751}]},"public_addr":"172.21.15.52:6813/2360219751","cluster_addr":"172.21.15.52:6819/2360219751","heartbeat_back_addr":"172.21.15.52:6830/2360219751","heartbeat_front_addr":"172.21.15.52:6825/2360219751","state":["exists","up"]},{"osd":2,"uuid":"d7bb089d-4c55-4370-ba59-7fe88c39512a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6801","nonce":835073005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6803","nonce":835073005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6807","nonce":835073005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":835073005},{"type":"v1","addr":"172.21.15.52:6805","nonce":835073005}]},"public_addr":"172.21.15.52:6801/835073005","cluster_addr":"172.21.15.52:6803/835073005","heartbeat_back_addr":"172.21.15.52:6807/835073005","heartbeat_front_addr":"172.21.15.52:6805/835073005","state":["exists","up"]},{"osd":3,"uuid":"4bcdcdc3-6a8f-468e-877e-57f76079ac3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6811","nonce":2852700864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6817","nonce":2852700864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6831","nonce":2852700864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6821","nonce":2852700864},{"type":"v1","addr":"172.21.15.52:6824","nonce":2852700864}]},"public_addr":"172.21.15.52:6811/2852700864","cluster_addr":"172.21.15.52:6817/2852700864","heartbeat_back_addr":"172.21.15.52:6831/2852700864","heartbeat_front_addr":"172.21.15.52:6824/2852700864","state":["exists","up"]},{"osd":4,"uuid":"cac63000-ae94-4b08-93e6-a99119640b63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6809","nonce":2538664679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6811","nonce":2538664679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6815","nonce":2538664679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":2538664679},{"type":"v1","addr":"172.21.15.89:6813","nonce":2538664679}]},"public_addr":"172.21.15.89:6809/2538664679","cluster_addr":"172.21.15.89:6811/2538664679","heartbeat_back_addr":"172.21.15.89:6815/2538664679","heartbeat_front_addr":"172.21.15.89:6813/2538664679","state":["exists","up"]},{"osd":5,"uuid":"45c53102-18a6-4fd7-9c25-8ea5e1ef6851","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6801","nonce":1683710352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6803","nonce":1683710352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6807","nonce":1683710352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1683710352},{"type":"v1","addr":"172.21.15.89:6805","nonce":1683710352}]},"public_addr":"172.21.15.89:6801/1683710352","cluster_addr":"172.21.15.89:6803/1683710352","heartbeat_back_addr":"172.21.15.89:6807/1683710352","heartbeat_front_addr":"172.21.15.89:6805/1683710352","state":["exists","up"]},{"osd":6,"uuid":"abee09d1-8eba-484f-a25c-871c1fe2e843","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6817","nonce":3890899288}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6819","nonce":3890899288}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6823","nonce":3890899288}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3890899288},{"type":"v1","addr":"172.21.15.89:6821","nonce":3890899288}]},"public_addr":"172.21.15.89:6817/3890899288","cluster_addr":"172.21.15.89:6819/3890899288","heartbeat_back_addr":"172.21.15.89:6823/3890899288","heartbeat_front_addr":"172.21.15.89:6821/3890899288","state":["exists","up"]},{"osd":7,"uuid":"5acf9e2e-00dd-4f9b-a7d9-3d820f695de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6825","nonce":2989085420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6827","nonce":2989085420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6831","nonce":2989085420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2989085420},{"type":"v1","addr":"172.21.15.89:6829","nonce":2989085420}]},"public_addr":"172.21.15.89:6825/2989085420","cluster_addr":"172.21.15.89:6827/2989085420","heartbeat_back_addr":"172.21.15.89:6831/2989085420","heartbeat_front_addr":"172.21.15.89:6829/2989085420","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.663866+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.710904+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.619347+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.660102+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.686933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.724635+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.669111+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T18:44:39.678740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.10","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.52:6835/2041592035":"2023-06-24T19:03:06.908932+0000","172.21.15.52:6833/2041592035":"2023-06-24T19:03:06.908932+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T19:08:02.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.585+0000 7fc4be3e5700 1 -- 172.21.15.52:0/2398430207 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc49c06adb0 msgr2=0x7fc49c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:02.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.585+0000 7fc4be3e5700 1 --2- 172.21.15.52:0/2398430207 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc49c06adb0 0x7fc49c06d260 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4009520 tx=0x7fc4b4008040 comp rx=0 tx=0).stop 2023-06-23T19:08:02.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.585+0000 7fc4be3e5700 1 -- 172.21.15.52:0/2398430207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4b8146350 msgr2=0x7fc4b81e7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:02.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.585+0000 7fc4be3e5700 1 --2- 172.21.15.52:0/2398430207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4b8146350 0x7fc4b81e7480 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0018000 tx=0x7fc4b0004ad0 comp rx=0 tx=0).stop 2023-06-23T19:08:02.593 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.586+0000 7fc4be3e5700 1 -- 172.21.15.52:0/2398430207 shutdown_connections 2023-06-23T19:08:02.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.586+0000 7fc4be3e5700 1 --2- 172.21.15.52:0/2398430207 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fc49c06adb0 0x7fc49c06d260 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:02.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.586+0000 7fc4be3e5700 1 --2- 172.21.15.52:0/2398430207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4b8146350 0x7fc4b81e7480 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:02.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.586+0000 7fc4be3e5700 1 --2- 172.21.15.52:0/2398430207 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4b806ffa0 0x7fc4b813adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:02.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.586+0000 7fc4be3e5700 1 --2- 172.21.15.52:0/2398430207 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc4b8143b30 0x7fc4b813b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:02.594 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.586+0000 7fc4be3e5700 1 -- 172.21.15.52:0/2398430207 >> 172.21.15.52:0/2398430207 conn(0x7fc4b80b8a60 msgr2=0x7fc4b813dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:08:02.602 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.597+0000 7fc4be3e5700 1 -- 172.21.15.52:0/2398430207 shutdown_connections 2023-06-23T19:08:02.603 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.600+0000 7fc4be3e5700 1 -- 172.21.15.52:0/2398430207 wait complete. 2023-06-23T19:08:02.642 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-23T18:44:43.346578+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-23T18:44:43.829719+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-23T18:45:34.943560+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-06-23T18:45:36.307208+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-23T19:08:02.643 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T19:08:02.980 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.977+0000 7f5a9a175700 1 Processor -- start 2023-06-23T19:08:02.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.980+0000 7f5a9a175700 1 -- start start 2023-06-23T19:08:02.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.981+0000 7f5a9a175700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5a94147f40 0x7f5a94144650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:02.986 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.981+0000 7f5a9a175700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f5a94144b90 0x7f5a94151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:02.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.981+0000 7f5a9a175700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a941473a0 con 0x7f5a940b8b50 2023-06-23T19:08:02.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.981+0000 7f5a9a175700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a94071170 con 0x7f5a94144b90 2023-06-23T19:08:02.987 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.981+0000 7f5a9a175700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a94071760 con 0x7f5a94147f40 2023-06-23T19:08:02.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.982+0000 7f5a92ffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5a94147f40 0x7f5a94144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:08:02.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.982+0000 7f5a92ffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5a94147f40 0x7f5a94144650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.52:32952/0 (socket says 172.21.15.52:32952) 2023-06-23T19:08:02.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.982+0000 7f5a92ffd700 1 -- 172.21.15.52:0/1291172748 learned_addr learned my addr 172.21.15.52:0/1291172748 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T19:08:02.988 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.982+0000 7f5a92ffd700 1 -- 172.21.15.52:0/1291172748 >> v2:172.21.15.52:3300/0 conn(0x7f5a94144b90 msgr2=0x7f5a94151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:08:02.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.982+0000 7f5a92ffd700 1 --2- 172.21.15.52:0/1291172748 >> v2:172.21.15.52:3300/0 conn(0x7f5a94144b90 0x7f5a94151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:02.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.982+0000 7f5a92ffd700 1 -- 172.21.15.52:0/1291172748 >> v1:172.21.15.52:6789/0 conn(0x7f5a940b8b50 legacy=0x7f5a94147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:08:02.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.982+0000 7f5a92ffd700 1 -- 172.21.15.52:0/1291172748 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a94071a40 con 0x7f5a94147f40 2023-06-23T19:08:02.989 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.982+0000 7f5a92ffd700 1 --2- 172.21.15.52:0/1291172748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a94147f40 0x7f5a94144650 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5a9406cc40 tx=0x7f5a8c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da182aa3e8d1af9b server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:08:02.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.984+0000 7f5a927fc700 1 -- 172.21.15.52:0/1291172748 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c00e070 con 0x7f5a94147f40 2023-06-23T19:08:02.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.984+0000 7f5a927fc700 1 -- 172.21.15.52:0/1291172748 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8c003a20 con 0x7f5a94147f40 2023-06-23T19:08:02.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.984+0000 7f5a927fc700 1 -- 172.21.15.52:0/1291172748 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c003dd0 con 0x7f5a94147f40 2023-06-23T19:08:02.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.984+0000 7f5a9a175700 1 -- 172.21.15.52:0/1291172748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a94147f40 msgr2=0x7f5a94144650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:02.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:02.984+0000 7f5a9a175700 1 --2- 172.21.15.52:0/1291172748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a94147f40 0x7f5a94144650 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5a9406cc40 tx=0x7f5a8c00b330 comp rx=0 tx=0).stop 2023-06-23T19:08:03.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.006+0000 7f5a9a175700 1 -- 172.21.15.52:0/1291172748 shutdown_connections 2023-06-23T19:08:03.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.006+0000 7f5a9a175700 1 --2- 172.21.15.52:0/1291172748 >> v2:172.21.15.52:3300/0 conn(0x7f5a94144b90 0x7f5a94151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:03.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.006+0000 7f5a9a175700 1 --2- 172.21.15.52:0/1291172748 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a94147f40 0x7f5a94144650 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:03.010 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.006+0000 7f5a9a175700 1 -- 172.21.15.52:0/1291172748 >> 172.21.15.52:0/1291172748 conn(0x7f5a940bd3d0 msgr2=0x7f5a940bd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:08:03.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.010+0000 7f5a9a175700 1 -- 172.21.15.52:0/1291172748 shutdown_connections 2023-06-23T19:08:03.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.010+0000 7f5a9a175700 1 -- 172.21.15.52:0/1291172748 wait complete. 2023-06-23T19:08:03.014 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.011+0000 7f5a9a175700 1 Processor -- start 2023-06-23T19:08:03.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.011+0000 7f5a9a175700 1 -- start start 2023-06-23T19:08:03.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.012+0000 7f5a9a175700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a940b8b50 0x7f5a940b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:03.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.012+0000 7f5a9a175700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a94144b90 0x7f5a9414b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:03.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.012+0000 7f5a9a175700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a94147f40 0x7f5a9413f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:03.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.012+0000 7f5a9a175700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a940b6580 con 0x7f5a94144b90 2023-06-23T19:08:03.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.012+0000 7f5a9a175700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a940b3b40 con 0x7f5a94147f40 2023-06-23T19:08:03.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.012+0000 7f5a9a175700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9414a160 con 0x7f5a940b8b50 2023-06-23T19:08:03.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.013+0000 7f5a92ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a94144b90 0x7f5a9414b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:08:03.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.013+0000 7f5a92ffd700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a94144b90 0x7f5a9414b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55182/0 (socket says 172.21.15.52:55182) 2023-06-23T19:08:03.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.013+0000 7f5a92ffd700 1 -- 172.21.15.52:0/3663463709 learned_addr learned my addr 172.21.15.52:0/3663463709 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T19:08:03.018 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.013+0000 7f5a92ffd700 1 -- 172.21.15.52:0/3663463709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a940b8b50 msgr2=0x7f5a940b3600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-23T19:08:03.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.013+0000 7f5a92ffd700 1 --2- 172.21.15.52:0/3663463709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a940b8b50 0x7f5a940b3600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:03.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.013+0000 7f5a92ffd700 1 -- 172.21.15.52:0/3663463709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a94147f40 msgr2=0x7f5a9413f810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-23T19:08:03.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.013+0000 7f5a92ffd700 1 --2- 172.21.15.52:0/3663463709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a94147f40 0x7f5a9413f810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:03.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.013+0000 7f5a92ffd700 1 -- 172.21.15.52:0/3663463709 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c009b30 con 0x7f5a94144b90 2023-06-23T19:08:03.019 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.014+0000 7f5a92ffd700 1 --2- 172.21.15.52:0/3663463709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a94144b90 0x7f5a9414b040 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c004000 tx=0x7f5a8c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:08:03.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.017+0000 7f5a7bfff700 1 -- 172.21.15.52:0/3663463709 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c01eb20 con 0x7f5a94144b90 2023-06-23T19:08:03.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.017+0000 7f5a7bfff700 1 -- 172.21.15.52:0/3663463709 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8c01ec80 con 0x7f5a94144b90 2023-06-23T19:08:03.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.017+0000 7f5a7bfff700 1 -- 172.21.15.52:0/3663463709 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c004030 con 0x7f5a94144b90 2023-06-23T19:08:03.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.017+0000 7f5a9a175700 1 -- 172.21.15.52:0/3663463709 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a941e1090 con 0x7f5a94144b90 2023-06-23T19:08:03.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.017+0000 7f5a9a175700 1 -- 172.21.15.52:0/3663463709 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a941d06a0 con 0x7f5a94144b90 2023-06-23T19:08:03.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.021+0000 7f5a9a175700 1 -- 172.21.15.52:0/3663463709 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a740052e0 con 0x7f5a94144b90 2023-06-23T19:08:03.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.030+0000 7f5a7bfff700 1 -- 172.21.15.52:0/3663463709 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5a8c024070 con 0x7f5a94144b90 2023-06-23T19:08:03.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.031+0000 7f5a7bfff700 1 --2- 172.21.15.52:0/3663463709 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f5a8006adb0 0x7f5a8006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:03.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.031+0000 7f5a7bfff700 1 -- 172.21.15.52:0/3663463709 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f5a8c08eb00 con 0x7f5a94144b90 2023-06-23T19:08:03.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.031+0000 7f5a7bfff700 1 -- 172.21.15.52:0/3663463709 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5a8c0922a0 con 0x7f5a94144b90 2023-06-23T19:08:03.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.050+0000 7f5a937fe700 1 --2- 172.21.15.52:0/3663463709 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f5a8006adb0 0x7f5a8006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:08:03.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.052+0000 7f5a937fe700 1 --2- 172.21.15.52:0/3663463709 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f5a8006adb0 0x7f5a8006d260 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5a88006fd0 tx=0x7f5a88006bc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:08:03.623 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.619+0000 7f5a9a175700 1 -- 172.21.15.52:0/3663463709 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5a74005b10 con 0x7f5a94144b90 2023-06-23T19:08:03.624 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.621+0000 7f5a7bfff700 1 -- 172.21.15.52:0/3663463709 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v35) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5a8c059be0 con 0x7f5a94144b90 2023-06-23T19:08:03.625 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2023-06-23T19:08:03.641 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.638+0000 7f5a9a175700 1 -- 172.21.15.52:0/3663463709 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f5a8006adb0 msgr2=0x7f5a8006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:03.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.638+0000 7f5a9a175700 1 --2- 172.21.15.52:0/3663463709 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f5a8006adb0 0x7f5a8006d260 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5a88006fd0 tx=0x7f5a88006bc0 comp rx=0 tx=0).stop 2023-06-23T19:08:03.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.638+0000 7f5a9a175700 1 -- 172.21.15.52:0/3663463709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a94144b90 msgr2=0x7f5a9414b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:03.642 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.638+0000 7f5a9a175700 1 --2- 172.21.15.52:0/3663463709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a94144b90 0x7f5a9414b040 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c004000 tx=0x7f5a8c004ad0 comp rx=0 tx=0).stop 2023-06-23T19:08:03.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.645+0000 7f5a9a175700 1 -- 172.21.15.52:0/3663463709 shutdown_connections 2023-06-23T19:08:03.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.645+0000 7f5a9a175700 1 --2- 172.21.15.52:0/3663463709 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f5a8006adb0 0x7f5a8006d260 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:03.649 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.645+0000 7f5a9a175700 1 --2- 172.21.15.52:0/3663463709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a94147f40 0x7f5a9413f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:03.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.645+0000 7f5a9a175700 1 --2- 172.21.15.52:0/3663463709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5a940b8b50 0x7f5a940b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:03.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.645+0000 7f5a9a175700 1 --2- 172.21.15.52:0/3663463709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5a94144b90 0x7f5a9414b040 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:03.650 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.645+0000 7f5a9a175700 1 -- 172.21.15.52:0/3663463709 >> 172.21.15.52:0/3663463709 conn(0x7f5a940bd3d0 msgr2=0x7f5a94143950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:08:03.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.658+0000 7f5a9a175700 1 -- 172.21.15.52:0/3663463709 shutdown_connections 2023-06-23T19:08:03.663 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.660+0000 7f5a9a175700 1 -- 172.21.15.52:0/3663463709 wait complete. 2023-06-23T19:08:03.692 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T19:08:03.990 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.987+0000 7f64ed54b700 1 Processor -- start 2023-06-23T19:08:03.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.987+0000 7f64ed54b700 1 -- start start 2023-06-23T19:08:03.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.988+0000 7f64ed54b700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f64e806a0d0 0x7f64e806c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:03.991 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.988+0000 7f64ed54b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f64e806a4a0 0x7f64e80b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:03.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.988+0000 7f64ed54b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e80b70e0 con 0x7f64e80b9a20 2023-06-23T19:08:03.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.988+0000 7f64ed54b700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e806b090 con 0x7f64e806a0d0 2023-06-23T19:08:03.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.988+0000 7f64ed54b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e806a960 con 0x7f64e806a4a0 2023-06-23T19:08:03.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.989+0000 7f64e6ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f64e806a0d0 0x7f64e806c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:08:03.992 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.989+0000 7f64e6ffd700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f64e806a0d0 0x7f64e806c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55192/0 (socket says 172.21.15.52:55192) 2023-06-23T19:08:03.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.989+0000 7f64e6ffd700 1 -- 172.21.15.52:0/2079746536 learned_addr learned my addr 172.21.15.52:0/2079746536 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T19:08:03.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.989+0000 7f64e6ffd700 1 -- 172.21.15.52:0/2079746536 >> v2:172.21.15.89:3300/0 conn(0x7f64e806a4a0 msgr2=0x7f64e80b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:08:03.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.989+0000 7f64e6ffd700 1 --2- 172.21.15.52:0/2079746536 >> v2:172.21.15.89:3300/0 conn(0x7f64e806a4a0 0x7f64e80b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:03.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.989+0000 7f64e6ffd700 1 -- 172.21.15.52:0/2079746536 >> v1:172.21.15.89:6789/0 conn(0x7f64e80b9a20 legacy=0x7f64e814daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:08:03.993 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.989+0000 7f64e6ffd700 1 -- 172.21.15.52:0/2079746536 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e806bcf0 con 0x7f64e806a0d0 2023-06-23T19:08:03.994 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.990+0000 7f64e6ffd700 1 --2- 172.21.15.52:0/2079746536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64e806a0d0 0x7f64e806c110 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f64e80b80e0 tx=0x7f64d8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a33fd208d901f9b server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:08:03.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.994+0000 7f64e5ffb700 1 -- 172.21.15.52:0/2079746536 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d8004230 con 0x7f64e806a0d0 2023-06-23T19:08:03.999 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.994+0000 7f64e5ffb700 1 -- 172.21.15.52:0/2079746536 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d8004390 con 0x7f64e806a0d0 2023-06-23T19:08:04.000 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:03.994+0000 7f64e5ffb700 1 -- 172.21.15.52:0/2079746536 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d80036a0 con 0x7f64e806a0d0 2023-06-23T19:08:04.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.002+0000 7f64ed54b700 1 -- 172.21.15.52:0/2079746536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64e806a0d0 msgr2=0x7f64e806c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:04.006 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.002+0000 7f64ed54b700 1 --2- 172.21.15.52:0/2079746536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64e806a0d0 0x7f64e806c110 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f64e80b80e0 tx=0x7f64d8009bd0 comp rx=0 tx=0).stop 2023-06-23T19:08:04.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.004+0000 7f64ed54b700 1 -- 172.21.15.52:0/2079746536 shutdown_connections 2023-06-23T19:08:04.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.004+0000 7f64ed54b700 1 --2- 172.21.15.52:0/2079746536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64e806a0d0 0x7f64e806c110 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:04.008 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.004+0000 7f64ed54b700 1 --2- 172.21.15.52:0/2079746536 >> v2:172.21.15.89:3300/0 conn(0x7f64e806a4a0 0x7f64e80b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:04.009 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.004+0000 7f64ed54b700 1 -- 172.21.15.52:0/2079746536 >> 172.21.15.52:0/2079746536 conn(0x7f64e80bd420 msgr2=0x7f64e80bd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:08:04.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.010+0000 7f64ed54b700 1 -- 172.21.15.52:0/2079746536 shutdown_connections 2023-06-23T19:08:04.013 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.010+0000 7f64ed54b700 1 -- 172.21.15.52:0/2079746536 wait complete. 2023-06-23T19:08:04.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.012+0000 7f64ed54b700 1 Processor -- start 2023-06-23T19:08:04.016 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.012+0000 7f64ed54b700 1 -- start start 2023-06-23T19:08:04.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.013+0000 7f64ed54b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64e806a0d0 0x7f64e80a91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:04.017 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.013+0000 7f64ed54b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64e806a4a0 0x7f64e80a9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:04.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.013+0000 7f64ed54b700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64e80b9a20 0x7f64e81ddd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:04.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.013+0000 7f64ed54b700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e80a7b10 con 0x7f64e80b9a20 2023-06-23T19:08:04.020 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.013+0000 7f64ed54b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e80a9720 con 0x7f64e806a0d0 2023-06-23T19:08:04.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.013+0000 7f64ed54b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e80a7900 con 0x7f64e806a4a0 2023-06-23T19:08:04.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.013+0000 7f64e77fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64e80b9a20 0x7f64e81ddd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:08:04.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.014+0000 7f64e77fe700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64e80b9a20 0x7f64e81ddd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55202/0 (socket says 172.21.15.52:55202) 2023-06-23T19:08:04.021 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.014+0000 7f64e77fe700 1 -- 172.21.15.52:0/1947925793 learned_addr learned my addr 172.21.15.52:0/1947925793 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T19:08:04.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.014+0000 7f64e67fc700 1 --2- 172.21.15.52:0/1947925793 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64e806a4a0 0x7f64e80a9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:08:04.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.014+0000 7f64e77fe700 1 -- 172.21.15.52:0/1947925793 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64e806a4a0 msgr2=0x7f64e80a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:04.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.014+0000 7f64e77fe700 1 --2- 172.21.15.52:0/1947925793 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64e806a4a0 0x7f64e80a9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:04.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.014+0000 7f64e77fe700 1 -- 172.21.15.52:0/1947925793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64e806a0d0 msgr2=0x7f64e80a91e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-23T19:08:04.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.014+0000 7f64e77fe700 1 --2- 172.21.15.52:0/1947925793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64e806a0d0 0x7f64e80a91e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:04.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.014+0000 7f64e77fe700 1 -- 172.21.15.52:0/1947925793 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d8009550 con 0x7f64e80b9a20 2023-06-23T19:08:04.022 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.015+0000 7f64e77fe700 1 --2- 172.21.15.52:0/1947925793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64e80b9a20 0x7f64e81ddd90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f64e000b990 tx=0x7f64e000bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:08:04.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.018+0000 7f64cf7fe700 1 -- 172.21.15.52:0/1947925793 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e000c930 con 0x7f64e80b9a20 2023-06-23T19:08:04.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.018+0000 7f64cf7fe700 1 -- 172.21.15.52:0/1947925793 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e000ca90 con 0x7f64e80b9a20 2023-06-23T19:08:04.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.018+0000 7f64cf7fe700 1 -- 172.21.15.52:0/1947925793 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e000ce40 con 0x7f64e80b9a20 2023-06-23T19:08:04.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.020+0000 7f64ed54b700 1 -- 172.21.15.52:0/1947925793 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e80aa870 con 0x7f64e80b9a20 2023-06-23T19:08:04.025 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.020+0000 7f64ed54b700 1 -- 172.21.15.52:0/1947925793 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e80a85d0 con 0x7f64e80b9a20 2023-06-23T19:08:04.030 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.026+0000 7f64cf7fe700 1 -- 172.21.15.52:0/1947925793 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f64e0006d50 con 0x7f64e80b9a20 2023-06-23T19:08:04.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.026+0000 7f64cf7fe700 1 --2- 172.21.15.52:0/1947925793 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f64d406adb0 0x7f64d406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:04.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.027+0000 7f64cf7fe700 1 -- 172.21.15.52:0/1947925793 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f64e0088fd0 con 0x7f64e80b9a20 2023-06-23T19:08:04.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.027+0000 7f64e6ffd700 1 --2- 172.21.15.52:0/1947925793 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f64d406adb0 0x7f64d406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:08:04.031 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.028+0000 7f64e6ffd700 1 --2- 172.21.15.52:0/1947925793 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f64d406adb0 0x7f64d406d260 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f64d8009c10 tx=0x7f64d8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:08:04.032 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.029+0000 7f64ed54b700 1 -- 172.21.15.52:0/1947925793 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e804e1d0 con 0x7f64e80b9a20 2023-06-23T19:08:04.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.041+0000 7f64cf7fe700 1 -- 172.21.15.52:0/1947925793 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f64e0053ff0 con 0x7f64e80b9a20 2023-06-23T19:08:04.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.436+0000 7f64ed54b700 1 -- 172.21.15.52:0/1947925793 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f64e806ba10 con 0x7f64e80b9a20 2023-06-23T19:08:04.450 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.446+0000 7f64cf7fe700 1 -- 172.21.15.52:0/1947925793 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f64e005b020 con 0x7f64e80b9a20 2023-06-23T19:08:04.458 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2023-06-23T19:08:04.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.457+0000 7f64ed54b700 1 -- 172.21.15.52:0/1947925793 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f64d406adb0 msgr2=0x7f64d406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:04.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.457+0000 7f64ed54b700 1 --2- 172.21.15.52:0/1947925793 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f64d406adb0 0x7f64d406d260 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f64d8009c10 tx=0x7f64d8008030 comp rx=0 tx=0).stop 2023-06-23T19:08:04.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.457+0000 7f64ed54b700 1 -- 172.21.15.52:0/1947925793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64e80b9a20 msgr2=0x7f64e81ddd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:04.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.457+0000 7f64ed54b700 1 --2- 172.21.15.52:0/1947925793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64e80b9a20 0x7f64e81ddd90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f64e000b990 tx=0x7f64e000bca0 comp rx=0 tx=0).stop 2023-06-23T19:08:04.461 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.457+0000 7f64ed54b700 1 -- 172.21.15.52:0/1947925793 shutdown_connections 2023-06-23T19:08:04.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.457+0000 7f64ed54b700 1 --2- 172.21.15.52:0/1947925793 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f64d406adb0 0x7f64d406d260 secure :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f64d8009c10 tx=0x7f64d8008030 comp rx=0 tx=0).stop 2023-06-23T19:08:04.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.457+0000 7f64ed54b700 1 --2- 172.21.15.52:0/1947925793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64e80b9a20 0x7f64e81ddd90 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:04.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.457+0000 7f64ed54b700 1 --2- 172.21.15.52:0/1947925793 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64e806a0d0 0x7f64e80a91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:04.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.457+0000 7f64ed54b700 1 --2- 172.21.15.52:0/1947925793 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64e806a4a0 0x7f64e80a9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:04.462 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.457+0000 7f64ed54b700 1 -- 172.21.15.52:0/1947925793 >> 172.21.15.52:0/1947925793 conn(0x7f64e80bd420 msgr2=0x7f64e80ba5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:08:04.469 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.466+0000 7f64ed54b700 1 -- 172.21.15.52:0/1947925793 shutdown_connections 2023-06-23T19:08:04.472 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:04.469+0000 7f64ed54b700 1 -- 172.21.15.52:0/1947925793 wait complete. 2023-06-23T19:08:04.502 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-23T19:08:05.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.030+0000 7f4c73cec700 1 Processor -- start 2023-06-23T19:08:05.034 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.030+0000 7f4c73cec700 1 -- start start 2023-06-23T19:08:05.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.031+0000 7f4c73cec700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4c6c06b0e0 0x7f4c6c1520d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:05.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.031+0000 7f4c73cec700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4c6c148c10 0x7f4c6c152610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:05.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.031+0000 7f4c73cec700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c6c0b67d0 con 0x7f4c6c0b84c0 2023-06-23T19:08:05.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.031+0000 7f4c73cec700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c6c071eb0 con 0x7f4c6c148c10 2023-06-23T19:08:05.035 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.031+0000 7f4c73cec700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c6c071970 con 0x7f4c6c06b0e0 2023-06-23T19:08:05.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.031+0000 7f4c72289700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4c6c148c10 0x7f4c6c152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:08:05.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.031+0000 7f4c72289700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f4c6c148c10 0x7f4c6c152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:55212/0 (socket says 172.21.15.52:55212) 2023-06-23T19:08:05.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.031+0000 7f4c72289700 1 -- 172.21.15.52:0/2680131094 learned_addr learned my addr 172.21.15.52:0/2680131094 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T19:08:05.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.031+0000 7f4c72289700 1 -- 172.21.15.52:0/2680131094 >> v2:172.21.15.89:3300/0 conn(0x7f4c6c06b0e0 msgr2=0x7f4c6c1520d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T19:08:05.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.031+0000 7f4c72289700 1 --2- 172.21.15.52:0/2680131094 >> v2:172.21.15.89:3300/0 conn(0x7f4c6c06b0e0 0x7f4c6c1520d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:05.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.031+0000 7f4c72289700 1 -- 172.21.15.52:0/2680131094 >> v1:172.21.15.89:6789/0 conn(0x7f4c6c0b84c0 legacy=0x7f4c6c148500 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-23T19:08:05.036 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.031+0000 7f4c72289700 1 -- 172.21.15.52:0/2680131094 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c6c071c10 con 0x7f4c6c148c10 2023-06-23T19:08:05.037 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.033+0000 7f4c72289700 1 --2- 172.21.15.52:0/2680131094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c6c148c10 0x7f4c6c152610 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c06e270 tx=0x7f4c64009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212ff18d20779f19 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:08:05.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.034+0000 7f4c70a86700 1 -- 172.21.15.52:0/2680131094 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c64004230 con 0x7f4c6c148c10 2023-06-23T19:08:05.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.034+0000 7f4c70a86700 1 -- 172.21.15.52:0/2680131094 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c64004390 con 0x7f4c6c148c10 2023-06-23T19:08:05.038 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.034+0000 7f4c70a86700 1 -- 172.21.15.52:0/2680131094 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c640036a0 con 0x7f4c6c148c10 2023-06-23T19:08:05.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.035+0000 7f4c73cec700 1 -- 172.21.15.52:0/2680131094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c6c148c10 msgr2=0x7f4c6c152610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:05.039 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.035+0000 7f4c73cec700 1 --2- 172.21.15.52:0/2680131094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c6c148c10 0x7f4c6c152610 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c06e270 tx=0x7f4c64009bd0 comp rx=0 tx=0).stop 2023-06-23T19:08:05.040 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.037+0000 7f4c73cec700 1 -- 172.21.15.52:0/2680131094 shutdown_connections 2023-06-23T19:08:05.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.037+0000 7f4c73cec700 1 --2- 172.21.15.52:0/2680131094 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c6c148c10 0x7f4c6c152610 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:05.043 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.037+0000 7f4c73cec700 1 --2- 172.21.15.52:0/2680131094 >> v2:172.21.15.89:3300/0 conn(0x7f4c6c06b0e0 0x7f4c6c1520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:05.044 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.037+0000 7f4c73cec700 1 -- 172.21.15.52:0/2680131094 >> 172.21.15.52:0/2680131094 conn(0x7f4c6c0b8dd0 msgr2=0x7f4c6c0b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:08:05.048 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.045+0000 7f4c73cec700 1 -- 172.21.15.52:0/2680131094 shutdown_connections 2023-06-23T19:08:05.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.047+0000 7f4c73cec700 1 -- 172.21.15.52:0/2680131094 wait complete. 2023-06-23T19:08:05.052 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.048+0000 7f4c73cec700 1 Processor -- start 2023-06-23T19:08:05.053 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.050+0000 7f4c73cec700 1 -- start start 2023-06-23T19:08:05.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.051+0000 7f4c73cec700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c6c06b0e0 0x7f4c6c146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:05.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.051+0000 7f4c73cec700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c6c0b84c0 0x7f4c6c143df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:05.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.051+0000 7f4c73cec700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c6c148c10 0x7f4c6c1d8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:05.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.051+0000 7f4c73cec700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c1470b0 con 0x7f4c6c0b84c0 2023-06-23T19:08:05.054 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.051+0000 7f4c73cec700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c1d7440 con 0x7f4c6c148c10 2023-06-23T19:08:05.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.051+0000 7f4c73cec700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c1d7720 con 0x7f4c6c06b0e0 2023-06-23T19:08:05.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.051+0000 7f4c71a88700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c6c06b0e0 0x7f4c6c146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:08:05.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.051+0000 7f4c72289700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c6c148c10 0x7f4c6c1d8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:08:05.055 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.051+0000 7f4c71a88700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c6c06b0e0 0x7f4c6c146b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.52:43724/0 (socket says 172.21.15.52:43724) 2023-06-23T19:08:05.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.051+0000 7f4c71a88700 1 -- 172.21.15.52:0/538467917 learned_addr learned my addr 172.21.15.52:0/538467917 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T19:08:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.051+0000 7f4c72289700 1 -- 172.21.15.52:0/538467917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c6c06b0e0 msgr2=0x7f4c6c146b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.052+0000 7f4c72289700 1 --2- 172.21.15.52:0/538467917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c6c06b0e0 0x7f4c6c146b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.052+0000 7f4c72289700 1 -- 172.21.15.52:0/538467917 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c6c0b84c0 msgr2=0x7f4c6c143df0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-23T19:08:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.052+0000 7f4c72289700 1 --2- 172.21.15.52:0/538467917 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c6c0b84c0 0x7f4c6c143df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.052+0000 7f4c72289700 1 -- 172.21.15.52:0/538467917 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c64009550 con 0x7f4c6c148c10 2023-06-23T19:08:05.057 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.052+0000 7f4c72289700 1 --2- 172.21.15.52:0/538467917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c6c148c10 0x7f4c6c1d8220 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4c64015000 tx=0x7f4c64004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:08:05.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.052+0000 7f4c6a7fc700 1 -- 172.21.15.52:0/538467917 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c64003e50 con 0x7f4c6c148c10 2023-06-23T19:08:05.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.052+0000 7f4c6a7fc700 1 -- 172.21.15.52:0/538467917 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c64011630 con 0x7f4c6c148c10 2023-06-23T19:08:05.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.052+0000 7f4c6a7fc700 1 -- 172.21.15.52:0/538467917 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c640119c0 con 0x7f4c6c148c10 2023-06-23T19:08:05.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.052+0000 7f4c73cec700 1 -- 172.21.15.52:0/538467917 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c6c0712a0 con 0x7f4c6c148c10 2023-06-23T19:08:05.058 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.052+0000 7f4c73cec700 1 -- 172.21.15.52:0/538467917 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c6c1d7d00 con 0x7f4c6c148c10 2023-06-23T19:08:05.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.054+0000 7f4c73cec700 1 -- 172.21.15.52:0/538467917 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c6c06ea90 con 0x7f4c6c148c10 2023-06-23T19:08:05.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.055+0000 7f4c6a7fc700 1 -- 172.21.15.52:0/538467917 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4c64021070 con 0x7f4c6c148c10 2023-06-23T19:08:05.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.056+0000 7f4c6a7fc700 1 --2- 172.21.15.52:0/538467917 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f4c5006ace0 0x7f4c5006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:05.059 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.056+0000 7f4c6a7fc700 1 -- 172.21.15.52:0/538467917 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f4c6408ac10 con 0x7f4c6c148c10 2023-06-23T19:08:05.061 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.058+0000 7f4c71a88700 1 --2- 172.21.15.52:0/538467917 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f4c5006ace0 0x7f4c5006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:08:05.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.060+0000 7f4c71a88700 1 --2- 172.21.15.52:0/538467917 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f4c5006ace0 0x7f4c5006d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000e200 tx=0x7f4c6000b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:08:05.074 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.068+0000 7f4c6a7fc700 1 -- 172.21.15.52:0/538467917 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4c64055c30 con 0x7f4c6c148c10 2023-06-23T19:08:05.499 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2023-06-23T19:08:05.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.481+0000 7f4c73cec700 1 -- 172.21.15.52:0/538467917 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4c6c0b9c20 con 0x7f4c6c148c10 2023-06-23T19:08:05.499 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.482+0000 7f4c6a7fc700 1 -- 172.21.15.52:0/538467917 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4c64059250 con 0x7f4c6c148c10 2023-06-23T19:08:05.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.500+0000 7f4c73cec700 1 -- 172.21.15.52:0/538467917 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f4c5006ace0 msgr2=0x7f4c5006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:05.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.500+0000 7f4c73cec700 1 --2- 172.21.15.52:0/538467917 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f4c5006ace0 0x7f4c5006d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000e200 tx=0x7f4c6000b040 comp rx=0 tx=0).stop 2023-06-23T19:08:05.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.500+0000 7f4c73cec700 1 -- 172.21.15.52:0/538467917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c6c148c10 msgr2=0x7f4c6c1d8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:05.504 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.500+0000 7f4c73cec700 1 --2- 172.21.15.52:0/538467917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c6c148c10 0x7f4c6c1d8220 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4c64015000 tx=0x7f4c64004750 comp rx=0 tx=0).stop 2023-06-23T19:08:05.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.506+0000 7f4c73cec700 1 -- 172.21.15.52:0/538467917 shutdown_connections 2023-06-23T19:08:05.509 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.506+0000 7f4c73cec700 1 --2- 172.21.15.52:0/538467917 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f4c5006ace0 0x7f4c5006d190 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:05.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.506+0000 7f4c73cec700 1 --2- 172.21.15.52:0/538467917 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4c6c148c10 0x7f4c6c1d8220 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:05.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.506+0000 7f4c73cec700 1 --2- 172.21.15.52:0/538467917 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4c6c06b0e0 0x7f4c6c146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:05.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.506+0000 7f4c73cec700 1 --2- 172.21.15.52:0/538467917 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4c6c0b84c0 0x7f4c6c143df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:05.510 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.506+0000 7f4c73cec700 1 -- 172.21.15.52:0/538467917 >> 172.21.15.52:0/538467917 conn(0x7f4c6c0b8dd0 msgr2=0x7f4c6c144f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:08:05.515 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.512+0000 7f4c73cec700 1 -- 172.21.15.52:0/538467917 shutdown_connections 2023-06-23T19:08:05.520 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:05.517+0000 7f4c73cec700 1 -- 172.21.15.52:0/538467917 wait complete. 2023-06-23T19:08:05.549 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-23T19:08:06.056 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.050+0000 7fae109f5700 1 Processor -- start 2023-06-23T19:08:06.063 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.060+0000 7fae109f5700 1 -- start start 2023-06-23T19:08:06.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.061+0000 7fae109f5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fae0c06b0e0 0x7fae0c06f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:06.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.061+0000 7fae109f5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae0c0b64e0 0x7fae0c14b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:06.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.061+0000 7fae109f5700 1 -- --> v1:172.21.15.52:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae0c0b6090 con 0x7fae0c06f9b0 2023-06-23T19:08:06.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.061+0000 7fae109f5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae0c070540 con 0x7fae0c06b0e0 2023-06-23T19:08:06.065 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.061+0000 7fae109f5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c14a570 con 0x7fae0c0b64e0 2023-06-23T19:08:06.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.062+0000 7fae0ad9d700 1 --1- >> v1:172.21.15.52:6789/0 conn(0x7fae0c06f9b0 0x7fae0c06fe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.52:6789/0 says I am v1:172.21.15.52:35168/0 (socket says 172.21.15.52:35168) 2023-06-23T19:08:06.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.062+0000 7fae0ad9d700 1 -- 172.21.15.52:0/856758932 learned_addr learned my addr 172.21.15.52:0/856758932 (peer_addr_for_me v1:172.21.15.52:0/0) 2023-06-23T19:08:06.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.062+0000 7fae0959a700 1 -- 172.21.15.52:0/856758932 <== mon.0 v1:172.21.15.52:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2068925257 0 0) 0x7fae0c0b6090 con 0x7fae0c06f9b0 2023-06-23T19:08:06.066 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.062+0000 7fae0959a700 1 -- 172.21.15.52:0/856758932 --> v1:172.21.15.52:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadf40035b0 con 0x7fae0c06f9b0 2023-06-23T19:08:06.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.063+0000 7fae0959a700 1 -- 172.21.15.52:0/856758932 <== mon.0 v1:172.21.15.52:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2422348069 0 0) 0x7fadf40035b0 con 0x7fae0c06f9b0 2023-06-23T19:08:06.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.063+0000 7fae0959a700 1 -- 172.21.15.52:0/856758932 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae0c0b64e0 msgr2=0x7fae0c14b010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-23T19:08:06.067 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.063+0000 7fae0959a700 1 --2- 172.21.15.52:0/856758932 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae0c0b64e0 0x7fae0c14b010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:06.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.063+0000 7fae0959a700 1 -- 172.21.15.52:0/856758932 >> v2:172.21.15.89:3300/0 conn(0x7fae0c06b0e0 msgr2=0x7fae0c06f200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T19:08:06.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.063+0000 7fae0959a700 1 --2- 172.21.15.52:0/856758932 >> v2:172.21.15.89:3300/0 conn(0x7fae0c06b0e0 0x7fae0c06f200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:06.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.063+0000 7fae0959a700 1 -- 172.21.15.52:0/856758932 --> v1:172.21.15.52:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c071ca0 con 0x7fae0c06f9b0 2023-06-23T19:08:06.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.063+0000 7fae0959a700 1 -- 172.21.15.52:0/856758932 <== mon.0 v1:172.21.15.52:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3476644655 0 0) 0x7fae040019f0 con 0x7fae0c06f9b0 2023-06-23T19:08:06.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.063+0000 7fae0959a700 1 -- 172.21.15.52:0/856758932 >> v1:172.21.15.52:6789/0 conn(0x7fae0c06f9b0 legacy=0x7fae0c06fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:06.068 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.063+0000 7fae0959a700 1 --2- 172.21.15.52:0/856758932 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadf4003a00 0x7fadf4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:06.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.063+0000 7fae0959a700 1 --2- 172.21.15.52:0/856758932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadf4004850 0x7fadf4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:06.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.063+0000 7fae0959a700 1 --2- 172.21.15.52:0/856758932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadf40052d0 0x7fadf4014220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:06.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.063+0000 7fae0959a700 1 -- 172.21.15.52:0/856758932 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c070540 con 0x7fadf4004850 2023-06-23T19:08:06.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.063+0000 7fae0959a700 1 -- 172.21.15.52:0/856758932 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c14a570 con 0x7fadf40052d0 2023-06-23T19:08:06.069 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.063+0000 7fae0959a700 1 -- 172.21.15.52:0/856758932 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf4014a70 con 0x7fadf4003a00 2023-06-23T19:08:06.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.068+0000 7fae09d9b700 1 --2- 172.21.15.52:0/856758932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadf4004850 0x7fadf4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:08:06.075 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.070+0000 7fae0a59c700 1 --2- 172.21.15.52:0/856758932 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadf4003a00 0x7fadf4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:08:06.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.072+0000 7fae09d9b700 1 -- 172.21.15.52:0/856758932 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadf4003a00 msgr2=0x7fadf4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:08:06.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.072+0000 7fae09d9b700 1 --2- 172.21.15.52:0/856758932 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadf4003a00 0x7fadf4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:06.076 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.072+0000 7fae09d9b700 1 -- 172.21.15.52:0/856758932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadf40052d0 msgr2=0x7fadf4014220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T19:08:06.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.072+0000 7fae09d9b700 1 --2- 172.21.15.52:0/856758932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadf40052d0 0x7fadf4014220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:06.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.072+0000 7fae09d9b700 1 -- 172.21.15.52:0/856758932 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c071ca0 con 0x7fadf4004850 2023-06-23T19:08:06.077 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.072+0000 7fae09d9b700 1 --2- 172.21.15.52:0/856758932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadf4004850 0x7fadf4004cc0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fae0c06e650 tx=0x7fadf4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad6d390905d6ca2 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:08:06.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.076+0000 7fae0959a700 1 -- 172.21.15.52:0/856758932 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae000092f0 con 0x7fadf4004850 2023-06-23T19:08:06.079 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.076+0000 7fae0959a700 1 -- 172.21.15.52:0/856758932 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae00011620 con 0x7fadf4004850 2023-06-23T19:08:06.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.076+0000 7fae0959a700 1 -- 172.21.15.52:0/856758932 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae000119d0 con 0x7fadf4004850 2023-06-23T19:08:06.080 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.077+0000 7fae109f5700 1 -- 172.21.15.52:0/856758932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadf4004850 msgr2=0x7fadf4004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:06.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.077+0000 7fae109f5700 1 --2- 172.21.15.52:0/856758932 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadf4004850 0x7fadf4004cc0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fae0c06e650 tx=0x7fadf4005880 comp rx=0 tx=0).stop 2023-06-23T19:08:06.081 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.077+0000 7fae0ad9d700 1 -- 172.21.15.52:0/856758932 reap_dead start 2023-06-23T19:08:06.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.088+0000 7fae109f5700 1 -- 172.21.15.52:0/856758932 shutdown_connections 2023-06-23T19:08:06.100 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.088+0000 7fae109f5700 1 -- 172.21.15.52:0/856758932 >> 172.21.15.52:0/856758932 conn(0x7fae0c0b8dd0 msgr2=0x7fae0c0b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:08:06.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.097+0000 7fae109f5700 1 -- 172.21.15.52:0/856758932 shutdown_connections 2023-06-23T19:08:06.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.098+0000 7fae109f5700 1 -- 172.21.15.52:0/856758932 wait complete. 2023-06-23T19:08:06.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.099+0000 7fae109f5700 1 Processor -- start 2023-06-23T19:08:06.105 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.100+0000 7fae109f5700 1 -- start start 2023-06-23T19:08:06.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.101+0000 7fae109f5700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadf4004850 0x7fae0c1dc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:06.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.101+0000 7fae109f5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae0c0acb50 0x7fae0c0ad540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:06.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.101+0000 7fae109f5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae0c0ada80 0x7fae0c1dea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:06.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.101+0000 7fae109f5700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c0aa2d0 con 0x7fadf4004850 2023-06-23T19:08:06.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.101+0000 7fae109f5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c0acfc0 con 0x7fae0c0ada80 2023-06-23T19:08:06.106 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.101+0000 7fae109f5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c0ae1e0 con 0x7fae0c0acb50 2023-06-23T19:08:06.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.102+0000 7fae0a59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadf4004850 0x7fae0c1dc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:08:06.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.102+0000 7fae0a59c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadf4004850 0x7fae0c1dc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49562/0 (socket says 172.21.15.52:49562) 2023-06-23T19:08:06.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.102+0000 7fae0a59c700 1 -- 172.21.15.52:0/867296623 learned_addr learned my addr 172.21.15.52:0/867296623 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T19:08:06.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.102+0000 7fae0a59c700 1 -- 172.21.15.52:0/867296623 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae0c0acb50 msgr2=0x7fae0c0ad540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:06.107 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.102+0000 7fae0a59c700 1 --2- 172.21.15.52:0/867296623 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae0c0acb50 0x7fae0c0ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:06.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.102+0000 7fae0a59c700 1 -- 172.21.15.52:0/867296623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae0c0ada80 msgr2=0x7fae0c1dea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:06.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.102+0000 7fae0a59c700 1 --2- 172.21.15.52:0/867296623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae0c0ada80 0x7fae0c1dea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:06.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.102+0000 7fae0a59c700 1 -- 172.21.15.52:0/867296623 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c1db560 con 0x7fadf4004850 2023-06-23T19:08:06.108 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.103+0000 7fae0a59c700 1 --2- 172.21.15.52:0/867296623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadf4004850 0x7fae0c1dc040 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00e870 tx=0x7fadfc00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:08:06.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.103+0000 7fadfaffd700 1 -- 172.21.15.52:0/867296623 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc0094c0 con 0x7fadf4004850 2023-06-23T19:08:06.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.103+0000 7fadfaffd700 1 -- 172.21.15.52:0/867296623 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc00c640 con 0x7fadf4004850 2023-06-23T19:08:06.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.103+0000 7fadfaffd700 1 -- 172.21.15.52:0/867296623 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc00c9d0 con 0x7fadf4004850 2023-06-23T19:08:06.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.103+0000 7fae109f5700 1 -- 172.21.15.52:0/867296623 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae0c1db840 con 0x7fadf4004850 2023-06-23T19:08:06.109 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.103+0000 7fae109f5700 1 -- 172.21.15.52:0/867296623 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae0c0adef0 con 0x7fadf4004850 2023-06-23T19:08:06.114 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.111+0000 7fae109f5700 1 -- 172.21.15.52:0/867296623 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf00052e0 con 0x7fadf4004850 2023-06-23T19:08:06.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.116+0000 7fadfaffd700 1 -- 172.21.15.52:0/867296623 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fadfc00cb30 con 0x7fadf4004850 2023-06-23T19:08:06.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.116+0000 7fadfaffd700 1 --2- 172.21.15.52:0/867296623 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fadf407d7d0 0x7fadf407fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:06.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.116+0000 7fadfaffd700 1 -- 172.21.15.52:0/867296623 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6177+0+0 (secure 0 0 0) 0x7fadfc089440 con 0x7fadf4004850 2023-06-23T19:08:06.122 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.119+0000 7fadfaffd700 1 -- 172.21.15.52:0/867296623 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fadfc054460 con 0x7fadf4004850 2023-06-23T19:08:06.125 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.120+0000 7fae09d9b700 1 --2- 172.21.15.52:0/867296623 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fadf407d7d0 0x7fadf407fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:08:06.146 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.143+0000 7fae09d9b700 1 --2- 172.21.15.52:0/867296623 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fadf407d7d0 0x7fadf407fc80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fae0c1d5d10 tx=0x7fae00010000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:08:06.503 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.489+0000 7fae109f5700 1 -- 172.21.15.52:0/867296623 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fadf0005b10 con 0x7fadf4004850 2023-06-23T19:08:06.513 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.509+0000 7fadfaffd700 1 -- 172.21.15.52:0/867296623 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7fadfc057a80 con 0x7fadf4004850 2023-06-23T19:08:06.523 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2023-06-23T19:08:06.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.522+0000 7fae109f5700 1 -- 172.21.15.52:0/867296623 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fadf407d7d0 msgr2=0x7fadf407fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:06.526 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.522+0000 7fae109f5700 1 --2- 172.21.15.52:0/867296623 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fadf407d7d0 0x7fadf407fc80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fae0c1d5d10 tx=0x7fae00010000 comp rx=0 tx=0).stop 2023-06-23T19:08:06.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.522+0000 7fae109f5700 1 -- 172.21.15.52:0/867296623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadf4004850 msgr2=0x7fae0c1dc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:06.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.522+0000 7fae109f5700 1 --2- 172.21.15.52:0/867296623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadf4004850 0x7fae0c1dc040 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00e870 tx=0x7fadfc00ec30 comp rx=0 tx=0).stop 2023-06-23T19:08:06.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.523+0000 7fae109f5700 1 -- 172.21.15.52:0/867296623 shutdown_connections 2023-06-23T19:08:06.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.523+0000 7fae109f5700 1 --2- 172.21.15.52:0/867296623 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7fadf407d7d0 0x7fadf407fc80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:06.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.523+0000 7fae109f5700 1 --2- 172.21.15.52:0/867296623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fae0c0ada80 0x7fae0c1dea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:06.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.523+0000 7fae109f5700 1 --2- 172.21.15.52:0/867296623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadf4004850 0x7fae0c1dc040 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:06.527 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.523+0000 7fae109f5700 1 --2- 172.21.15.52:0/867296623 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fae0c0acb50 0x7fae0c0ad540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:06.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.523+0000 7fae109f5700 1 -- 172.21.15.52:0/867296623 >> 172.21.15.52:0/867296623 conn(0x7fae0c0b8dd0 msgr2=0x7fae0c0b6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:08:06.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.523+0000 7fae109f5700 1 -- 172.21.15.52:0/867296623 shutdown_connections 2023-06-23T19:08:06.528 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.523+0000 7fae109f5700 1 -- 172.21.15.52:0/867296623 wait complete. 2023-06-23T19:08:06.547 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-23T19:08:06.897 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.893+0000 7f3110301700 1 Processor -- start 2023-06-23T19:08:06.920 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.915+0000 7f3110301700 1 -- start start 2023-06-23T19:08:06.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.916+0000 7f3110301700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3108143b90 0x7f31081464c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:06.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.916+0000 7f3110301700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3108071a80 0x7f310806f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:06.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.916+0000 7f3110301700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3108143f60 con 0x7f3108146a00 2023-06-23T19:08:06.921 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.916+0000 7f3110301700 1 -- --> v2:172.21.15.52:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3108071f60 con 0x7f3108071a80 2023-06-23T19:08:06.922 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.916+0000 7f3110301700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31080716f0 con 0x7f3108143b90 2023-06-23T19:08:06.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.918+0000 7f310d89c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3108071a80 0x7f310806f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:08:06.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.918+0000 7f310d89c700 1 --2- >> v2:172.21.15.52:3300/0 conn(0x7f3108071a80 0x7f310806f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49566/0 (socket says 172.21.15.52:49566) 2023-06-23T19:08:06.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.918+0000 7f310d89c700 1 -- 172.21.15.52:0/821260546 learned_addr learned my addr 172.21.15.52:0/821260546 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T19:08:06.927 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.918+0000 7f310d89c700 1 -- 172.21.15.52:0/821260546 >> v2:172.21.15.89:3300/0 conn(0x7f3108143b90 msgr2=0x7f31081464c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-23T19:08:06.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.918+0000 7f310d89c700 1 --2- 172.21.15.52:0/821260546 >> v2:172.21.15.89:3300/0 conn(0x7f3108143b90 0x7f31081464c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:06.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.918+0000 7f310d89c700 1 -- 172.21.15.52:0/821260546 >> v1:172.21.15.89:6789/0 conn(0x7f3108146a00 legacy=0x7f3108149a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T19:08:06.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.918+0000 7f310d89c700 1 -- 172.21.15.52:0/821260546 --> v2:172.21.15.52:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310806f4a0 con 0x7f3108071a80 2023-06-23T19:08:06.928 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.918+0000 7f310d89c700 1 --2- 172.21.15.52:0/821260546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3108071a80 0x7f310806f930 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3108073d10 tx=0x7f3104009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d463ca5a7573c23 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:08:06.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.928+0000 7f310d09b700 1 -- 172.21.15.52:0/821260546 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3104004030 con 0x7f3108071a80 2023-06-23T19:08:06.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.928+0000 7f310d09b700 1 -- 172.21.15.52:0/821260546 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3104004190 con 0x7f3108071a80 2023-06-23T19:08:06.932 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.928+0000 7f310d09b700 1 -- 172.21.15.52:0/821260546 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3104004520 con 0x7f3108071a80 2023-06-23T19:08:06.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.929+0000 7f3110301700 1 -- 172.21.15.52:0/821260546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3108071a80 msgr2=0x7f310806f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:06.933 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.929+0000 7f3110301700 1 --2- 172.21.15.52:0/821260546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3108071a80 0x7f310806f930 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3108073d10 tx=0x7f3104009520 comp rx=0 tx=0).stop 2023-06-23T19:08:06.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.932+0000 7f3110301700 1 -- 172.21.15.52:0/821260546 shutdown_connections 2023-06-23T19:08:06.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.932+0000 7f3110301700 1 --2- 172.21.15.52:0/821260546 >> v2:172.21.15.89:3300/0 conn(0x7f3108143b90 0x7f31081464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:06.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.932+0000 7f3110301700 1 --2- 172.21.15.52:0/821260546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3108071a80 0x7f310806f930 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:06.935 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.932+0000 7f3110301700 1 -- 172.21.15.52:0/821260546 >> 172.21.15.52:0/821260546 conn(0x7f31080bc170 msgr2=0x7f31080bc540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:08:06.938 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.935+0000 7f3110301700 1 -- 172.21.15.52:0/821260546 shutdown_connections 2023-06-23T19:08:06.940 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.936+0000 7f3110301700 1 -- 172.21.15.52:0/821260546 wait complete. 2023-06-23T19:08:06.941 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.937+0000 7f3110301700 1 Processor -- start 2023-06-23T19:08:06.945 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.941+0000 7f3110301700 1 -- start start 2023-06-23T19:08:06.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.942+0000 7f3110301700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3108071a80 0x7f3108136e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:06.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.942+0000 7f3110301700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3108143b90 0x7f31081def60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:06.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.942+0000 7f3110301700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3108146a00 0x7f31081445f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:06.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.942+0000 7f3110301700 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31081df4a0 con 0x7f3108143b90 2023-06-23T19:08:06.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.942+0000 7f3110301700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3108136290 con 0x7f3108146a00 2023-06-23T19:08:06.946 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.942+0000 7f3110301700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3108139250 con 0x7f3108071a80 2023-06-23T19:08:06.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.943+0000 7f310d89c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3108143b90 0x7f31081def60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:08:06.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.943+0000 7f310d89c700 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3108143b90 0x7f31081def60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:49574/0 (socket says 172.21.15.52:49574) 2023-06-23T19:08:06.947 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.943+0000 7f310d89c700 1 -- 172.21.15.52:0/1340445410 learned_addr learned my addr 172.21.15.52:0/1340445410 (peer_addr_for_me v2:172.21.15.52:0/0) 2023-06-23T19:08:06.948 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.944+0000 7f310d89c700 1 -- 172.21.15.52:0/1340445410 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3108071a80 msgr2=0x7f3108136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:06.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.944+0000 7f310d89c700 1 --2- 172.21.15.52:0/1340445410 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3108071a80 0x7f3108136e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:06.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.944+0000 7f310d89c700 1 -- 172.21.15.52:0/1340445410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3108146a00 msgr2=0x7f31081445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:06.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.944+0000 7f310d89c700 1 --2- 172.21.15.52:0/1340445410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3108146a00 0x7f31081445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:06.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.944+0000 7f310d89c700 1 -- 172.21.15.52:0/1340445410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310400a5f0 con 0x7f3108143b90 2023-06-23T19:08:06.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.944+0000 7f310d89c700 1 --2- 172.21.15.52:0/1340445410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3108143b90 0x7f31081def60 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f31080b6c80 tx=0x7f3104004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:08:06.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.944+0000 7f30feffd700 1 -- 172.21.15.52:0/1340445410 <== mon.0 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3104027070 con 0x7f3108143b90 2023-06-23T19:08:06.949 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.944+0000 7f30feffd700 1 -- 172.21.15.52:0/1340445410 <== mon.0 v2:172.21.15.52:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3104019850 con 0x7f3108143b90 2023-06-23T19:08:06.950 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.944+0000 7f30feffd700 1 -- 172.21.15.52:0/1340445410 <== mon.0 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3104019be0 con 0x7f3108143b90 2023-06-23T19:08:06.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.948+0000 7f3110301700 1 -- 172.21.15.52:0/1340445410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31081364e0 con 0x7f3108143b90 2023-06-23T19:08:06.952 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.948+0000 7f3110301700 1 -- 172.21.15.52:0/1340445410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3108138ee0 con 0x7f3108143b90 2023-06-23T19:08:06.959 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.953+0000 7f30feffd700 1 -- 172.21.15.52:0/1340445410 <== mon.0 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3104019d40 con 0x7f3108143b90 2023-06-23T19:08:06.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.953+0000 7f30feffd700 1 --2- 172.21.15.52:0/1340445410 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f30f406af10 0x7f30f406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T19:08:06.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.953+0000 7f30feffd700 1 -- 172.21.15.52:0/1340445410 <== mon.0 v2:172.21.15.52:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6177+0+0 (secure 0 0 0) 0x7f3104092b60 con 0x7f3108143b90 2023-06-23T19:08:06.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.954+0000 7f310e09d700 1 --2- 172.21.15.52:0/1340445410 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f30f406af10 0x7f30f406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T19:08:06.960 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.956+0000 7f310e09d700 1 --2- 172.21.15.52:0/1340445410 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f30f406af10 0x7f30f406d3c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f310000abb0 tx=0x7f3100009250 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T19:08:06.973 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.961+0000 7f3110301700 1 -- 172.21.15.52:0/1340445410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3108143f60 con 0x7f3108143b90 2023-06-23T19:08:06.974 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:06.971+0000 7f30feffd700 1 -- 172.21.15.52:0/1340445410 <== mon.0 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3108143f60 con 0x7f3108143b90 2023-06-23T19:08:07.416 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:07.412+0000 7f3110301700 1 -- 172.21.15.52:0/1340445410 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3108143f60 con 0x7f3108143b90 2023-06-23T19:08:07.417 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:07.413+0000 7f30feffd700 1 -- 172.21.15.52:0/1340445410 <== mon.0 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v35) v1 ==== 80+0+122 (secure 0 0 0) 0x7f3108143f60 con 0x7f3108143b90 2023-06-23T19:08:07.429 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6835/2041592035 2023-06-24T19:03:06.908932+0000 2023-06-23T19:08:07.429 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52:6833/2041592035 2023-06-24T19:03:06.908932+0000 2023-06-23T19:08:07.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:07.435+0000 7f3110301700 1 -- 172.21.15.52:0/1340445410 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f30f406af10 msgr2=0x7f30f406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:07.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:07.435+0000 7f3110301700 1 --2- 172.21.15.52:0/1340445410 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f30f406af10 0x7f30f406d3c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f310000abb0 tx=0x7f3100009250 comp rx=0 tx=0).stop 2023-06-23T19:08:07.438 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:07.435+0000 7f3110301700 1 -- 172.21.15.52:0/1340445410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3108143b90 msgr2=0x7f31081def60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T19:08:07.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:07.435+0000 7f3110301700 1 --2- 172.21.15.52:0/1340445410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3108143b90 0x7f31081def60 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f31080b6c80 tx=0x7f3104004750 comp rx=0 tx=0).stop 2023-06-23T19:08:07.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:07.435+0000 7f3110301700 1 -- 172.21.15.52:0/1340445410 shutdown_connections 2023-06-23T19:08:07.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:07.435+0000 7f3110301700 1 --2- 172.21.15.52:0/1340445410 >> [v2:172.21.15.89:6832/397406548,v1:172.21.15.89:6833/397406548] conn(0x7f30f406af10 0x7f30f406d3c0 secure :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f310000abb0 tx=0x7f3100009250 comp rx=0 tx=0).stop 2023-06-23T19:08:07.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:07.435+0000 7f3110301700 1 --2- 172.21.15.52:0/1340445410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3108146a00 0x7f31081445f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:07.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:07.435+0000 7f3110301700 1 --2- 172.21.15.52:0/1340445410 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3108071a80 0x7f3108136e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:07.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:07.435+0000 7f3110301700 1 --2- 172.21.15.52:0/1340445410 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3108143b90 0x7f31081def60 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T19:08:07.439 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:07.435+0000 7f3110301700 1 -- 172.21.15.52:0/1340445410 >> 172.21.15.52:0/1340445410 conn(0x7f31080bc170 msgr2=0x7f31080b91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T19:08:07.454 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:07.450+0000 7f3110301700 1 -- 172.21.15.52:0/1340445410 shutdown_connections 2023-06-23T19:08:07.455 INFO:teuthology.orchestra.run.smithi052.stderr:2023-06-23T19:08:07.452+0000 7f3110301700 1 -- 172.21.15.52:0/1340445410 wait complete. 2023-06-23T19:08:07.485 INFO:teuthology.orchestra.run.smithi052.stderr:listed 2 entries 2023-06-23T19:08:07.504 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-06-23T19:08:07.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:08:07.505 DEBUG:teuthology.orchestra.run.smithi158:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-06-23T19:08:07.597 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi158.front.sepia.ceph.com 2023-06-23T19:08:07.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-23T19:08:07.597 DEBUG:teuthology.orchestra.run.smithi158:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-23T19:08:09.156 INFO:tasks.ceph.osd.0:Sent signal 15 2023-06-23T19:08:09.157 INFO:tasks.ceph.osd.1:Sent signal 15 2023-06-23T19:08:09.157 INFO:tasks.ceph.osd.2:Sent signal 15 2023-06-23T19:08:09.157 INFO:tasks.ceph.osd.3:Sent signal 15 2023-06-23T19:08:09.158 INFO:tasks.ceph.osd.4:Sent signal 15 2023-06-23T19:08:09.158 INFO:tasks.ceph.osd.5:Sent signal 15 2023-06-23T19:08:09.158 INFO:tasks.ceph.osd.6:Sent signal 15 2023-06-23T19:08:09.159 INFO:tasks.ceph.osd.7:Sent signal 15 2023-06-23T19:08:09.159 INFO:tasks.ceph.mds.a:Sent signal 15 2023-06-23T19:08:09.159 INFO:tasks.ceph.mds.b:Sent signal 15 2023-06-23T19:08:09.160 INFO:tasks.ceph.mon.a:Sent signal 15 2023-06-23T19:08:09.160 INFO:tasks.ceph.mon.b:Sent signal 15 2023-06-23T19:08:09.161 INFO:tasks.ceph.mon.c:Sent signal 15 2023-06-23T19:08:09.161 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-06-23T19:08:09.162 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-06-23T19:08:09.163 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-23T19:08:09.159+0000 7f23d79b0700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 115381) UID: 0 2023-06-23T19:08:09.163 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-23T19:08:09.159+0000 7f23d79b0700 -1 osd.5 35 *** Got signal Terminated *** 2023-06-23T19:08:09.164 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-23T19:08:09.159+0000 7f23d79b0700 -1 osd.5 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-23T19:08:09.164 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-06-23T19:08:09.158+0000 7fc235b82700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 115209) UID: 0 2023-06-23T19:08:09.164 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-06-23T19:08:09.158+0000 7fc235b82700 -1 osd.0 35 *** Got signal Terminated *** 2023-06-23T19:08:09.164 INFO:tasks.ceph.osd.0.smithi052.stderr:2023-06-23T19:08:09.158+0000 7fc235b82700 -1 osd.0 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-23T19:08:09.166 INFO:tasks.ceph.mon.b.smithi089.stderr:2023-06-23T19:08:09.159+0000 7fe9cd1f9700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 114680) UID: 0 2023-06-23T19:08:09.166 INFO:tasks.ceph.mon.b.smithi089.stderr:2023-06-23T19:08:09.159+0000 7fe9cd1f9700 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-06-23T19:08:09.167 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-06-23T19:08:09.158+0000 7fca2eb0c700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 115210) UID: 0 2023-06-23T19:08:09.167 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-06-23T19:08:09.158+0000 7fca2eb0c700 -1 osd.1 35 *** Got signal Terminated *** 2023-06-23T19:08:09.167 INFO:tasks.ceph.osd.1.smithi052.stderr:2023-06-23T19:08:09.158+0000 7fca2eb0c700 -1 osd.1 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-23T19:08:09.168 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-23T19:08:09.159+0000 7f6fc6990700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 115387) UID: 0 2023-06-23T19:08:09.168 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-23T19:08:09.159+0000 7f6fc6990700 -1 osd.6 35 *** Got signal Terminated *** 2023-06-23T19:08:09.168 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-23T19:08:09.159+0000 7f6fc6990700 -1 osd.6 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-23T19:08:09.168 INFO:tasks.ceph.mds.a.smithi052.stderr:2023-06-23T19:08:09.158+0000 7fd97e5e5700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 126283) UID: 0 2023-06-23T19:08:09.169 INFO:tasks.ceph.mds.a.smithi052.stderr:2023-06-23T19:08:09.158+0000 7fd97e5e5700 -1 mds.a *** got signal Terminated *** 2023-06-23T19:08:09.169 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-06-23T19:08:09.158+0000 7f0f242b1700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 115227) UID: 0 2023-06-23T19:08:09.170 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-06-23T19:08:09.158+0000 7f0f242b1700 -1 osd.3 35 *** Got signal Terminated *** 2023-06-23T19:08:09.170 INFO:tasks.ceph.osd.3.smithi052.stderr:2023-06-23T19:08:09.158+0000 7f0f242b1700 -1 osd.3 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-23T19:08:09.170 INFO:tasks.ceph.mon.a.smithi052.stderr:2023-06-23T19:08:09.165+0000 7f037a1eb700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 114844) UID: 0 2023-06-23T19:08:09.171 INFO:tasks.ceph.mon.a.smithi052.stderr:2023-06-23T19:08:09.165+0000 7f037a1eb700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-06-23T19:08:09.171 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-06-23T19:08:09.165+0000 7f91b1438700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 115215) UID: 0 2023-06-23T19:08:09.171 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-06-23T19:08:09.165+0000 7f91b1438700 -1 osd.2 35 *** Got signal Terminated *** 2023-06-23T19:08:09.172 INFO:tasks.ceph.osd.2.smithi052.stderr:2023-06-23T19:08:09.165+0000 7f91b1438700 -1 osd.2 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-23T19:08:09.172 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-23T19:08:09.160+0000 7f49db57c700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 115382) UID: 0 2023-06-23T19:08:09.173 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-23T19:08:09.160+0000 7f49db57c700 -1 osd.4 35 *** Got signal Terminated *** 2023-06-23T19:08:09.173 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-23T19:08:09.160+0000 7f49db57c700 -1 osd.4 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-23T19:08:09.173 INFO:tasks.ceph.mon.c.smithi089.stderr:2023-06-23T19:08:09.161+0000 7fce1d535700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 114682) UID: 0 2023-06-23T19:08:09.174 INFO:tasks.ceph.mon.c.smithi089.stderr:2023-06-23T19:08:09.161+0000 7fce1d535700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-06-23T19:08:09.174 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-23T19:08:09.164+0000 7fd0844dd700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 115388) UID: 0 2023-06-23T19:08:09.174 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-23T19:08:09.164+0000 7fd0844dd700 -1 osd.7 35 *** Got signal Terminated *** 2023-06-23T19:08:09.175 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-23T19:08:09.164+0000 7fd0844dd700 -1 osd.7 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-23T19:08:09.183 INFO:tasks.ceph.mds.b.smithi089.stderr:2023-06-23T19:08:09.179+0000 7fd06363f700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 121663) UID: 0 2023-06-23T19:08:09.183 INFO:tasks.ceph.mds.b.smithi089.stderr:2023-06-23T19:08:09.179+0000 7fd06363f700 -1 mds.b *** got signal Terminated *** 2023-06-23T19:08:09.379 INFO:tasks.ceph.mgr.y.smithi052.stderr:daemon-helper: command crashed with signal 15 2023-06-23T19:08:19.296 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:08:19.300 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:08:19.309 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:08:49.411 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:08:49.413 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:08:49.416 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:09:19.607 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:09:19.610 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:09:19.613 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:09:49.786 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:09:49.789 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:09:49.791 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:10:19.992 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:10:19.995 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:10:19.997 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:10:50.188 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:10:50.191 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:10:50.193 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:11:20.384 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:11:20.387 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:11:20.389 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:11:50.572 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:11:50.575 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:11:50.578 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:12:20.752 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:12:20.755 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:12:20.757 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:12:50.965 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:12:50.967 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:12:50.970 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:13:21.262 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:13:21.265 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:13:21.268 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:13:51.600 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:13:51.603 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:13:51.606 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:14:21.855 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:14:21.858 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:14:21.860 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:14:52.094 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:14:52.097 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:14:52.099 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:15:22.223 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:15:22.226 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:15:22.229 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:15:52.378 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:15:52.381 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:15:52.384 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:16:22.515 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:16:22.518 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:16:22.520 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:16:52.669 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:16:52.672 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:16:52.675 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:17:22.793 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:17:22.796 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:17:22.798 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:17:52.952 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:17:52.956 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:17:52.959 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:18:23.094 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:18:23.097 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:18:23.099 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:18:53.211 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:18:53.214 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:18:53.217 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:19:23.368 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:19:23.371 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:19:23.373 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:19:53.503 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:19:53.506 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:19:53.508 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:20:23.649 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:20:23.652 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:20:23.654 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:20:53.779 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:20:53.782 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:20:53.784 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:21:23.899 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:21:23.902 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:21:23.905 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:21:54.078 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:21:54.081 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:21:54.084 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:22:24.232 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:22:24.235 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:22:24.238 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:22:54.506 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:22:54.510 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:22:54.513 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:23:24.710 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:23:24.713 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:23:24.715 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:23:54.882 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:23:54.884 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:23:54.887 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:24:25.025 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:24:25.029 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:24:25.031 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:24:55.163 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:24:55.165 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:24:55.168 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:25:25.292 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:25:25.295 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:25:25.297 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:25:55.418 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:25:55.421 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:25:55.423 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:26:25.598 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:26:25.601 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:26:25.603 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:26:55.730 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:26:55.733 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:26:55.735 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:27:25.892 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:27:25.895 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:27:25.897 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:27:56.022 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:27:56.025 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:27:56.027 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:28:26.201 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:28:26.206 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:28:26.208 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:28:56.406 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:28:56.410 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:28:56.413 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:29:26.594 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:29:26.598 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:29:26.601 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:29:56.741 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:29:56.743 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:29:56.746 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:30:26.912 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:30:26.915 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:30:26.917 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:30:57.049 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:30:57.051 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:30:57.054 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:31:27.239 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:31:27.242 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:31:27.245 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:31:57.405 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:31:57.408 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:31:57.410 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:32:27.585 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:32:27.588 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:32:27.590 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:32:57.839 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:32:57.842 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:32:57.844 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:33:28.136 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:33:28.139 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:33:28.141 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:33:58.299 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:33:58.303 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:33:58.306 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:34:28.428 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:34:28.430 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:34:28.433 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:34:58.574 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:34:58.577 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:34:58.579 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:35:28.736 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:35:28.740 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:35:28.744 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:35:58.918 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:35:58.921 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:35:58.923 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:36:29.031 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:36:29.034 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:36:29.037 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:36:59.158 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:36:59.161 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:36:59.163 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:37:29.312 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:37:29.315 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:37:29.317 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:37:59.492 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:37:59.495 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:37:59.497 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:38:29.621 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:38:29.636 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:38:29.638 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:38:59.759 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:38:59.762 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:38:59.764 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:39:29.897 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:39:29.901 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:39:29.904 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:40:00.091 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:40:00.094 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:40:00.097 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:40:30.288 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:40:30.290 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:40:30.293 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:41:00.458 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:41:00.461 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:41:00.463 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:41:30.572 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:41:30.575 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:41:30.577 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:42:00.860 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:42:00.863 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:42:00.865 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:42:31.005 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:42:31.008 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:42:31.010 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:43:01.428 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:43:01.431 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:43:01.434 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:43:31.564 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:43:31.567 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:43:31.569 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:44:01.913 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:44:01.916 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:44:01.918 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:44:32.201 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:44:32.203 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:44:32.206 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:45:02.581 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:45:02.584 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:45:02.587 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:45:32.786 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:45:32.790 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:45:32.793 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:46:03.041 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:46:03.044 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:46:03.046 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:46:33.438 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:46:33.442 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:46:33.445 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:47:03.718 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:47:03.721 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:47:03.724 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:47:33.848 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:47:33.850 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:47:33.853 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:48:03.994 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:48:03.997 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:48:04.000 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:48:34.166 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:48:34.170 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:48:34.173 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:49:04.303 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:49:04.306 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:49:04.309 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:49:34.449 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:49:34.452 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:49:34.455 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:50:04.563 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:50:04.567 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:50:04.570 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:50:34.717 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:50:34.720 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:50:34.723 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:51:04.862 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:51:04.865 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:51:04.867 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:51:35.017 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:51:35.020 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:51:35.023 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:52:05.167 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:52:05.177 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:52:05.188 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:52:35.363 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:52:35.369 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:52:35.375 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:53:05.489 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:53:05.493 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:53:05.496 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:53:35.642 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:53:35.647 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:53:35.650 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:54:05.779 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:54:05.782 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:54:05.785 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:54:35.928 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:54:35.934 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:54:35.936 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:55:06.063 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:55:06.067 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:55:06.069 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:55:36.242 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:55:36.245 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:55:36.247 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:56:06.372 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:56:06.375 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:56:06.378 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:56:36.568 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:56:36.571 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:56:36.574 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:57:06.773 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:57:06.776 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:57:06.778 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:57:36.918 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:57:36.920 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:57:36.923 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:58:07.064 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:58:07.067 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:58:07.070 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:58:37.246 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:58:37.248 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:58:37.250 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:59:07.417 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:59:07.420 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:59:07.422 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:59:37.544 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:59:37.547 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T19:59:37.549 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:00:07.682 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:00:07.685 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:00:07.688 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:00:37.820 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:00:37.824 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:00:37.826 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:01:07.957 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:01:07.961 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:01:07.963 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:01:38.076 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:01:38.079 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:01:38.081 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:02:08.256 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:02:08.259 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:02:08.261 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:02:38.390 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:02:38.396 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:02:38.406 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:03:08.525 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:03:08.530 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:03:08.533 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:03:38.679 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:03:38.682 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:03:38.686 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:04:08.800 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:04:08.803 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:04:08.805 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:04:38.929 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:04:38.932 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:04:38.935 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:05:09.093 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:05:09.097 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:05:09.100 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:05:39.273 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:05:39.276 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:05:39.278 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:06:09.570 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:06:09.573 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:06:09.575 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:06:39.791 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:06:39.794 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:06:39.797 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:07:09.917 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:07:09.920 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:07:09.923 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:07:40.038 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:07:40.041 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:07:40.044 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:08:10.193 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:08:10.196 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:08:10.198 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:08:40.335 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:08:40.338 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:08:40.340 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:09:10.474 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:09:10.477 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:09:10.479 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:09:40.606 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:09:40.608 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:09:40.611 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:10:10.735 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:10:10.737 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:10:10.740 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:10:40.865 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:10:40.868 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:10:40.871 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:11:11.002 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:11:11.005 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:11:11.007 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:11:41.157 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:11:41.160 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:11:41.162 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:12:11.295 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:12:11.298 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:12:11.300 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:12:41.440 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:12:41.443 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:12:41.445 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:13:11.755 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:13:11.758 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:13:11.760 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:13:41.891 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:13:41.894 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:13:41.896 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:14:12.081 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:14:12.084 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:14:12.086 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:14:42.208 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:14:42.211 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:14:42.213 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:15:12.371 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:15:12.374 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:15:12.376 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:15:42.554 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:15:42.557 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:15:42.559 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:16:12.769 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:16:12.772 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:16:12.774 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:16:42.908 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:16:42.911 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:16:42.914 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:17:13.101 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:17:13.106 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:17:13.109 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:17:43.234 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:17:43.237 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:17:43.239 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:18:13.364 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:18:13.367 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:18:13.369 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:18:43.492 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:18:43.496 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:18:43.498 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:19:13.663 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:19:13.673 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:19:13.676 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:19:43.843 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:19:43.847 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:19:43.849 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:20:14.040 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:20:14.044 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:20:14.046 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:20:44.217 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:20:44.219 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:20:44.222 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:21:14.391 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:21:14.394 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:21:14.396 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:21:44.521 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:21:44.524 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:21:44.526 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:22:14.673 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:22:14.676 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:22:14.679 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:22:44.828 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:22:44.831 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:22:44.833 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:23:14.957 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:23:14.960 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:23:14.962 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:23:45.132 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:23:45.135 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:23:45.138 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:24:15.303 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:24:15.306 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:24:15.308 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:24:45.508 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:24:45.511 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:24:45.514 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:25:15.696 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:25:15.698 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:25:15.701 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:25:45.884 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:25:45.887 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:25:45.890 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:26:16.081 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:26:16.084 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:26:16.087 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:26:46.251 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:26:46.254 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:26:46.257 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:27:16.465 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:27:16.468 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:27:16.470 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:27:46.620 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:27:46.623 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:27:46.626 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:28:16.758 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:28:16.760 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:28:16.763 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:28:47.072 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:28:47.075 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:28:47.077 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:29:17.343 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:29:17.346 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:29:17.348 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:29:47.572 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:29:47.575 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:29:47.577 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:30:17.742 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:30:17.745 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:30:17.747 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:30:48.024 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:30:48.028 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:30:48.030 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:31:18.305 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:31:18.308 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:31:18.311 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:31:48.419 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:31:48.423 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:31:48.430 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:32:18.568 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:32:18.572 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:32:18.574 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:32:48.723 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:32:48.726 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:32:48.729 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:33:18.899 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:33:18.903 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:33:18.905 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:33:49.079 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:33:49.082 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:33:49.084 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:34:19.367 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:34:19.370 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:34:19.372 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:34:49.514 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:34:49.517 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:34:49.520 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:35:19.711 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:35:19.714 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:35:19.716 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:35:49.856 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:35:49.858 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:35:49.860 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:36:19.986 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:36:19.989 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:36:19.992 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:36:50.117 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:36:50.120 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:36:50.123 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:37:20.236 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:37:20.239 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:37:20.242 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:37:50.374 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:37:50.377 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:37:50.379 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:38:20.519 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:38:20.522 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:38:20.524 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:38:50.674 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:38:50.677 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:38:50.680 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:39:20.804 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:39:20.808 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:39:20.810 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:39:50.949 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:39:50.952 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:39:50.954 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:40:21.104 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:40:21.106 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:40:21.108 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:40:51.241 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:40:51.244 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:40:51.246 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:41:21.405 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:41:21.408 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:41:21.410 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:41:51.541 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:41:51.545 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:41:51.548 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:42:21.663 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:42:21.665 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:42:21.668 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:42:51.783 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:42:51.787 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:42:51.791 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:43:21.930 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:43:21.933 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:43:21.935 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:43:52.159 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:43:52.162 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:43:52.164 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:44:22.280 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:44:22.283 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:44:22.285 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:44:52.418 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:44:52.421 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:44:52.423 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:45:22.547 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:45:22.550 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:45:22.552 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:45:52.693 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:45:52.696 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:45:52.699 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:46:22.893 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:46:22.896 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:46:22.903 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:46:53.027 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:46:53.031 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:46:53.034 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:47:23.147 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:47:23.150 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:47:23.152 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:47:53.366 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:47:53.369 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:47:53.371 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:48:23.544 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:48:23.547 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:48:23.549 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:48:53.733 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:48:53.736 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:48:53.739 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:49:23.856 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:49:23.859 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:49:23.864 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:49:54.043 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:49:54.046 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:49:54.048 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:50:24.213 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:50:24.216 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:50:24.218 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:50:54.404 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:50:54.407 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:50:54.409 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:51:24.598 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:51:24.601 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:51:24.603 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:51:54.778 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:51:54.781 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:51:54.785 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:52:24.957 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:52:24.960 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:52:24.963 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:52:55.146 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:52:55.149 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:52:55.152 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:53:25.292 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:53:25.295 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:53:25.298 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:53:55.480 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:53:55.483 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:53:55.485 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:54:25.653 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:54:25.657 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:54:25.660 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:54:55.850 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:54:55.853 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:54:55.855 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:55:25.999 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:55:26.002 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:55:26.005 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:55:56.147 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:55:56.150 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:55:56.152 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:56:26.323 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:56:26.326 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:56:26.328 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:56:56.494 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:56:56.497 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:56:56.499 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:57:26.624 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:57:26.627 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:57:26.629 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:57:56.794 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:57:56.797 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:57:56.799 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:58:26.991 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:58:26.994 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:58:26.996 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:58:57.129 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:58:57.132 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:58:57.134 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:59:27.251 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:59:27.254 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:59:27.256 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:59:57.379 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:59:57.383 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T20:59:57.387 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:00:27.503 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:00:27.506 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:00:27.509 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:00:57.691 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:00:57.697 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:00:57.701 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:01:27.828 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:01:27.831 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:01:27.833 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:01:57.967 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:01:57.970 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:01:57.972 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:02:28.113 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:02:28.116 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:02:28.119 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:02:58.249 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:02:58.252 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:02:58.254 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:03:28.403 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:03:28.406 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:03:28.409 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:03:58.558 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:03:58.561 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:03:58.563 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:04:28.703 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:04:28.706 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:04:28.708 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:04:58.848 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:04:58.852 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:04:58.855 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:05:28.958 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:05:28.961 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:05:28.964 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:05:59.099 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:05:59.101 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:05:59.104 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:06:29.225 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:06:29.228 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:06:29.230 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:06:59.341 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:06:59.343 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:06:59.346 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:07:29.470 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:07:29.473 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:07:29.475 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:07:59.603 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:07:59.605 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:07:59.607 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:08:29.787 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:08:29.790 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:08:29.792 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:08:59.908 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:08:59.911 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:08:59.914 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:09:30.037 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:09:30.040 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:09:30.042 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:10:00.243 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:10:00.246 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:10:00.249 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:10:30.404 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:10:30.407 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:10:30.409 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:11:00.589 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:11:00.592 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:11:00.595 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:11:30.758 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:11:30.761 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:11:30.763 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:12:00.892 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:12:00.895 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:12:00.897 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:12:31.075 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:12:31.078 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:12:31.081 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:13:01.217 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:13:01.221 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:13:01.224 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:13:31.346 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:13:31.349 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:13:31.352 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:14:01.492 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:14:01.495 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:14:01.497 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:14:31.630 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:14:31.633 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:14:31.635 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:15:01.825 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:15:01.828 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:15:01.831 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:15:32.021 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:15:32.024 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:15:32.027 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:16:02.151 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:16:02.154 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:16:02.156 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:16:32.305 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:16:32.308 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:16:32.311 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:17:02.418 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:17:02.421 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:17:02.424 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:17:32.790 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:17:32.793 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:17:32.795 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:18:02.918 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:18:02.921 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:18:02.924 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:18:33.346 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:18:33.349 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:18:33.351 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:19:03.596 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:19:03.600 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:19:03.602 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:19:33.714 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:19:33.717 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:19:33.719 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:20:03.860 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:20:03.863 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:20:03.866 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:20:33.995 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:20:33.999 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:20:34.002 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:21:04.136 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:21:04.139 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:21:04.142 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:21:34.281 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:21:34.285 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:21:34.288 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:22:04.427 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:22:04.431 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:22:04.434 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:22:34.599 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:22:34.603 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:22:34.605 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:23:04.785 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:23:04.788 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:23:04.791 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:23:34.932 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:23:34.936 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:23:34.938 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:24:05.052 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:24:05.055 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:24:05.058 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:24:35.182 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:24:35.186 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:24:35.189 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:25:05.353 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:25:05.356 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:25:05.358 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:25:35.490 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:25:35.493 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:25:35.495 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:26:05.611 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:26:05.614 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:26:05.616 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:26:35.766 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:26:35.768 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:26:35.771 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:27:05.881 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:27:05.884 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:27:05.886 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:27:36.032 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:27:36.035 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:27:36.037 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:28:06.153 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:28:06.155 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:28:06.158 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:28:36.312 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:28:36.315 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:28:36.318 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:29:06.467 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:29:06.472 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:29:06.476 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:29:36.663 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:29:36.667 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:29:36.669 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:30:06.837 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:30:06.840 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:30:06.842 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:30:36.983 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:30:36.986 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:30:36.989 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:31:07.139 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:31:07.143 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:31:07.146 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:31:37.283 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:31:37.285 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:31:37.287 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:32:07.421 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:32:07.423 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:32:07.426 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:32:37.550 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:32:37.552 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:32:37.555 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:33:07.864 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:33:07.866 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:33:07.868 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:33:37.991 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:33:37.994 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:33:37.997 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:34:08.138 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:34:08.141 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:34:08.143 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:34:38.328 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:34:38.331 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:34:38.333 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:35:08.463 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:35:08.466 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:35:08.468 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:35:38.654 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:35:38.657 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:35:38.659 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:36:08.796 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:36:08.798 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:36:08.801 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:36:38.921 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:36:38.924 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:36:38.927 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:37:09.085 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:37:09.089 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:37:09.091 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:37:39.282 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:37:39.285 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:37:39.287 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:38:09.469 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:38:09.472 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:38:09.474 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:38:39.641 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:38:39.644 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:38:39.646 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:39:09.778 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:39:09.781 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:39:09.784 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:39:39.967 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:39:39.971 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:39:39.973 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:40:10.088 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:40:10.091 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:40:10.094 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:40:40.219 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:40:40.222 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:40:40.224 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:41:10.363 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:41:10.366 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:41:10.369 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:41:40.493 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:41:40.497 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:41:40.499 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:42:10.624 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:42:10.627 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:42:10.630 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:42:40.822 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:42:40.825 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:42:40.827 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:43:11.010 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:43:11.013 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:43:11.016 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:43:41.205 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:43:41.210 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:43:41.213 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:44:11.364 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:44:11.367 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:44:11.370 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:44:41.527 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:44:41.530 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:44:41.532 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:45:11.719 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:45:11.722 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:45:11.724 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:45:41.916 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:45:41.918 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:45:41.921 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:46:12.104 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:46:12.107 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:46:12.109 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:46:42.250 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:46:42.254 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:46:42.257 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:47:12.456 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:47:12.458 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:47:12.461 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:47:42.595 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:47:42.598 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:47:42.600 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:48:12.740 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:48:12.743 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:48:12.746 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:48:43.021 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:48:43.023 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:48:43.026 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:49:13.292 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:49:13.295 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:49:13.298 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:49:43.522 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:49:43.525 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:49:43.528 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:49:48.347 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2023-06-23T21:50:13.751 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:50:13.754 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:50:13.756 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:50:43.895 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:50:43.898 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:50:43.900 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:51:14.041 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:51:14.044 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:51:14.046 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:51:44.195 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:51:44.197 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:51:44.200 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:52:14.316 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:52:14.319 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:52:14.321 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:52:44.461 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:52:44.464 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:52:44.467 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:53:14.583 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:53:14.585 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:53:14.588 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:53:44.778 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:53:44.781 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:53:44.785 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:54:14.948 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:54:14.951 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:54:14.954 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:54:45.087 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:54:45.090 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:54:45.093 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:55:15.235 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:55:15.238 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:55:15.240 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:55:45.421 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:55:45.424 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:55:45.426 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:56:15.567 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:56:15.572 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:56:15.575 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:56:45.748 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:56:45.751 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:56:45.754 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:57:15.911 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:57:15.914 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:57:15.917 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:57:46.054 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:57:46.056 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:57:46.059 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:58:16.183 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:58:16.186 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:58:16.188 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:58:46.304 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:58:46.306 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:58:46.308 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:59:16.416 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:59:16.419 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:59:16.421 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:59:46.602 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:59:46.605 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T21:59:46.607 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:00:16.742 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:00:16.746 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:00:16.748 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:00:46.953 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:00:46.956 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:00:46.959 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:01:17.109 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:01:17.112 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:01:17.114 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:01:47.263 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:01:47.267 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:01:47.269 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:02:17.443 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:02:17.446 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:02:17.449 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:02:47.614 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:02:47.617 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:02:47.619 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:03:17.927 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:03:17.930 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:03:17.933 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:03:48.242 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:03:48.245 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:03:48.247 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:04:18.376 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:04:18.378 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:04:18.381 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:04:48.531 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:04:48.534 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:04:48.536 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:05:18.659 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:05:18.662 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:05:18.664 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:05:48.814 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:05:48.817 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:05:48.819 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:06:18.952 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:06:18.955 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:06:18.957 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:06:49.097 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:06:49.100 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:06:49.103 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:07:19.260 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:07:19.264 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:07:19.266 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:07:44.656 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2023-06-23T22:07:49.422 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:07:49.425 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:07:49.428 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:08:19.535 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:08:19.538 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:08:19.541 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:08:49.665 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:08:49.668 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:08:49.671 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:09:19.819 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:09:19.822 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:09:19.824 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:09:49.965 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:09:49.967 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:09:49.969 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:10:20.238 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:10:20.241 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:10:20.244 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:10:50.459 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:10:50.462 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:10:50.464 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:11:20.681 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:11:20.684 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:11:20.686 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:11:50.816 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:11:50.821 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:11:50.824 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:12:20.999 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:12:21.001 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:12:21.004 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:12:51.187 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:12:51.191 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:12:51.193 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:13:21.337 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:13:21.340 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:13:21.344 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:13:51.482 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:13:51.486 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:13:51.488 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:14:21.669 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:14:21.672 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:14:21.675 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:14:51.824 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:14:51.827 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:14:51.829 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:15:21.995 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:15:21.998 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:15:22.001 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:15:52.175 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:15:52.179 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:15:52.182 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:16:22.389 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:16:22.392 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:16:22.395 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:16:52.560 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:16:52.563 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:16:52.566 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:17:22.696 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:17:22.699 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:17:22.701 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:17:52.994 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:17:52.996 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:17:52.999 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:18:23.146 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:18:23.149 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:18:23.151 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:18:53.275 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:18:53.279 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:18:53.282 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:19:23.467 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:19:23.471 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:19:23.474 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:19:53.633 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:19:53.637 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:19:53.640 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:20:23.827 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:20:23.830 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:20:23.833 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:20:54.006 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:20:54.008 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:20:54.010 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:21:24.194 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:21:24.197 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:21:24.199 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:21:54.367 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:21:54.370 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:21:54.372 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:22:24.505 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:22:24.508 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:22:24.510 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:22:54.627 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:22:54.631 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:22:54.634 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:23:24.755 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:23:24.757 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:23:24.760 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:23:54.886 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:23:54.888 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:23:54.891 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:24:25.067 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:24:25.070 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:24:25.072 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:24:55.247 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:24:55.250 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:24:55.252 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:25:25.507 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:25:25.510 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:25:25.512 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:25:55.864 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:25:55.867 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:25:55.869 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:26:26.144 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:26:26.147 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:26:26.149 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:26:56.440 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:26:56.444 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:26:56.447 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:27:26.770 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:27:26.772 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:27:26.775 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:27:56.958 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:27:56.961 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:27:56.963 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:28:27.179 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:28:27.182 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:28:27.185 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:28:57.425 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:28:57.428 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:28:57.431 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:29:27.605 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:29:27.608 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:29:27.611 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:29:57.743 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:29:57.746 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:29:57.749 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:30:27.907 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:30:27.910 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:30:27.913 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:30:58.029 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:30:58.032 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:30:58.035 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:31:28.150 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:31:28.154 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:31:28.157 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:31:58.269 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:31:58.272 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:31:58.274 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:32:28.444 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:32:28.447 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:32:28.449 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:32:58.594 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:32:58.597 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:32:58.600 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:33:28.740 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:33:28.743 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:33:28.746 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:33:58.877 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:33:58.880 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:33:58.882 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:34:29.007 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:34:29.011 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:34:29.013 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:34:59.193 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:34:59.196 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:34:59.198 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:35:29.323 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:35:29.326 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:35:29.329 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:35:59.469 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:35:59.472 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:35:59.474 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:36:29.574 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:36:29.577 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:36:29.579 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:36:59.694 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:36:59.697 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:36:59.700 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:37:29.832 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:37:29.835 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:37:29.837 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:37:59.980 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:37:59.983 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:37:59.985 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:38:30.126 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:38:30.129 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:38:30.131 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:39:00.323 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:39:00.326 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:39:00.328 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:39:30.520 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:39:30.524 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:39:30.526 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:40:00.675 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:40:00.679 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:40:00.681 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:40:30.825 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:40:30.828 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:40:30.831 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:41:00.961 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:41:00.964 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:41:00.966 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:41:31.140 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:41:31.142 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:41:31.145 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:42:01.262 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:42:01.265 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:42:01.267 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:42:31.375 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:42:31.378 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:42:31.381 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:43:01.529 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:43:01.532 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:43:01.534 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:43:31.753 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:43:31.757 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:43:31.759 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:44:01.904 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:44:01.907 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:44:01.909 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:44:32.050 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:44:32.053 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:44:32.056 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:45:02.188 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:45:02.191 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:45:02.193 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:45:32.354 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:45:32.357 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:45:32.360 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:46:02.520 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:46:02.523 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:46:02.525 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:46:32.714 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:46:32.717 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:46:32.719 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:47:02.872 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:47:02.875 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:47:02.877 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:47:33.182 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:47:33.185 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:47:33.187 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:48:03.330 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:48:03.333 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:48:03.335 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:48:33.600 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:48:33.604 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:48:33.606 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:49:03.746 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:49:03.749 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:49:03.751 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:49:34.152 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:49:34.155 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:49:34.157 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:50:04.507 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:50:04.510 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:50:04.513 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:50:34.627 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:50:34.630 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:50:34.633 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:51:04.756 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:51:04.759 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:51:04.762 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:51:34.911 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:51:34.913 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:51:34.916 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:52:05.025 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:52:05.028 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:52:05.031 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:52:35.161 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:52:35.164 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:52:35.166 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:53:05.290 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:53:05.293 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:53:05.296 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:53:35.443 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:53:35.451 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:53:35.453 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:54:05.598 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:54:05.602 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:54:05.604 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:54:35.728 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:54:35.732 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:54:35.736 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:55:05.848 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:55:05.851 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:55:05.853 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:55:36.013 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:55:36.016 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:55:36.019 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:56:06.181 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:56:06.183 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:56:06.186 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:56:36.385 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:56:36.388 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:56:36.390 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:57:06.542 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:57:06.544 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:57:06.547 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:57:36.678 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:57:36.681 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:57:36.683 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:58:06.884 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:58:06.887 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:58:06.889 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:58:37.056 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:58:37.059 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:58:37.061 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:59:07.227 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:59:07.229 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:59:07.232 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:59:37.407 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:59:37.410 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T22:59:37.412 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:00:07.553 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:00:07.556 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:00:07.559 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:00:37.690 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:00:37.693 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:00:37.696 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:01:07.871 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:01:07.875 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:01:07.877 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:01:37.984 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:01:37.987 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:01:37.990 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:02:08.158 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:02:08.160 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:02:08.162 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:02:38.279 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:02:38.282 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:02:38.285 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:03:08.408 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:03:08.411 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:03:08.413 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:03:38.586 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:03:38.589 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:03:38.592 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:04:08.773 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:04:08.776 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:04:08.779 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:04:38.962 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:04:38.965 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:04:38.967 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:05:09.108 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:05:09.111 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:05:09.114 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:05:39.255 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:05:39.258 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:05:39.260 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:06:09.400 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:06:09.403 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:06:09.405 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:06:39.514 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:06:39.517 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:06:39.519 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:07:09.675 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:07:09.678 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:07:09.680 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:07:39.864 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:07:39.867 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:07:39.870 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:08:10.061 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:08:10.064 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:08:10.066 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:08:40.178 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:08:40.182 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:08:40.184 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:09:10.388 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:09:10.391 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:09:10.393 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:09:40.563 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:09:40.566 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:09:40.568 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:10:10.756 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:10:10.759 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:10:10.765 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:10:40.872 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:10:40.875 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:10:40.877 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:11:11.009 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:11:11.012 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:11:11.015 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:11:41.203 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:11:41.206 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:11:41.209 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:12:11.350 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:12:11.354 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:12:11.356 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:12:41.496 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:12:41.499 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:12:41.501 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:13:11.759 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:13:11.762 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:13:11.765 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:13:41.913 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:13:41.916 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:13:41.918 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:14:12.042 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:14:12.045 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:14:12.048 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:14:42.181 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:14:42.185 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:14:42.187 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:15:12.310 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:15:12.312 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:15:12.315 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:15:42.439 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:15:42.441 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:15:42.444 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:16:12.635 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:16:12.637 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:16:12.639 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:16:42.780 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:16:42.784 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:16:42.787 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:17:12.919 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:17:12.922 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:17:12.924 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:17:43.065 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:17:43.068 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:17:43.070 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:18:13.398 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:18:13.401 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:18:13.404 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:18:43.556 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:18:43.559 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:18:43.561 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:19:13.824 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:19:13.827 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:19:13.830 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:19:43.981 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:19:43.984 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:19:43.987 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:20:14.111 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:20:14.114 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:20:14.117 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:20:44.240 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:20:44.243 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:20:44.245 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:21:14.377 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:21:14.380 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:21:14.382 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:21:44.632 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:21:44.635 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:21:44.637 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:22:14.828 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:22:14.831 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:22:14.834 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:22:44.948 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:22:44.951 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:22:44.954 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:23:15.146 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:23:15.149 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:23:15.153 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:23:45.275 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:23:45.278 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:23:45.281 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:24:15.412 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:24:15.416 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:24:15.418 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:24:45.549 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:24:45.552 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:24:45.554 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:25:15.740 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:25:15.743 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:25:15.745 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:25:45.904 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:25:45.907 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:25:45.909 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:26:16.075 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:26:16.078 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:26:16.080 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:26:46.224 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:26:46.226 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:26:46.229 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:27:16.343 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:27:16.346 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:27:16.348 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:27:46.549 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:27:46.551 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:27:46.553 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:28:16.694 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:28:16.697 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:28:16.699 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:28:46.874 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:28:46.877 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:28:46.879 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:29:17.062 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:29:17.065 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:29:17.067 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:29:47.251 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:29:47.254 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:29:47.256 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:30:17.438 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:30:17.441 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:30:17.444 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:30:47.643 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:30:47.646 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:30:47.649 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:31:17.832 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:31:17.835 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:31:17.837 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:31:48.028 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:31:48.031 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:31:48.033 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:32:18.225 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:32:18.228 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:32:18.230 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:32:48.359 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:32:48.362 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:32:48.364 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:33:18.513 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:33:18.516 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:33:18.518 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:33:48.704 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:33:48.707 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:33:48.710 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:34:18.838 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:34:18.841 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:34:18.843 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:34:48.949 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:34:48.951 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:34:48.954 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:35:19.089 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:35:19.092 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:35:19.094 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:35:49.251 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:35:49.254 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:35:49.256 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:36:19.447 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:36:19.450 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:36:19.453 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:36:49.676 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:36:49.679 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:36:49.682 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:37:19.807 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:37:19.810 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:37:19.813 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:37:50.003 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:37:50.007 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:37:50.010 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:38:20.130 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:38:20.133 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:38:20.136 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:38:50.304 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:38:50.307 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:38:50.310 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:39:20.465 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:39:20.468 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:39:20.471 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:39:50.644 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:39:50.647 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:39:50.649 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:40:20.851 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:40:20.854 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:40:20.857 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:40:51.048 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:40:51.051 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:40:51.053 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:41:21.210 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:41:21.213 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:41:21.215 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:41:51.407 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:41:51.410 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:41:51.412 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:42:21.579 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:42:21.581 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:42:21.584 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:42:51.742 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:42:51.744 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:42:51.747 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:43:21.906 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:43:21.909 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:43:21.911 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:43:52.136 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:43:52.139 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:43:52.141 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:44:22.409 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:44:22.411 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:44:22.414 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:44:52.678 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:44:52.681 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:44:52.683 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:45:23.049 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:45:23.053 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:45:23.055 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:45:53.330 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:45:53.334 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:45:53.337 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:46:23.474 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:46:23.477 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:46:23.480 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:46:53.889 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:46:53.892 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:46:53.894 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:47:24.152 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:47:24.155 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:47:24.157 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:47:54.507 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:47:54.510 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:47:54.512 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:48:24.886 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:48:24.888 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:48:24.890 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:48:55.190 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:48:55.193 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:48:55.195 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:49:25.554 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:49:25.557 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:49:25.559 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:49:55.816 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:49:55.819 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:49:55.822 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:50:26.038 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:50:26.041 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:50:26.043 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:50:56.344 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:50:56.347 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:50:56.349 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:51:26.589 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:51:26.592 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:51:26.594 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:51:56.916 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:51:56.919 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:51:56.921 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:52:27.041 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:52:27.044 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:52:27.047 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:52:57.196 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:52:57.199 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:52:57.202 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:53:27.333 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:53:27.337 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:53:27.340 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:53:57.479 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:53:57.482 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:53:57.492 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:54:27.634 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:54:27.638 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:54:27.641 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:54:57.763 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:54:57.765 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:54:57.768 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:55:27.974 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:55:27.977 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:55:27.979 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:55:58.104 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:55:58.108 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:55:58.110 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:56:28.243 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:56:28.246 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:56:28.248 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:56:58.413 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:56:58.417 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:56:58.421 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:57:28.567 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:57:28.570 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:57:28.573 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:57:58.762 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:57:58.768 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:57:58.771 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:58:28.940 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:58:28.944 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:58:28.947 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:58:59.146 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:58:59.149 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:58:59.152 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:59:29.317 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:59:29.320 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:59:29.322 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:59:59.463 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:59:59.466 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T23:59:59.469 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:00:29.643 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:00:29.647 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:00:29.650 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:00:59.824 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:00:59.827 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:00:59.830 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:01:29.969 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:01:29.973 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:01:29.977 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:02:00.150 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:02:00.152 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:02:00.155 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:02:30.311 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:02:30.314 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:02:30.317 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:03:00.441 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:03:00.444 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:03:00.447 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:03:30.614 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:03:30.617 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:03:30.619 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:04:00.749 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:04:00.751 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:04:00.754 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:04:30.895 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:04:30.899 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:04:30.901 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:05:01.041 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:05:01.044 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:05:01.046 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:05:31.178 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:05:31.181 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:05:31.184 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:06:01.538 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:06:01.541 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:06:01.544 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:06:31.651 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:06:31.653 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:06:31.655 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:07:01.847 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:07:01.850 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:07:01.853 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:07:32.012 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:07:32.015 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:07:32.017 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:08:02.158 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:08:02.161 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:08:02.164 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:08:32.354 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:08:32.356 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:08:32.359 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:09:02.517 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:09:02.520 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:09:02.524 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:09:32.729 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:09:32.732 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:09:32.734 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:10:02.851 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:10:02.854 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:10:02.857 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:10:32.997 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:10:33.001 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:10:33.004 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:11:03.117 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:11:03.120 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:11:03.123 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:11:33.324 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:11:33.328 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:11:33.330 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:12:03.451 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:12:03.455 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:12:03.457 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:12:33.607 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:12:33.611 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:12:33.613 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:13:03.779 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:13:03.781 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:13:03.784 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:13:33.959 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:13:33.962 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:13:33.964 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:14:04.138 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:14:04.141 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:14:04.145 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:14:34.273 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:14:34.276 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:14:34.278 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:15:04.447 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:15:04.451 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:15:04.453 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:15:34.812 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:15:34.815 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:15:34.818 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:16:05.017 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:16:05.020 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:16:05.023 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:16:35.304 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:16:35.307 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:16:35.310 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:17:05.533 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:17:05.536 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:17:05.538 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:17:35.705 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:17:35.708 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:17:35.710 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:18:05.976 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:18:05.979 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:18:05.981 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:18:36.115 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:18:36.118 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:18:36.121 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:19:06.270 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:19:06.272 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:19:06.275 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:19:36.424 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:19:36.426 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:19:36.429 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:20:06.553 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:20:06.557 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:20:06.559 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:20:36.682 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:20:36.685 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:20:36.687 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:21:06.836 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:21:06.839 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:21:06.841 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:21:36.965 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:21:36.968 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:21:36.971 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:22:07.086 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:22:07.089 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:22:07.091 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:22:37.201 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:22:37.204 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:22:37.207 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:23:07.329 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:23:07.332 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:23:07.334 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:23:37.457 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:23:37.460 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:23:37.462 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:24:07.570 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:24:07.573 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:24:07.576 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:24:37.788 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:24:37.791 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:24:37.793 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:25:07.909 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:25:07.912 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:25:07.914 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:25:38.042 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:25:38.044 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:25:38.047 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:26:08.179 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:26:08.181 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:26:08.184 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:26:38.339 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:26:38.342 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:26:38.345 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:27:08.502 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:27:08.505 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:27:08.507 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:27:38.617 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:27:38.620 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:27:38.622 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:28:08.787 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:28:08.790 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:28:08.792 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:28:38.934 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:28:38.937 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:28:38.939 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:29:09.064 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:29:09.067 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:29:09.069 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:29:39.242 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:29:39.245 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:29:39.247 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:30:09.432 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:30:09.435 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:30:09.438 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:30:39.619 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:30:39.622 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:30:39.624 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:31:09.806 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:31:09.809 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:31:09.811 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:31:40.077 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:31:40.080 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:31:40.082 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:32:10.222 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:32:10.225 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:32:10.227 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:32:40.344 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:32:40.346 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:32:40.348 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:33:10.541 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:33:10.544 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:33:10.546 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:33:40.779 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:33:40.781 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:33:40.784 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:34:10.898 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:34:10.900 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:34:10.903 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:34:41.026 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:34:41.029 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:34:41.031 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:35:11.164 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:35:11.167 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:35:11.169 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:35:41.310 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:35:41.313 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:35:41.316 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:36:11.464 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:36:11.466 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:36:11.468 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:36:41.602 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:36:41.605 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:36:41.607 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:37:11.748 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:37:11.751 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:37:11.754 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:37:41.915 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:37:41.918 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:37:41.920 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:38:12.066 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:38:12.069 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:38:12.073 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:38:42.232 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:38:42.235 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:38:42.237 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:39:12.421 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:39:12.424 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:39:12.426 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:39:42.775 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:39:42.778 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:39:42.781 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:40:12.898 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:40:12.901 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:40:12.904 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:40:43.045 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:40:43.048 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:40:43.050 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:41:13.235 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:41:13.238 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:41:13.241 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:41:43.427 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:41:43.430 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:41:43.433 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:42:13.565 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:42:13.569 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:42:13.571 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:42:43.754 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:42:43.756 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:42:43.759 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:43:13.900 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:43:13.903 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:43:13.906 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:43:44.045 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:43:44.048 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:43:44.050 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:44:14.183 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:44:14.186 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:44:14.188 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:44:44.329 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:44:44.332 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:44:44.334 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:45:14.475 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:45:14.479 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:45:14.481 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:45:44.653 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:45:44.656 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:45:44.659 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:46:14.958 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:46:14.961 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:46:14.963 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:46:45.338 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:46:45.341 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:46:45.343 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:47:15.575 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:47:15.578 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:47:15.580 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:47:45.755 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:47:45.758 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:47:45.761 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:48:15.968 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:48:15.970 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:48:15.973 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:48:46.096 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:48:46.099 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:48:46.101 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:49:16.234 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:49:16.237 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:49:16.239 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:49:46.397 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:49:46.400 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:49:46.402 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:50:16.542 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:50:16.545 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:50:16.548 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:50:46.689 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:50:46.692 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:50:46.694 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:51:16.834 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:51:16.837 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:51:16.840 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:51:46.955 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:51:46.958 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:51:46.960 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:52:17.136 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:52:17.139 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:52:17.142 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:52:47.316 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:52:47.319 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:52:47.323 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:53:17.494 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:53:17.498 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:53:17.501 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:53:47.666 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:53:47.668 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:53:47.670 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:54:17.861 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:54:17.864 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:54:17.867 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:54:47.999 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:54:48.002 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:54:48.004 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:55:18.195 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:55:18.198 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:55:18.200 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:55:48.374 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:55:48.377 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:55:48.379 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:56:18.533 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:56:18.537 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:56:18.540 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:56:48.933 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:56:48.936 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:56:48.939 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:57:19.070 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:57:19.073 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:57:19.075 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:57:49.209 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:57:49.211 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:57:49.213 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:58:19.397 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:58:19.400 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:58:19.403 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:58:49.550 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:58:49.552 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:58:49.555 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:59:19.713 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:59:19.717 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:59:19.720 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:59:50.027 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:59:50.030 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T00:59:50.032 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:00:20.181 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:00:20.183 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:00:20.185 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:00:50.377 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:00:50.380 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:00:50.383 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:01:20.548 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:01:20.551 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:01:20.554 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:01:50.727 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:01:50.730 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:01:50.732 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:02:20.915 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:02:20.918 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:02:20.920 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:02:51.086 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:02:51.089 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:02:51.092 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:03:21.266 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:03:21.269 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:03:21.271 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:03:51.409 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:03:51.412 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:03:51.414 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:04:21.547 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:04:21.549 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:04:21.552 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:04:51.712 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:04:51.715 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:04:51.718 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:05:21.883 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:05:21.887 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:05:21.889 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:05:52.063 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:05:52.065 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:05:52.067 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:06:22.231 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:06:22.234 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:06:22.237 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:06:52.359 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:06:52.362 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:06:52.364 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:07:22.576 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:07:22.579 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:07:22.581 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:07:52.772 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:07:52.775 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:07:52.777 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:08:22.977 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:08:22.980 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:08:22.982 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:08:53.164 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:08:53.167 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:08:53.170 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:09:23.327 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:09:23.329 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:09:23.332 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:09:53.507 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:09:53.510 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:09:53.512 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:10:23.682 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:10:23.685 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:10:23.688 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:10:53.810 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:10:53.813 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:10:53.815 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:11:23.940 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:11:23.943 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:11:23.945 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:11:54.061 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:11:54.064 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:11:54.067 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:12:24.190 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:12:24.193 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:12:24.195 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:12:54.344 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:12:54.347 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:12:54.350 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:13:24.529 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:13:24.532 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:13:24.534 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:13:54.659 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:13:54.662 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:13:54.665 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:14:24.847 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:14:24.851 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:14:24.854 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:14:55.026 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:14:55.029 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:14:55.031 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:15:25.198 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:15:25.200 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:15:25.202 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:15:55.386 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:15:55.389 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:15:55.391 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:16:25.615 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:16:25.618 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:16:25.620 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:16:55.810 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:16:55.813 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:16:55.815 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:17:25.939 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:17:25.942 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:17:25.944 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:17:56.111 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:17:56.114 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:17:56.116 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:18:26.307 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:18:26.310 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:18:26.312 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:18:56.478 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:18:56.480 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:18:56.483 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:19:26.616 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:19:26.619 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:19:26.621 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:19:56.728 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:19:56.731 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:19:56.733 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:20:26.874 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:20:26.877 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:20:26.880 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:20:57.078 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:20:57.082 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:20:57.084 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:21:27.249 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:21:27.252 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:21:27.255 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:21:57.396 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:21:57.399 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:21:57.401 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:22:27.526 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:22:27.529 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:22:27.531 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:22:57.713 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:22:57.716 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:22:57.718 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:23:27.893 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:23:27.895 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:23:27.898 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:23:58.096 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:23:58.099 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:23:58.101 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:24:28.276 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:24:28.279 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:24:28.281 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:24:58.656 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:24:58.659 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:24:58.662 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:25:28.844 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:25:28.847 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:25:28.849 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:25:58.954 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:25:58.957 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:25:58.959 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:26:29.101 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:26:29.103 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:26:29.106 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:26:59.247 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:26:59.249 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:26:59.252 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:27:29.392 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:27:29.395 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:27:29.399 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:27:59.567 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:27:59.570 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:27:59.572 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:28:29.780 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:28:29.783 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:28:29.786 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:28:59.976 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:28:59.979 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:28:59.982 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:29:30.163 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:29:30.167 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:29:30.169 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:30:00.305 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:30:00.308 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:30:00.310 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:30:30.501 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:30:30.504 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:30:30.508 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:31:00.684 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:31:00.687 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:31:00.689 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:31:30.813 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:31:30.816 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:31:30.819 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:32:00.956 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:32:00.959 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:32:00.961 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:32:31.141 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:32:31.144 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:32:31.146 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:33:01.329 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:33:01.332 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:33:01.334 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:33:31.534 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:33:31.537 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:33:31.540 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:34:01.737 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:34:01.741 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:34:01.743 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:34:31.976 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:34:31.979 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:34:31.981 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:35:02.089 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:35:02.092 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:35:02.094 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:35:32.219 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:35:32.222 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:35:32.225 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:36:02.398 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:36:02.401 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:36:02.403 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:36:32.569 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:36:32.572 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:36:32.574 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:37:02.756 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:37:02.759 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:37:02.762 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:37:32.912 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:37:32.914 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:37:32.917 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:38:03.057 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:38:03.060 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:38:03.062 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:38:33.178 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:38:33.181 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:38:33.183 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:39:03.425 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:39:03.428 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:39:03.430 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:39:33.570 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:39:33.573 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:39:33.575 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:40:03.724 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:40:03.726 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:40:03.728 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:40:33.905 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:40:33.909 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:40:33.911 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:41:04.119 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:41:04.122 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:41:04.125 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:41:34.270 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:41:34.273 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:41:34.275 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:42:04.528 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:42:04.532 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:42:04.535 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:42:34.715 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:42:34.718 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:42:34.721 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:43:04.889 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:43:04.892 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:43:04.894 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:43:35.090 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:43:35.093 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:43:35.096 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:44:05.445 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:44:05.448 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:44:05.450 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:44:35.633 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:44:35.635 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:44:35.638 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:45:05.766 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:45:05.769 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:45:05.772 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:45:35.950 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:45:35.953 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:45:35.955 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:46:06.129 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:46:06.132 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:46:06.135 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:46:36.242 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:46:36.245 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:46:36.247 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:47:06.371 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:47:06.374 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:47:06.377 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:47:36.513 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:47:36.516 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:47:36.518 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:48:06.642 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:48:06.645 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:48:06.647 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:48:36.789 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:48:36.792 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:48:36.794 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:49:06.909 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:49:06.912 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:49:06.914 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:49:37.010 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:49:37.014 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:49:37.016 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:50:07.189 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:50:07.192 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:50:07.195 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:50:37.369 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:50:37.372 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:50:37.374 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:51:07.566 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:51:07.568 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:51:07.571 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:51:37.761 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:51:37.764 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:51:37.766 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:52:07.949 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:52:07.952 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:52:07.954 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:52:38.097 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:52:38.101 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:52:38.103 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:53:08.250 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:53:08.253 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:53:08.255 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:53:38.438 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:53:38.440 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:53:38.443 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:54:08.585 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:54:08.588 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:54:08.591 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:54:38.762 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:54:38.765 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:54:38.767 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:55:08.933 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:55:08.936 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:55:08.939 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:55:39.113 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:55:39.115 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:55:39.117 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:56:09.292 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:56:09.295 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:56:09.298 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:56:39.423 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:56:39.426 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:56:39.429 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:57:09.601 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:57:09.604 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:57:09.606 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:57:39.765 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:57:39.767 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:57:39.769 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:58:09.894 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:58:09.897 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:58:09.900 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:58:40.091 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:58:40.094 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:58:40.096 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:59:10.236 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:59:10.239 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:59:10.241 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:59:40.365 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:59:40.368 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T01:59:40.370 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:00:10.537 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:00:10.539 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:00:10.542 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:00:40.724 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:00:40.728 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:00:40.730 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:01:10.920 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:01:10.923 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:01:10.926 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:01:41.102 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:01:41.107 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:01:41.110 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:02:11.455 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:02:11.459 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:02:11.461 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:02:41.651 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:02:41.654 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:02:41.656 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:03:11.797 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:03:11.801 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:03:11.804 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:03:42.001 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:03:42.004 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:03:42.007 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:04:12.190 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:04:12.192 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:04:12.194 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:04:42.369 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:04:42.373 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:04:42.376 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:05:12.531 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:05:12.535 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:05:12.537 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:05:42.736 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:05:42.740 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:05:42.743 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:06:12.870 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:06:12.873 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:06:12.875 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:06:43.037 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:06:43.040 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:06:43.043 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:07:13.208 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:07:13.211 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:07:13.214 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:07:43.404 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:07:43.407 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:07:43.410 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:08:13.584 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:08:13.587 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:08:13.589 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:08:43.697 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:08:43.700 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:08:43.703 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:09:13.844 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:09:13.848 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:09:13.852 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:09:44.040 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:09:44.043 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:09:44.045 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:10:14.218 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:10:14.223 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:10:14.226 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:10:44.390 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:10:44.393 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:10:44.395 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:11:14.577 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:11:14.580 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:11:14.582 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:11:44.765 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:11:44.768 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:11:44.770 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:12:14.906 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:12:14.908 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:12:14.911 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:12:45.074 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:12:45.077 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:12:45.080 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:13:15.267 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:13:15.270 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:13:15.272 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:13:45.432 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:13:45.435 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:13:45.438 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:14:15.572 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:14:15.575 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:14:15.577 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:14:45.726 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:14:45.729 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:14:45.731 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:15:15.880 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:15:15.883 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:15:15.886 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:15:46.035 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:15:46.037 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:15:46.040 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:16:16.180 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:16:16.183 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:16:16.186 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:16:46.317 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:16:46.323 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:16:46.326 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:17:16.471 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:17:16.474 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:17:16.476 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:17:46.602 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:17:46.604 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:17:46.607 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:18:16.790 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:18:16.792 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:18:16.795 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:18:46.918 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:18:46.921 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:18:46.923 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:19:17.099 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:19:17.102 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:19:17.105 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:19:47.296 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:19:47.299 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:19:47.301 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:20:17.507 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:20:17.510 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:20:17.513 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:20:47.654 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:20:47.656 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:20:47.659 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:21:17.850 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:21:17.852 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:21:17.855 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:21:48.046 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:21:48.049 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:21:48.051 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:22:18.176 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:22:18.178 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:22:18.181 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:22:48.347 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:22:48.350 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:22:48.352 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:23:18.543 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:23:18.546 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:23:18.549 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:23:48.714 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:23:48.716 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:23:48.719 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:24:18.928 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:24:18.932 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:24:18.936 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:24:49.115 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:24:49.118 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:24:49.120 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:25:19.266 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:25:19.269 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:25:19.272 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:25:49.457 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:25:49.461 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:25:49.464 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:26:19.607 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:26:19.610 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:26:19.612 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:26:49.799 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:26:49.802 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:26:49.805 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:27:19.962 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:27:19.965 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:27:19.967 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:27:50.111 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:27:50.114 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:27:50.116 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:28:20.246 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:28:20.249 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:28:20.252 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:28:50.396 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:28:50.399 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:28:50.401 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:29:20.572 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:29:20.574 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:29:20.576 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:29:50.759 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:29:50.762 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:29:50.764 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:30:20.940 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:30:20.943 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:30:20.945 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:30:51.070 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:30:51.074 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:30:51.076 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:31:21.181 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:31:21.185 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:31:21.188 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:31:51.337 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:31:51.341 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:31:51.343 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:32:21.541 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:32:21.545 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:32:21.548 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:32:51.670 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:32:51.674 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:32:51.676 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:33:21.842 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:33:21.845 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:33:21.848 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:33:52.004 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:33:52.007 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:33:52.009 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:34:22.182 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:34:22.185 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:34:22.188 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:34:52.352 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:34:52.355 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:34:52.357 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:35:22.524 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:35:22.527 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:35:22.529 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:35:52.671 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:35:52.675 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:35:52.678 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:36:22.826 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:36:22.829 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:36:22.833 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:36:52.986 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:36:52.989 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:36:52.992 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:37:23.174 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:37:23.177 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:37:23.180 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:37:53.314 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:37:53.316 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:37:53.319 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:38:23.459 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:38:23.463 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:38:23.465 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:38:53.646 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:38:53.649 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:38:53.651 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:39:23.826 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:39:23.829 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:39:23.832 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:39:54.021 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:39:54.025 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:39:54.029 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:40:24.193 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:40:24.196 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:40:24.199 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:40:54.371 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:40:54.375 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:40:54.377 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:41:24.575 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:41:24.578 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:41:24.581 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:41:54.746 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:41:54.749 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:41:54.752 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:42:24.943 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:42:24.946 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:42:24.949 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:42:55.131 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:42:55.134 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:42:55.137 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:43:25.335 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:43:25.338 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:43:25.341 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:43:55.531 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:43:55.535 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:43:55.537 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:44:25.702 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:44:25.705 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:44:25.707 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:44:55.848 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:44:55.851 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:44:55.854 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:45:26.194 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:45:26.197 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:45:26.200 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:45:56.398 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:45:56.401 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:45:56.404 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:46:26.578 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:46:26.581 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:46:26.583 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:46:56.773 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:46:56.776 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:46:56.780 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:47:26.919 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:47:26.922 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:47:26.924 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:47:57.100 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:47:57.105 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:47:57.108 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:48:27.295 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:48:27.298 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:48:27.300 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:48:57.458 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:48:57.463 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:48:57.466 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:49:27.586 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:49:27.594 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:49:27.598 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:49:57.776 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:49:57.779 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:49:57.782 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:50:27.963 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:50:27.966 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:50:27.969 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:50:58.134 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:50:58.138 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:50:58.141 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:51:28.261 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:51:28.264 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:51:28.267 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:51:58.423 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:51:58.426 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:51:58.429 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:52:28.553 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:52:28.556 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:52:28.558 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:52:58.699 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:52:58.702 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:52:58.704 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:53:28.836 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:53:28.839 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:53:28.841 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:53:58.974 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:53:58.976 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:53:58.979 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:54:29.120 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:54:29.122 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:54:29.125 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:54:59.261 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:54:59.264 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:54:59.266 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:55:29.400 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:55:29.403 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:55:29.405 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:55:59.596 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:55:59.598 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:55:59.600 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:56:29.775 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:56:29.778 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:56:29.780 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:56:59.963 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:56:59.966 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:56:59.968 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:57:30.151 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:57:30.154 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:57:30.156 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:58:00.338 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:58:00.341 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:58:00.343 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:58:30.543 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:58:30.546 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:58:30.549 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:59:00.739 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:59:00.742 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:59:00.744 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:59:30.926 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:59:30.929 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T02:59:30.931 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:00:01.066 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:00:01.069 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:00:01.071 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:00:31.243 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:00:31.246 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:00:31.249 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:01:01.414 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:01:01.417 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:01:01.419 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:01:31.619 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:01:31.622 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:01:31.624 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:02:01.799 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:02:01.801 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:02:01.803 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:02:31.995 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:02:31.997 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:02:32.000 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:03:02.151 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:03:02.154 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:03:02.156 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:03:32.337 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:03:32.341 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:03:32.343 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:04:02.533 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:04:02.536 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:04:02.539 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:04:32.664 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:04:32.667 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:04:32.670 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:05:02.842 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:05:02.845 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:05:02.848 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:05:33.046 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:05:33.049 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:05:33.051 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:06:03.169 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:06:03.172 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:06:03.174 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:06:33.496 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:06:33.500 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:06:33.503 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:07:03.644 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:07:03.647 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:07:03.649 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:07:33.773 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:07:33.776 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:07:33.779 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:08:03.901 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:08:03.904 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:08:03.907 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:08:34.023 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:08:34.026 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:08:34.029 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:09:04.177 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:09:04.181 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:09:04.183 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:09:34.288 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:09:34.292 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:09:34.294 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:10:04.479 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:10:04.482 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:10:04.485 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:10:34.624 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:10:34.627 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:10:34.629 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:11:04.778 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:11:04.783 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:11:04.787 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:11:34.957 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:11:34.960 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:11:34.962 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:12:05.140 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:12:05.144 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:12:05.146 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:12:35.306 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:12:35.309 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:12:35.312 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:13:05.495 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:13:05.497 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:13:05.500 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:13:35.633 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:13:35.636 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:13:35.638 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:14:05.787 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:14:05.789 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:14:05.791 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:14:35.925 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:14:35.927 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:14:35.930 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:15:06.238 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:15:06.240 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:15:06.242 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:15:36.425 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:15:36.428 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:15:36.430 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:16:06.596 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:16:06.598 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:16:06.601 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:16:36.775 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:16:36.778 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:16:36.780 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:17:06.987 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:17:06.990 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:17:06.992 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:17:37.178 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:17:37.181 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:17:37.184 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:18:07.321 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:18:07.324 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:18:07.326 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:18:37.458 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:18:37.461 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:18:37.464 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:19:07.596 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:19:07.599 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:19:07.601 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:19:37.750 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:19:37.753 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:19:37.756 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:20:07.888 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:20:07.890 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:20:07.892 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:20:38.051 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:20:38.054 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:20:38.056 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:21:08.236 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:21:08.238 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:21:08.240 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:21:38.415 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:21:38.418 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:21:38.420 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:22:08.546 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:22:08.549 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:22:08.551 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:22:38.692 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:22:38.696 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:22:38.698 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:23:08.864 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:23:08.867 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:23:08.870 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:23:38.976 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:23:38.979 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:23:38.981 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:24:09.173 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:24:09.176 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:24:09.178 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:24:39.427 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:24:39.429 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:24:39.432 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:25:09.606 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:25:09.609 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:25:09.611 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:25:39.810 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:25:39.813 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:25:39.815 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:26:09.981 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:26:09.983 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:26:09.986 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:26:40.127 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:26:40.130 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:26:40.132 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:27:10.516 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:27:10.519 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:27:10.521 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:27:40.644 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:27:40.648 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:27:40.650 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:28:10.825 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:28:10.828 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:28:10.830 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:28:40.944 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:28:40.947 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:28:40.950 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:29:11.328 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:29:11.331 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:29:11.333 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:29:41.539 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:29:41.594 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:29:41.597 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:30:11.732 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:30:11.734 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:30:11.737 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:30:41.923 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:30:41.926 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:30:41.928 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:31:12.144 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:31:12.148 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:31:12.150 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:31:42.315 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:31:42.318 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:31:42.322 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:32:12.486 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:32:12.489 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:32:12.491 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:32:42.699 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:32:42.702 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:32:42.705 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:33:12.887 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:33:12.890 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:33:12.892 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:33:43.011 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:33:43.014 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:33:43.016 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:34:13.165 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:34:13.168 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:34:13.170 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:34:43.320 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:34:43.323 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:34:43.326 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:35:13.468 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:35:13.471 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:35:13.474 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:35:43.628 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:35:43.632 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:35:43.634 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:36:13.822 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:36:13.825 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:36:13.828 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:36:44.018 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:36:44.022 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:36:44.024 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:37:14.207 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:37:14.210 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:37:14.212 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:37:44.328 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:37:44.332 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:37:44.334 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:38:14.483 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:38:14.486 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:38:14.488 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:38:44.637 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:38:44.640 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:38:44.643 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:39:14.774 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:39:14.777 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:39:14.779 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:39:44.920 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:39:44.923 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:39:44.925 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:40:15.074 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:40:15.077 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:40:15.079 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:40:45.238 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:40:45.240 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:40:45.243 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:41:15.418 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:41:15.421 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:41:15.423 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:41:45.597 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:41:45.600 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:41:45.603 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:42:15.786 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:42:15.789 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:42:15.791 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:42:45.898 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:42:45.901 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:42:45.903 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:43:16.020 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:43:16.022 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:43:16.025 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:43:46.154 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:43:46.157 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:43:46.159 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:44:16.292 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:44:16.295 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:44:16.298 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:44:46.454 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:44:46.457 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:44:46.459 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:45:16.600 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:45:16.603 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:45:16.605 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:45:46.729 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:45:46.732 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:45:46.734 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:46:16.921 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:46:16.924 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:46:16.926 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:46:47.102 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:46:47.104 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:46:47.107 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:47:17.240 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:47:17.242 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:47:17.244 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:47:47.436 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:47:47.439 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:47:47.442 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:48:17.559 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:48:17.562 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:48:17.564 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:48:47.754 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:48:47.757 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:48:47.759 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:49:17.949 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:49:17.953 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:49:17.955 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:49:48.129 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:49:48.131 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:49:48.134 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:50:18.301 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:50:18.304 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:50:18.306 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:50:48.638 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:50:48.641 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:50:48.644 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:51:18.817 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:51:18.820 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:51:18.822 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:51:48.988 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:51:48.991 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:51:48.993 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:52:19.135 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:52:19.138 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:52:19.141 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:52:49.330 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:52:49.333 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:52:49.336 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:53:19.510 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:53:19.513 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:53:19.515 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:53:49.689 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:53:49.695 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:53:49.701 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:54:19.902 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:54:19.905 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:54:19.907 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:54:50.099 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:54:50.102 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:54:50.104 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:55:20.243 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:55:20.247 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:55:20.249 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:55:50.356 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:55:50.359 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:55:50.361 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:56:20.477 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:56:20.480 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:56:20.482 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:56:50.615 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:56:50.618 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:56:50.620 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:57:20.736 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:57:20.740 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:57:20.743 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:57:50.890 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:57:50.893 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:57:50.895 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:58:21.020 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:58:21.022 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:58:21.024 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:58:51.157 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:58:51.160 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:58:51.162 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:59:21.286 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:59:21.288 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:59:21.290 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:59:51.423 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:59:51.426 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T03:59:51.429 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:00:21.561 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:00:21.564 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:00:21.566 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:00:51.744 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:00:51.747 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:00:51.749 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:01:21.895 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:01:21.898 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:01:21.901 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:01:52.016 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:01:52.018 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:01:52.020 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:02:22.154 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:02:22.156 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:02:22.159 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:02:52.266 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:02:52.268 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:02:52.271 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:03:22.450 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:03:22.453 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:03:22.457 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:03:52.597 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:03:52.600 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:03:52.602 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:04:22.776 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:04:22.779 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:04:22.781 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:04:52.925 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:04:52.928 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:04:52.930 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:05:23.086 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:05:23.088 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:05:23.091 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:05:53.216 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:05:53.219 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:05:53.222 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:06:23.410 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:06:23.413 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:06:23.415 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:06:53.567 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:06:53.569 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:06:53.572 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:07:23.744 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:07:23.747 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:07:23.749 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:07:53.949 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:07:53.952 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:07:53.954 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:08:24.088 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:08:24.090 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:08:24.093 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:08:54.209 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:08:54.211 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:08:54.214 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:09:24.346 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:09:24.352 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:09:24.355 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:09:54.509 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:09:54.512 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:09:54.515 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:10:24.658 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:10:24.661 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:10:24.663 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:10:54.784 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:10:54.787 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:10:54.790 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:11:24.938 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:11:24.940 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:11:24.942 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:11:55.092 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:11:55.095 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:11:55.097 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:12:25.281 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:12:25.284 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:12:25.286 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:12:55.485 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:12:55.489 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:12:55.491 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:13:25.639 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:13:25.642 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:13:25.644 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:13:55.820 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:13:55.823 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:13:55.825 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:14:26.007 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:14:26.009 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:14:26.012 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:14:56.120 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:14:56.123 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:14:56.125 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:15:26.232 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:15:26.235 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:15:26.237 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:15:56.369 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:15:56.371 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:15:56.373 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:16:26.514 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:16:26.517 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:16:26.519 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:16:56.687 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:16:56.690 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:16:56.692 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:17:26.874 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:17:26.877 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:17:26.880 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:17:57.036 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:17:57.039 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:17:57.043 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:18:27.210 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:18:27.213 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:18:27.216 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:18:57.397 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:18:57.399 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:18:57.402 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:19:27.539 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:19:27.542 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:19:27.545 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:19:57.677 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:19:57.681 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:19:57.683 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:20:27.833 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:20:27.836 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:20:27.838 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:20:58.015 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:20:58.018 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:20:58.020 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:21:28.139 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:21:28.142 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:21:28.144 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:21:58.277 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:21:58.280 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:21:58.282 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:22:28.399 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:22:28.402 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:22:28.405 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:22:58.553 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:22:58.556 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:22:58.559 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:23:28.691 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:23:28.694 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:23:28.696 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:23:58.829 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:23:58.832 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:23:58.835 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:24:28.957 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:24:28.959 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:24:28.961 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:24:59.078 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:24:59.329 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:24:59.331 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:25:29.521 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:25:29.524 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:25:29.526 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:25:59.693 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:25:59.696 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:25:59.699 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:26:29.863 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:26:29.867 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:26:29.870 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:27:00.035 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:27:00.038 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:27:00.040 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:27:30.197 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:27:30.201 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:27:30.203 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:28:00.361 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:28:00.364 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:28:00.366 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:28:30.498 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:28:30.502 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:28:30.504 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:29:00.687 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:29:00.690 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:29:00.692 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:29:30.866 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:29:30.869 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:29:30.872 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:30:01.046 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:30:01.051 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:30:01.054 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:30:31.242 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:30:31.245 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:30:31.247 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:31:01.413 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:31:01.415 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:31:01.418 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:31:31.601 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:31:31.604 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:31:31.606 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:32:01.806 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:32:01.809 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:32:01.811 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:32:31.949 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:32:31.952 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:32:31.955 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:33:02.087 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:33:02.090 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:33:02.092 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:33:32.234 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:33:32.236 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:33:32.239 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:34:02.348 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:34:02.351 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:34:02.353 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:34:32.467 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:34:32.470 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:34:32.472 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:35:02.604 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:35:02.607 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:35:02.609 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:35:32.742 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:35:32.745 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:35:32.748 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:36:02.854 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:36:02.857 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:36:02.860 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:36:32.953 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:36:32.956 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:36:32.959 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:37:03.071 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:37:03.074 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:37:03.076 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:37:33.225 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:37:33.228 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:37:33.230 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:38:03.355 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:38:03.358 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:38:03.361 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:38:33.548 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:38:33.551 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:38:33.554 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:39:03.697 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:39:03.700 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:39:03.702 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:39:33.872 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:39:33.875 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:39:33.878 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:40:04.044 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:40:04.047 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:40:04.050 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:40:34.240 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:40:34.243 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:40:34.246 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:41:04.372 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:41:04.375 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:41:04.378 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:41:34.526 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:41:34.530 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:41:34.533 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:42:04.686 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:42:04.689 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:42:04.691 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:42:34.834 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:42:34.837 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:42:34.839 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:43:05.029 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:43:05.031 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:43:05.034 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:43:35.209 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:43:35.211 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:43:35.213 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:44:05.413 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:44:05.415 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:44:05.417 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:44:35.605 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:44:35.608 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:44:35.610 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:45:05.756 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:45:05.759 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:45:05.762 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:45:35.911 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:45:35.913 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:45:35.916 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:46:06.047 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:46:06.050 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:46:06.052 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:46:36.211 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:46:36.213 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:46:36.215 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:47:06.333 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:47:06.336 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:47:06.339 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:47:36.477 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:47:36.480 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:47:36.482 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:48:06.614 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:48:06.617 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:48:06.619 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:48:36.760 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:48:36.762 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:48:36.764 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:49:06.898 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:49:06.900 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:49:06.903 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:49:37.079 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:49:37.082 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:49:37.084 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:50:07.266 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:50:07.269 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:50:07.272 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:50:37.446 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:50:37.448 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:50:37.451 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:51:07.584 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:51:07.587 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:51:07.590 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:51:37.772 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:51:37.774 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:51:37.776 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:52:07.960 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:52:07.963 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:52:07.966 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:52:38.148 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:52:38.151 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:52:38.153 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:53:08.344 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:53:08.347 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:53:08.349 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:53:38.532 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:53:38.535 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:53:38.538 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:54:08.728 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:54:08.730 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:54:08.732 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:54:38.878 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:54:38.881 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:54:38.884 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:55:09.054 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:55:09.057 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:55:09.059 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:55:39.241 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:55:39.244 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:55:39.246 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:56:09.604 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:56:09.607 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:56:09.609 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:56:39.746 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:56:39.749 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:56:39.751 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:57:09.921 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:57:09.924 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:57:09.926 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:57:40.125 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:57:40.129 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:57:40.132 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:58:10.296 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:58:10.299 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:58:10.301 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:58:40.429 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:58:40.431 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:58:40.434 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:59:10.592 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:59:10.594 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:59:10.597 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:59:40.735 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:59:40.738 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T04:59:40.740 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:00:10.876 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:00:10.879 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:00:10.881 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:00:41.014 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:00:41.016 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:00:41.019 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:01:11.214 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:01:11.217 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:01:11.220 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:01:41.402 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:01:41.405 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:01:41.407 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:02:11.590 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:02:11.594 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:02:11.596 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:02:41.802 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:02:41.805 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:02:41.807 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:03:11.960 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:03:11.963 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:03:11.965 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:03:42.127 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:03:42.130 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:03:42.133 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:04:12.298 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:04:12.301 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:04:12.303 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:04:42.462 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:04:42.465 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:04:42.467 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:05:12.595 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:05:12.600 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:05:12.602 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:05:42.796 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:05:42.800 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:05:42.803 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:06:12.975 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:06:12.977 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:06:12.980 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:06:43.088 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:06:43.093 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:06:43.097 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:07:13.285 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:07:13.288 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:07:13.291 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:07:43.424 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:07:43.428 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:07:43.430 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:08:13.570 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:08:13.575 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:08:13.578 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:08:43.749 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:08:43.753 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:08:43.755 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:09:13.937 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:09:13.940 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:09:13.943 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:09:44.074 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:09:44.078 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:09:44.081 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:10:14.245 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:10:14.256 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:10:14.260 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:10:44.383 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:10:44.386 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:10:44.389 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:11:14.588 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:11:14.591 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:11:14.594 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:11:44.732 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:11:44.735 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:11:44.737 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:12:14.922 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:12:14.925 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:12:14.928 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:12:45.109 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:12:45.113 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:12:45.116 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:13:15.289 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:13:15.292 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:13:15.294 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:13:45.452 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:13:45.456 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:13:45.458 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:14:15.648 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:14:15.651 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:14:15.653 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:14:45.819 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:14:45.821 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:14:45.824 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:15:15.971 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:15:15.973 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:15:15.975 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:15:46.170 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:15:46.172 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:15:46.174 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:16:16.340 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:16:16.342 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:16:16.345 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:16:46.519 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:16:46.522 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:16:46.524 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:17:16.637 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:17:16.640 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:17:16.642 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:17:46.803 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:17:46.806 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:17:46.808 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:18:17.000 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:18:17.003 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:18:17.005 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:18:47.187 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:18:47.190 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:18:47.193 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:19:17.313 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:19:17.316 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:19:17.318 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:19:47.442 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:19:47.445 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:19:47.447 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:20:17.588 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:20:17.591 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:20:17.593 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:20:47.710 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:20:47.713 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:20:47.716 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:21:17.863 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:21:17.867 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:21:17.871 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:21:48.010 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:21:48.013 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:21:48.015 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:22:18.139 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:22:18.142 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:22:18.147 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:22:48.276 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:22:48.279 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:22:48.281 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:23:18.478 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:23:18.481 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:23:18.483 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:23:48.626 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:23:48.629 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:23:48.631 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:24:18.764 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:24:18.767 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:24:18.770 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:24:48.926 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:24:48.929 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:24:48.931 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:25:19.105 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:25:19.108 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:25:19.110 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:25:49.284 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:25:49.287 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:25:49.289 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:26:19.405 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:26:19.408 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:26:19.410 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:26:49.560 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:26:49.562 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:26:49.565 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:27:19.739 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:27:19.742 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:27:19.744 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:27:49.919 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:27:49.921 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:27:49.924 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:28:20.098 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:28:20.101 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:28:20.103 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:28:50.278 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:28:50.280 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:28:50.282 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:29:20.448 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:29:20.451 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:29:20.454 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:29:50.736 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:29:50.739 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:29:50.741 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:30:20.908 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:30:20.910 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:30:20.912 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:30:51.112 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:30:51.116 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:30:51.119 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:31:21.292 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:31:21.296 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:31:21.299 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:31:51.445 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:31:51.447 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:31:51.450 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:32:21.609 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:32:21.612 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:32:21.614 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:32:51.847 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:32:51.850 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:32:51.853 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:33:22.044 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:33:22.047 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:33:22.050 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:33:52.155 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:33:52.158 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:33:52.160 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:34:22.326 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:34:22.329 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:34:22.331 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:34:52.547 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:34:52.550 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:34:52.552 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:35:22.699 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:35:22.702 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:35:22.705 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:35:52.845 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:35:52.848 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:35:52.850 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:36:23.045 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:36:23.048 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:36:23.051 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:36:53.407 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:36:53.410 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:36:53.412 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:37:23.595 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:37:23.599 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:37:23.603 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:37:53.800 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:37:53.804 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:37:53.806 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:38:23.933 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:38:23.937 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:38:23.940 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:38:54.070 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:38:54.074 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:38:54.076 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:39:24.199 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:39:24.202 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:39:24.204 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:39:54.568 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:39:54.574 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:39:54.580 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:40:24.739 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:40:24.743 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:40:24.749 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:40:54.936 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:40:54.939 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:40:54.942 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:41:25.097 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:41:25.100 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:41:25.103 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:41:55.269 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:41:55.271 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:41:55.274 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:42:25.457 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:42:25.460 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:42:25.462 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:42:55.636 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:42:55.639 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:42:55.641 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:43:25.816 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:43:25.819 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:43:25.821 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:43:55.954 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:43:55.957 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:43:55.959 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:44:26.092 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:44:26.095 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:44:26.097 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:44:56.237 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:44:56.240 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:44:56.243 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:45:26.425 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:45:26.428 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:45:26.431 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:45:56.579 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:45:56.582 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:45:56.584 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:46:26.759 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:46:26.762 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:46:26.765 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:46:56.923 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:46:56.926 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:46:56.928 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:47:27.051 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:47:27.054 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:47:27.056 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:47:57.445 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:47:57.448 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:47:57.450 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:48:27.558 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:48:27.561 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:48:27.563 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:48:57.740 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:48:57.743 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:48:57.745 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:49:27.929 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:49:27.931 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:49:27.934 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:49:58.107 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:49:58.110 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:49:58.112 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:50:28.446 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:50:28.448 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:50:28.451 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:50:58.572 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:50:58.575 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:50:58.577 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:51:28.702 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:51:28.706 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:51:28.709 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:51:58.895 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:51:58.898 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:51:58.901 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:52:29.069 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:52:29.072 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:52:29.074 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:52:59.259 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:52:59.262 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:52:59.264 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:53:29.447 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:53:29.450 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:53:29.453 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:53:59.618 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:53:59.622 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:53:59.624 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:54:29.806 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:54:29.809 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:54:29.811 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:54:59.994 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:54:59.997 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:55:00.000 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:55:30.190 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:55:30.194 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:55:30.197 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:56:00.385 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:56:00.388 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:56:00.391 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:56:30.527 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:56:30.531 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:56:30.533 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:57:00.673 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:57:00.676 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:57:00.679 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:57:30.819 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:57:30.824 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:57:30.827 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:58:00.978 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:58:00.981 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:58:00.984 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:58:31.192 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:58:31.195 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:58:31.197 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:59:01.331 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:59:01.334 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:59:01.339 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:59:31.508 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:59:31.513 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T05:59:31.515 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:00:01.665 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:00:01.668 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:00:01.670 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:00:31.794 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:00:31.797 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:00:31.800 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:01:01.987 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:01:01.990 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:01:01.993 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:01:32.119 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:01:32.123 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:01:32.125 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:02:02.257 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:02:02.260 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:02:02.262 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:02:32.378 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:02:32.381 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:02:32.383 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:03:02.665 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:03:02.668 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:03:02.671 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:03:32.795 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:03:32.798 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:03:32.801 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:04:02.932 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:04:02.936 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:04:02.939 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:04:33.088 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:04:33.091 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:04:33.093 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:05:03.232 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:05:03.235 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:05:03.237 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:05:33.379 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:05:33.382 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:05:33.384 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:06:03.557 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:06:03.560 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:06:03.563 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:06:33.761 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:06:33.765 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:06:33.767 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:07:03.950 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:07:03.953 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:07:03.957 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:07:34.154 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:07:34.157 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:07:34.159 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:08:04.290 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:08:04.293 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:08:04.295 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:08:34.455 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:08:34.458 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:08:34.460 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:09:04.633 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:09:04.639 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:09:04.642 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:09:34.813 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:09:34.816 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:09:34.818 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:10:04.983 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:10:04.986 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:10:04.989 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:10:35.171 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:10:35.174 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:10:35.177 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:11:05.308 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:11:05.311 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:11:05.314 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:11:35.471 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:11:35.475 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:11:35.477 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:12:05.616 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:12:05.620 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:12:05.622 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:12:35.738 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:12:35.742 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:12:35.744 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:13:05.884 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:13:05.887 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:13:05.890 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:13:36.021 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:13:36.024 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:13:36.027 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:14:06.150 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:14:06.152 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:14:06.155 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:14:36.287 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:14:36.290 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:14:36.292 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:15:06.434 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:15:06.436 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:15:06.438 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:15:36.562 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:15:36.565 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:15:36.568 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:16:06.717 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:16:06.719 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:16:06.722 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:16:36.862 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:16:36.866 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:16:36.868 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:17:07.009 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:17:07.012 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:17:07.016 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:17:37.146 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:17:37.149 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:17:37.151 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:18:07.276 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:18:07.280 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:18:07.285 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:18:37.422 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:18:37.425 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:18:37.428 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:19:07.559 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:19:07.562 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:19:07.564 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:19:37.688 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:19:37.691 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:19:37.693 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:20:07.826 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:20:07.828 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:20:07.831 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:20:38.019 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:20:38.022 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:20:38.024 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:21:08.207 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:21:08.210 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:21:08.212 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:21:38.329 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:21:38.332 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:21:38.334 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:22:08.482 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:22:08.486 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:22:08.488 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:22:38.730 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:22:38.732 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:22:38.735 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:23:08.916 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:23:08.919 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:23:08.921 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:23:39.047 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:23:39.050 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:23:39.052 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:24:09.201 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:24:09.204 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:24:09.207 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:24:39.330 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:24:39.333 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:24:39.336 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:25:09.485 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:25:09.488 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:25:09.491 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:25:39.639 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:25:39.642 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:25:39.645 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:26:09.793 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:26:09.796 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:26:09.799 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:26:39.940 DEBUG:teuthology.orchestra.run.smithi052:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:26:39.942 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:26:39.945 DEBUG:teuthology.orchestra.run.smithi158:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-24T06:27:04.989 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-06-24T06:27:04.990 DEBUG:teuthology.task.console_log:Killing console logger for smithi052 2023-06-24T06:27:04.990 DEBUG:teuthology.task.console_log:Killing console logger for smithi089 2023-06-24T06:27:04.991 DEBUG:teuthology.task.console_log:Killing console logger for smithi158 2023-06-24T06:27:04.991 DEBUG:teuthology.exit:Finished running handlers